Граф коммитов

94 Коммитов

Автор SHA1 Сообщение Дата
Vikas Bhansali bea95b401b
Preparing for 2.0.3 release (#1122)
* Preparing for 2.0.3 release
2023-04-26 11:26:58 +05:30
Vikas Bhansali 771f66b78f
sync call can force upload a file to storage if configured (#1086)
* Adding new option to force upload a file
2023-03-22 10:56:02 +05:30
weizhi 8f655cf9e1
Fix: async (background) mount may cause problems (#1088)
#1079
Pod deletion will cause global mount point to disappear. The root cause is csi driver will bind mount the global mount point into Pod volume immediately after blobfuse2 mount return successfully. However, fuse is still mounting at background, so actually bind mount and fuse mount happened at the same time, this will lead to a problem that unmount the bind mount (when deleting a Pod) will cause the original mount point unmounted as well.
#1081
Mount is actually failed, but the errno returned by blobfuse2 is 0 and no error log (both terminal and log file).
2023-03-22 10:29:36 +05:30
Vikas Bhansali 6165f412b7
Subdirectory as cli option and support for nonempty libfuse option (#975)
* Allow mounting on a nonempty directory
* Allow subdirectory to be configured using cli option
2022-11-16 16:27:46 +05:30
Tamer Sherif 6fa067d419
Document required config for azstorage + fix samples (#936)
* added required comment and fixed sampels

* more detail
2022-10-12 09:11:22 +05:30
Nick Piper 5cf214eb43
Change https_proxy / http_proxy example to a working example (#933)
I found that

`https_proxy=http://172.10.10.10:8888 blobfuse2...`

did not work. Logs show `proxyconnect tcp: dial tcp: lookup http://172.10.10.10: no such host`

However this works: `https_proxy=172.10.10.10:8888 blobfuse2...`

So I'm offering this patch to the readme accordingly
2022-10-11 01:16:55 -07:00
Gauri Prasad 0369d6098f
Added support to work with virtual directories without the special marker directory blob (#927)
* Added support to work with virtual directories

* fix spelling

* Fix lint

* Fix subdir issue

* Correcting infinte loop in getattr using list failure condition

* Add cli flag to enable virtual directory support

* Update ReadME for virtual-dir cli options

* Corrected

Co-authored-by: vibhansa-msft <vibhansa@microsoft.com>
2022-10-07 10:25:01 +05:30
Vikas Bhansali 6f8d90ad71
Docker installation and container image build (#914)
* adding commands to build and launch a container image with blobfuse2 installed

* Adding docker installation steps

* spell correction

* Adding support for fuse2 docker

* Correct fuse installation step

* Correct fuse installation step

* Adding steps to publish container image to azure container registry

* Adding script to map dependency graph

* Changes as per review comments

* Adding docker container related help in README

* Add flag to ignore open flag for write to work

* Correcting ignore open flags related option in dockerfile

* Correct handling of ignore open flags

* Correcting flag on cli

* Run blobfuse in foreground so that container stays up untill unmount is done

* Spell correction

Co-authored-by: Ubuntu <vibhansa@vibhansa-ubn20-perf.x53acyytduluvkundcmr1j05nd.sx.internal.cloudapp.net>
2022-10-01 09:59:38 +05:30
Gauri Prasad cdde152a0d
Fix for ignore open flags (#917)
* Fix typo for ignore open flags

* Changelog

* Fixed error and Readme

* correct the yaml

* try to fix ut

* revert test

* revert test

* revert test
2022-09-30 10:15:09 +05:30
Tamer Sherif d4a3b4e0c7
Health Monitor Readme + Generated CLI Docs (#907)
* Health Monitor Readme and generate new docs

* Health Monitor Readme and generate new docs
2022-09-19 09:44:40 -07:00
Gauri Prasad 23e7af7528
Make writeback cache default (#887)
* stream data validation

* stream data validation

* Enable writeback caching safely

* Flipped boolean semantics for writeback cache

* Added CLI param

* Add debug log for write only in case it is a problem

* Modified test to work with enable writeback cache

* Added a flag to ignore append flag

* github comments

* Added tests for ignore append

* changelog

* Added fuse2 test

* correcting file mode when ignore-append-file flag is true

* fix unit test

* Changes for ignore open flags

* test for libfuse2

* add ignore open flag to all config

* Updated README

* Added to Changelog

* Quick test only in data validation for streaming

Co-authored-by: Tamer Sherif <tasherif@microsoft.com>
Co-authored-by: vibhansa-msft <vibhansa@microsoft.com>
Co-authored-by: souravgupta <souravgupta@microsoft.com>
2022-09-02 17:04:42 +05:30
Gauri Prasad 1978243d43
Added supported v1 CLI parameters to v2 (#881) 2022-08-31 12:12:14 -07:00
Vikas Bhansali 6e05993f75
Add missing cli options to readme (#877)
* Add missing cli options to readme

* Adding missing features and unsupported scenarios

* Spell corrections

* Adding list block cli parameter as csi driver uses that over cli

* Update README.md

Co-authored-by: Gauri Prasad <51212198+gapra-msft@users.noreply.github.com>
2022-08-27 11:37:49 +05:30
Gauri Prasad 0484ee8a32
Migrated Nightly pipeline to 1ES Hosted Pools (#820) 2022-06-24 12:13:57 -07:00
Vikas Bhansali b1ff604a39
Vibhansa/v2/noconfigfile (#747)
* Allow blobfuse2 to mount without config file, in case all required params are set as env variables

* Updating readme for perf comparison with v1

* Removing test code

* Changes as per review comments

* Corrected perf numbers in readme
2022-03-25 10:54:41 +05:30
Gauri Prasad 15b68d598a
Fixed some codespell errors (#745)
Co-authored-by: Gauri Prasad <gapra@microsoft.com>
2022-03-23 11:00:13 -07:00
Gauri Prasad 990af0fefa First commit of blobfuse v2 code 2022-02-14 09:41:31 -08:00
Gauri Prasad eb17b3cf32 Deleted blobfuse code 2022-02-09 08:37:28 -08:00
Vikas Bhansali 945a7dff5d
Correct readme and change version to beta (#683) 2022-01-13 21:57:38 +05:30
Vikas Bhansali b1032925b9
Vibhansa/proxy details (#682)
Correction proxy cli option details on when to skip that and when to use it.
2022-01-11 09:14:07 +05:30
Vikas Bhansali ecb32ac6d3
Vibhansa/rman fix (#669)
Ubn18/20 giving error in pipelines as cmake version is outdated now. Upgrading version in all CMake files and disabling GTest as they are not compiling with newer version
2021-11-18 07:50:38 +05:30
Vikas Bhansali cb0da29773
Vibhansa/read stream parallel download block (#641)
If block size > 64MB allow to download block in parallel
2021-09-11 08:40:25 +05:30
Vikas Bhansali 8da827df82
Vibhansa/read streaming (#637)
Updated README for basic-remount-check config
2021-08-28 09:39:54 +05:30
Vikas Bhansali 073f962ca0
Vibhansa/read streaming (#636)
Adding support for read streaming on Read-Only mount.
2021-08-26 08:04:30 +05:30
Vikas Bhansali 13fea4edc6
1. Invalidate attr-cache even when file is not present in local cache. 2. Delete file if sync was done even if file was downloaded as part of sync. 3. Correct last change and last access time if returning from attr-cache 4. Correct readme for proxy options (#635)
1. Invalidate attr-cache even when file is not present in local cache
2. Delete file if sync was done even if file was downloaded as part of sync.
3. Correct last change and last access time if returning from attr-cache
4. Correct readme for proxy options
2021-08-19 08:02:30 +05:30
Vikas Bhansali 1f0ed1a093
Adding background download support (#629)
- Allow user to download the file in background instead of blocking open system call
- sync can force evict a file from cache, behavior is configurable.
- fsyncdir will invalidate attributes of all children of a given directory
- bug in cache eviction where file was not getting deleted if difference between last modified and current time was 0
2021-08-11 07:19:30 +05:30
Vikas Bhansali 6844eb13cd
Gen-2 ACL based blobs not showing correct permissions (#631)
For Gen-2 accounts if ACL is set with mask and additional principals for a blob/container, Blobfuse fails to parse the permission string. Correcting code to handle the same.
2021-08-10 14:31:21 +05:30
Nara ccffd4a950
Update README.md
added supported version numbers for command line params
2021-07-14 18:14:31 -07:00
Nara cb588b0104
Update README.md
added supported version numbers for command line params
2021-07-14 17:20:24 -07:00
Nara ce36c2d287
Update README.md
updated defaults for basic mount check and pre validate curl check.
2021-07-14 17:17:57 -07:00
Ashish Mishra c18c60da7d
Update README.md (#623)
Making the support statement very explicit
2021-07-13 18:55:06 +05:30
Vikas Bhansali 976680b403
Instead of using syscall try reading /etc/mtab to figure out director… (#615)
#612 : Instead of using syscall try reading /etc/mtab to figure out directory is already mounted or not. Use cli option "--basic-remount-check=true" to enable this.
#613 : Skip cURL check and validate authentication before the mount to return early failure for invalid authentication. Use cli option "--pre-mount-validate=true" to enable this.
2021-07-08 08:25:20 +05:30
Nara 097c1d7119
Update README.md
retry exp and defaults added
2021-06-22 00:41:39 -07:00
Nara e3b4f60df7
Merge pull request #608 from Azure/vibhansa/dfs-next-token-fix
Vibhansa/dfs next token fix
2021-06-22 00:27:37 -07:00
vibhansa-msft 4797d838f5 Correcting cli option name as per review comments 2021-06-21 16:18:33 +05:30
vibhansa-msft 3a5977a7a9 Correcting name of max delay in retry 2021-06-21 12:22:49 +05:30
Nara fd65aa0e49
Update README.md
changed Storage Blob Contributor to Storage Blob Data Contributor
2021-06-17 17:17:01 -07:00
heikki0 2316f19065
Correct typo in README.md 2021-06-14 10:03:09 +02:00
vibhansa-msft 1f209d37dd Making retry count and interval configurable 2021-06-09 10:52:21 +05:30
Nara 9fd5a768fc
Update README.md
updated optional parameter values.
2021-06-04 18:42:52 -07:00
Nara 41d5fbe89d
Update README.md
Modified readme values.
2021-06-04 18:26:34 -07:00
Nara a7af031f0d
Update README.md
called out the limits on multi-write
2021-06-03 10:44:52 -07:00
Nara 945bf89a9e
Update README.md
added adls and auth to feature list
2021-06-03 10:30:53 -07:00
Nara 1e194d28ec
Update README.md
note to  - Add both Contributor and Storage Blob Contributor roles to this identity in the Storage account..
2021-05-07 12:29:37 -07:00
nara 6be5c12b2f modified readme 2021-04-26 16:53:45 -07:00
nara f4ccc839a5 added detailed error messages 2021-04-26 13:04:12 -07:00
nara 91155aab6b updated Readme file for cacert and https proxy 2021-04-22 19:25:01 -07:00
Nara 5648f31d5b
Update README.md
updated description for high-disk-threshold
2021-04-07 16:36:46 -07:00
Nara 24bad9e552
Update README.md
updated  the description for commandline param --max-concurrency
2021-04-07 16:20:59 -07:00
Amrinder-Singh29 21d559acb8
Update README.md
Updating the recommendations to make is system configured log file
2021-03-20 08:44:01 +05:30