Граф коммитов

11 Коммитов

Автор SHA1 Сообщение Дата
Vikas Bhansali e02acffd38
Copyright fix (#1025)
* Correcting copyright statement
2023-01-07 08:11:07 +05:30
Vikas Bhansali 4f805cc1ab
Adding code linting (#844)
* Adding Ubn-22 to pipelines

* Adding lint as standard ci step

* correcting lint command path

* Add copyright checks to ci pipeline

* Copyright fixes and ci check for copyright statements

* Adding go format check to CI

* Fixing some lint issues

* More lint fixes

* More lint fixes

* Fixing some lint issues

* Correcting code linting check in ci

* correcting lint status check

* correcting lint status check

* correcting lint status check

* correcting lint status check

* correcting lint status check

* correcting lint status check

* correcting lint status check

* correcting bugs reported by sa check

* notices_fix.sh update

* Add step to validate NOTICE file

* Add step to release for ubn-22

* Add logs for success

* Fixing copyright bug

* Correcting tag formats

* Correcting percentage check

* Spell error correction

* Ignore exectime from code coverage

* Correcting log string

* Removing dead file

* Correcting go format error
2022-07-28 10:09:41 +05:30
Sourav Gupta 35cf5ff4a2
Module name fix (#847)
* Correcting module name

* Changing module name

* Adding output binary name in go build
2022-07-27 12:19:36 +05:30
Gauri Prasad 1566734ec3
Background auth validation fix (#845) 2022-07-26 22:05:32 -07:00
Tamer Sherif 631b408d89
Write Stream Caching Support (#777)
* Optimized Streaming

* close handle fix

* locking

* fixed tests

* cleanup

* Deprecate eviction library

* more cleanup

* remove timeout

* fix

* cleanup

* fixed bug

* fixed bug

* added purge

* added purge

* added purge

* added purge

* added a new interface:

* comment cleanup

* comment cleanup

* removed lock and added tests

* cleanup

* added handle buffer check

* added more methods

* cleanup - feedback

* moved to new dir

* merged

* added write caching on middle offsets

* added small file edit in the middle case

* flags

* reverted

* added truncate support on azstorage

* added truncate support on azstorage

* added appends

* fixed edge cases

* added remaining methods

* tests working

* fixed test

* cleanup

* logs

* cleanup

* fixed attr cache

* added more tests

* added more tests

* added more tests

* fixed small bug and added more tests

* more tests

* fixed a bug and added tests

* cleanup

* cleanup

* added comments

* cleanup

* added read test

* more test

* privacy

* merge main
2022-06-06 10:34:22 -07:00
Tamer Sherif 7d86acbc95
[BUG] df showed root mount stats against blobfuse rather than file cache stats (#801)
* Fixed df on blobfuse incorrect stats

* Fixed df on blobfuse incorrect stats

* cleanup

* added test

* added test

* cover the case of exceeding cache

* case with unlimited file cache

* file cache does fstat

* rename

* merge main
2022-06-06 10:24:14 -07:00
Vikas Bhansali 597f15821e
Native (C) pread/pwrite to improve performance (#752)
* Adding more fuse options for optimization

* Correcting logs for fuse3

* Removing nullpath feature as fuse3 does not support it

* Remove symlink cache as fuse3 does not support that

* Convert expected err log to warn

* Removing dead code

* Try file read using native C api

* Try early pread to improve perf

* Adding dynamic profiler and disable native pread call

* Log error when profiler fails to start

* Try prefetching data into memory for disk-file

* Make dynamic profiler available in both foreground and daemon mode

* Move read/write call to native calls

* Add call to update the file-cache when native read/writes are invoked

* Remove cache updating call for better perf

* Remove readahead logic from file-cache

* Clear handle map dead code

* convert fd to uint64 instead of int

* Adding basic infra for read ahead in native code

* Clean up code, remove read-ahead logic and make direct read the default option

* Correcting the flag name for offload-io

* Correcting spell mistakes and adding comments

* Correcting fsync test failure

* Correct fuse3 UT for fsync and handle conversion

* Resolve compilation failure for filehandle struct

* Add logic to update the cache on every 1K operations on a handle

* Resolve failure with flush when native write is enable

* Add read-ahead logic in native code

* Compilation failure resolution on fuse2

* Correcting memset params

* Correcting spell error

* Add GOGC and MAXPROCS value for perf tuning

* Reduce min file size and correct read ahead buffer size for smaller fiels

* Replace fsync with close of duplciate handle

* Correcting write flow file corruption issue

* Handle write in file-cache instead of libfuse as the other approach is corrupting data somewhere

* File-cache to refresh cache on eveyr 1K operations and data validation test to wait for 2 seconds after copy

* Replace file-cache read/write calls with syscalls

* Enable native read/write again with read ahead disabled

* Remove cache update from read calls

* Remove read ahead logic completly

* Cleanup libfuse compo and e2e test changes

* Delete emptry directories recursively till root

* Changes as per review comments

* Fix issue with block-size running into overflow of number of blocks

* Add blocksize and file size to logs

* Make blocksize function to work on file size instead of fi object and add UT for blocksize calculations

* Adding more ut case

* Add some breather between upload and test

* FileCacheTimeout test case to wait untill file is deleted from local system

* FileCacheTimeout test case to wait untill file is deleted from local system

* Codespell error fix

* Restructuring code as per review comments and internal discussions

* Code spell fixes

* Stop updating cache on read

* Adjusting cache update operation counter

* Correcting libfuse_read flow and adding option to enable offload option manually

* Correcting file_cache UT configs

* Adding dynamic profiler config in base config
2022-05-19 10:32:23 +05:30
Gauri Prasad 15b68d598a
Fixed some codespell errors (#745)
Co-authored-by: Gauri Prasad <gapra@microsoft.com>
2022-03-23 11:00:13 -07:00
Tamer Sherif 948ba17ccb feedback cleanup 2022-02-24 15:15:11 -08:00
Tamer Sherif 5507268e30 added basic write cases 2022-02-15 14:29:44 -08:00
Gauri Prasad 990af0fefa First commit of blobfuse v2 code 2022-02-14 09:41:31 -08:00