Граф коммитов

64 Коммитов

Автор SHA1 Сообщение Дата
Hong Ooi 962edb6ae8
Versioning and snapshotting (#121)
* versions

* tests, docs

* redoc

* fixes

* rm cruft
2022-05-22 13:03:08 +10:00
Hong Ooi 90b573efde create snapshot generics 2022-03-11 06:41:28 +11:00
Hong Ooi 97a55051d0
Blob snapshot support (#117)
Add support for blob snapshots:
- New functions `create_blob_snapshot`, `list_blob_snapshots` and `delete_blob_snapshots` to manage snapshots
- Argument `snapshot` added to `download_blob`, `get_storage_properties` and `get_storage_metadata` to work with specific snapshots

closes #113
2022-03-11 04:57:38 +11:00
Mikko Marttila 3d26759b34
Add directory_depth to get_service_sas class method (#115)
* Add directory_depth to get_service_sas class method

* update ver no

* update news

Co-authored-by: Hong Ooi <hongooi73@gmail.com>
2022-03-09 12:54:34 +11:00
Hong Ooi c9776008af
Add dir_exists functions (#108)
* implement dir_exists

* blob direxist working correctly

* file direxist

* adls dir exist

* add generics, redoc

* update news

* enable hns for new accounts
2021-12-12 02:26:10 +11:00
Hong Ooi 3a37ac6ba4
Support deletion of root directory (#104)
* implement del adls rootdir

* also fix rootdir del for other services

* testsuite maintenance
2021-10-28 12:40:55 +11:00
Hong Ooi b3df2fbb2f
Recursive dir deletion for file/blob storage (#101)
Implements `delete_storage_dir(*, recursive=TRUE)`, something that is needed for the pins package
2021-10-16 05:10:51 +11:00
Hong Ooi 8136935d74 fix file listing for empty filesystem 2021-10-13 13:28:47 +11:00
Hong Ooi 78c7e46160 add service arg to storage_endpoint 2021-05-15 16:12:38 +10:00
Hong Ooi 2eb4e0ae55
Update API version (#91)
* doc pass

* update to 2020-04-08 api

* quick fix for user delegation sas

* rm stray rcst param (?)

* update doc

* support dir resource, fix broken tests

* rm stray debug code

* update doc

* notable feature change from api update
2021-05-15 02:44:51 +10:00
Hong Ooi 236c008b42
Service SAS (#90)
closes #89
2021-05-09 23:46:47 +10:00
Hong Ooi 9a3e8dfd19 rm useless test 2021-04-25 08:30:11 +10:00
Hong Ooi 62a612c693
storage_load_rds fix (#84)
fixes #83
2021-04-15 13:54:58 +10:00
Hong Ooi 4d1d9a5da3
Lease fix (#80)
* add lease header to put-blocklist

* load pkgs quietly

* fix for new behaviour with append blobs and hns

* also test blob transfers

* also test adls lease

* reword news
2021-02-17 19:33:18 +11:00
Hong Ooi 0a9832edb2 fix blob lease functions 2021-02-14 20:47:42 +11:00
Hong Ooi 59245a70c6 some fixes 2021-01-13 12:25:58 +11:00
Hong Ooi 0c7d8d0c15
Add file format helpers (#75)
* change org

* Revert "change org"

This reverts commit 512e64fb94.

* better cloudyr checking

* Format helpers (#1)

* better cloudyr checking

* add format helpers

* document

* update mds, desc
2021-01-12 05:27:00 +11:00
Hong Ooi c47df7face
Md5 (#73)
Implements MD5 hashing:
- store hash on upload
- check hash on download
- add Content-MD5 header on transfers for error checking
2020-09-24 02:06:33 +10:00
Hong Ooi 5ebd3a66eb
Append blob (#71)
* commit

* append blob uploading

* list_blobs working

* document, implement actual appending

* redocument

* update mds

* fix example

* tests

* regression error fixes

* more regression fixes

* doc refresh
2020-09-07 16:31:42 +10:00
Hong Ooi b0dcdff533
Emulator support (#68)
Adds support for the Azurite and Azure SDK storage emulators, closes #66
2020-08-24 16:31:39 +10:00
Hong Ooi 26a6d7ec8f
Fix transfers with non-ASCII filenames (#63)
Fixes #62
2020-07-20 13:22:19 +10:00
Hong Ooi 25632dda2e
Implement create/delete dirs for blob storage (#59)
* blob create/delete

* implement generics

* works

* update news

* better wording

* also update readme

* update readme again
2020-07-01 19:20:41 +10:00
Hans Van Slooten 1a30a9c054
Adds hierarchy functionality to list_blobs mentioned in issue #55 (#56)
* Adds hierarchy functionality to list_blobs mentioned in issue #55

* documentation

* update documentation for list_blobs

* Formatting fixes for suggestions.

* linting

* style

* by_hierarchy -> recursive

* test flipped

* add tests

* document

* consistent behaviour for recursive arg

* simplifying logic

Co-authored-by: Hans Van Slooten <HansVanSlooten@twinsbaseball.com>
Co-authored-by: Hong Ooi <hongooi@microsoft.com>
2020-07-01 02:21:51 +10:00
Hong Ooi 94ba062e2b fix list_blobs bug with azcopy (fixes #52) 2020-06-09 23:58:24 +10:00
Hong Ooi 6e22a028e9 update tests 2020-06-05 19:45:21 +10:00
Hong Ooi 2683134c57 r cmd check passes 2020-04-11 01:22:24 +10:00
Hong Ooi c2c1f3a7f0 fixing tests to run under check() 2020-04-11 00:07:21 +10:00
Hong Ooi b2e209c39f
Generate sas (#49)
Greater support for generating an account or user-delegated SAS. Adds S3 generics/methods for `get_account_sas`, `get_user_delegation_key`, `get_user_delegation_sas`, `revoke_user_delegation_keys`. Closes #26
2020-04-09 21:43:07 +10:00
Hong Ooi a71fcf88a9
Dev (#47)
* check for continuation markers

* basic support for file perms API

* set blob content-type more efficiently

* add content-type tests

* update news

* fix rmds for updated call_azcopy

* more rmd fixes
2020-04-03 01:59:18 +11:00
Hong Ooi dbabefa0bc
Azcopy update (#37)
Refactoring, expanding azcopy support
2020-01-14 15:55:59 +11:00
Hong Ooi 34c2b97c6c storage_file_exists generic + methods 2019-12-23 09:57:03 +11:00
Christian Grotheer b8e089742b Added ability to check if a blob exists (#34)
* Added ability to check if a blob exists

* Fixing Rd file

* Fixing Rd file
2019-12-23 01:45:02 +11:00
Hong Ooi 2cee24d801 allow sas with leading ? 2019-11-16 04:47:08 +11:00
Hong Ooi 2216b26245
Blob-ADLS interop fixes (#29)
closes #28
2019-11-12 10:04:06 +11:00
Hong Ooi f42675c450 update for next release 2019-11-02 03:46:22 +11:00
Hong Ooi 36317e84a8 set default dest for file transfers 2019-10-31 04:31:19 +11:00
Hong Ooi 8c1a4a7078 copy url dispatch (fixes #22) 2019-10-31 02:50:57 +11:00
Hong Ooi 67bedbe158
Properties (#23)
closes #19
2019-10-31 01:43:41 +11:00
Hong Ooi a976478b54
Dev (#20)
- definitive treatment for multiple file transfers
- file storage method changes
- smaller changes for other storage types
- export low-level methods
2019-10-27 09:43:30 +08:00
Hong Ooi 2efabb3987
Vectorised transfers (#18)
* seems to be working

* file also works

* minor reorg

* adls now supports sas

* update news/desc

* improve multiupload

* also vectorise copy_url_to_blob

* documenting

* update doc, vignette

* md fixups

* refactor

* update news/desc

* update news
2019-10-22 12:11:16 +08:00
Hong Ooi 66c343d363
Copy url to blob (#6)
closes #3
2019-07-18 13:29:28 +10:00
Hong Ooi d30ad5306e also display progress bar for uploads 2019-05-18 09:51:39 +10:00
Hong Ooi 43757670f9
Retry transfers (#22)
closes #23 
closes #21
2019-05-17 06:44:48 +10:00
Hong Ooi 87464cb450 fix tests for connection transfers 2019-03-18 05:34:54 +11:00
hong-revo 82d60ec275 fixes for R CMD check 2019-02-15 21:58:21 +11:00
Hong Ooi e6f792151b
Generics (#15)
* first commit

* add tests

* better filenames

* documenting

* update readme

* rewording

* missed one unrename

* one more doc pass

* fixup

* really fixup
2019-02-10 17:35:50 +11:00
hong-revo 0c026b16c3 reenable adls token test 2019-02-06 17:01:52 +11:00
hong-revo e59be3ec06 rename upload/download_from_url; format news.md 2019-02-02 02:05:56 +11:00
hong-revo f7886f2a7e skip adls aad test for now 2019-01-23 18:04:33 +08:00
hong-revo c3b14b1312 some tidying 2019-01-23 18:04:01 +08:00