Hong Ooi
962edb6ae8
Versioning and snapshotting ( #121 )
...
* versions
* tests, docs
* redoc
* fixes
* rm cruft
2022-05-22 13:03:08 +10:00
Hong Ooi
90b573efde
create snapshot generics
2022-03-11 06:41:28 +11:00
Hong Ooi
97a55051d0
Blob snapshot support ( #117 )
...
Add support for blob snapshots:
- New functions `create_blob_snapshot`, `list_blob_snapshots` and `delete_blob_snapshots` to manage snapshots
- Argument `snapshot` added to `download_blob`, `get_storage_properties` and `get_storage_metadata` to work with specific snapshots
closes #113
2022-03-11 04:57:38 +11:00
Mikko Marttila
3d26759b34
Add directory_depth to get_service_sas class method ( #115 )
...
* Add directory_depth to get_service_sas class method
* update ver no
* update news
Co-authored-by: Hong Ooi <hongooi73@gmail.com>
2022-03-09 12:54:34 +11:00
Hong Ooi
c9776008af
Add dir_exists functions ( #108 )
...
* implement dir_exists
* blob direxist working correctly
* file direxist
* adls dir exist
* add generics, redoc
* update news
* enable hns for new accounts
2021-12-12 02:26:10 +11:00
Hong Ooi
3a37ac6ba4
Support deletion of root directory ( #104 )
...
* implement del adls rootdir
* also fix rootdir del for other services
* testsuite maintenance
2021-10-28 12:40:55 +11:00
Hong Ooi
b3df2fbb2f
Recursive dir deletion for file/blob storage ( #101 )
...
Implements `delete_storage_dir(*, recursive=TRUE)`, something that is needed for the pins package
2021-10-16 05:10:51 +11:00
Hong Ooi
8136935d74
fix file listing for empty filesystem
2021-10-13 13:28:47 +11:00
Hong Ooi
78c7e46160
add service arg to storage_endpoint
2021-05-15 16:12:38 +10:00
Hong Ooi
2eb4e0ae55
Update API version ( #91 )
...
* doc pass
* update to 2020-04-08 api
* quick fix for user delegation sas
* rm stray rcst param (?)
* update doc
* support dir resource, fix broken tests
* rm stray debug code
* update doc
* notable feature change from api update
2021-05-15 02:44:51 +10:00
Hong Ooi
236c008b42
Service SAS ( #90 )
...
closes #89
2021-05-09 23:46:47 +10:00
Hong Ooi
9a3e8dfd19
rm useless test
2021-04-25 08:30:11 +10:00
Hong Ooi
62a612c693
storage_load_rds fix ( #84 )
...
fixes #83
2021-04-15 13:54:58 +10:00
Hong Ooi
4d1d9a5da3
Lease fix ( #80 )
...
* add lease header to put-blocklist
* load pkgs quietly
* fix for new behaviour with append blobs and hns
* also test blob transfers
* also test adls lease
* reword news
2021-02-17 19:33:18 +11:00
Hong Ooi
0a9832edb2
fix blob lease functions
2021-02-14 20:47:42 +11:00
Hong Ooi
59245a70c6
some fixes
2021-01-13 12:25:58 +11:00
Hong Ooi
0c7d8d0c15
Add file format helpers ( #75 )
...
* change org
* Revert "change org"
This reverts commit 512e64fb94
.
* better cloudyr checking
* Format helpers (#1 )
* better cloudyr checking
* add format helpers
* document
* update mds, desc
2021-01-12 05:27:00 +11:00
Hong Ooi
c47df7face
Md5 ( #73 )
...
Implements MD5 hashing:
- store hash on upload
- check hash on download
- add Content-MD5 header on transfers for error checking
2020-09-24 02:06:33 +10:00
Hong Ooi
5ebd3a66eb
Append blob ( #71 )
...
* commit
* append blob uploading
* list_blobs working
* document, implement actual appending
* redocument
* update mds
* fix example
* tests
* regression error fixes
* more regression fixes
* doc refresh
2020-09-07 16:31:42 +10:00
Hong Ooi
b0dcdff533
Emulator support ( #68 )
...
Adds support for the Azurite and Azure SDK storage emulators, closes #66
2020-08-24 16:31:39 +10:00
Hong Ooi
26a6d7ec8f
Fix transfers with non-ASCII filenames ( #63 )
...
Fixes #62
2020-07-20 13:22:19 +10:00
Hong Ooi
25632dda2e
Implement create/delete dirs for blob storage ( #59 )
...
* blob create/delete
* implement generics
* works
* update news
* better wording
* also update readme
* update readme again
2020-07-01 19:20:41 +10:00
Hans Van Slooten
1a30a9c054
Adds hierarchy functionality to list_blobs mentioned in issue #55 ( #56 )
...
* Adds hierarchy functionality to list_blobs mentioned in issue #55
* documentation
* update documentation for list_blobs
* Formatting fixes for suggestions.
* linting
* style
* by_hierarchy -> recursive
* test flipped
* add tests
* document
* consistent behaviour for recursive arg
* simplifying logic
Co-authored-by: Hans Van Slooten <HansVanSlooten@twinsbaseball.com>
Co-authored-by: Hong Ooi <hongooi@microsoft.com>
2020-07-01 02:21:51 +10:00
Hong Ooi
94ba062e2b
fix list_blobs bug with azcopy ( fixes #52 )
2020-06-09 23:58:24 +10:00
Hong Ooi
6e22a028e9
update tests
2020-06-05 19:45:21 +10:00
Hong Ooi
2683134c57
r cmd check passes
2020-04-11 01:22:24 +10:00
Hong Ooi
c2c1f3a7f0
fixing tests to run under check()
2020-04-11 00:07:21 +10:00
Hong Ooi
b2e209c39f
Generate sas ( #49 )
...
Greater support for generating an account or user-delegated SAS. Adds S3 generics/methods for `get_account_sas`, `get_user_delegation_key`, `get_user_delegation_sas`, `revoke_user_delegation_keys`. Closes #26
2020-04-09 21:43:07 +10:00
Hong Ooi
a71fcf88a9
Dev ( #47 )
...
* check for continuation markers
* basic support for file perms API
* set blob content-type more efficiently
* add content-type tests
* update news
* fix rmds for updated call_azcopy
* more rmd fixes
2020-04-03 01:59:18 +11:00
Hong Ooi
dbabefa0bc
Azcopy update ( #37 )
...
Refactoring, expanding azcopy support
2020-01-14 15:55:59 +11:00
Hong Ooi
34c2b97c6c
storage_file_exists generic + methods
2019-12-23 09:57:03 +11:00
Christian Grotheer
b8e089742b
Added ability to check if a blob exists ( #34 )
...
* Added ability to check if a blob exists
* Fixing Rd file
* Fixing Rd file
2019-12-23 01:45:02 +11:00
Hong Ooi
2cee24d801
allow sas with leading ?
2019-11-16 04:47:08 +11:00
Hong Ooi
2216b26245
Blob-ADLS interop fixes ( #29 )
...
closes #28
2019-11-12 10:04:06 +11:00
Hong Ooi
f42675c450
update for next release
2019-11-02 03:46:22 +11:00
Hong Ooi
36317e84a8
set default dest for file transfers
2019-10-31 04:31:19 +11:00
Hong Ooi
8c1a4a7078
copy url dispatch ( fixes #22 )
2019-10-31 02:50:57 +11:00
Hong Ooi
67bedbe158
Properties ( #23 )
...
closes #19
2019-10-31 01:43:41 +11:00
Hong Ooi
a976478b54
Dev ( #20 )
...
- definitive treatment for multiple file transfers
- file storage method changes
- smaller changes for other storage types
- export low-level methods
2019-10-27 09:43:30 +08:00
Hong Ooi
2efabb3987
Vectorised transfers ( #18 )
...
* seems to be working
* file also works
* minor reorg
* adls now supports sas
* update news/desc
* improve multiupload
* also vectorise copy_url_to_blob
* documenting
* update doc, vignette
* md fixups
* refactor
* update news/desc
* update news
2019-10-22 12:11:16 +08:00
Hong Ooi
66c343d363
Copy url to blob ( #6 )
...
closes #3
2019-07-18 13:29:28 +10:00
Hong Ooi
d30ad5306e
also display progress bar for uploads
2019-05-18 09:51:39 +10:00
Hong Ooi
43757670f9
Retry transfers ( #22 )
...
closes #23
closes #21
2019-05-17 06:44:48 +10:00
Hong Ooi
87464cb450
fix tests for connection transfers
2019-03-18 05:34:54 +11:00
hong-revo
82d60ec275
fixes for R CMD check
2019-02-15 21:58:21 +11:00
Hong Ooi
e6f792151b
Generics ( #15 )
...
* first commit
* add tests
* better filenames
* documenting
* update readme
* rewording
* missed one unrename
* one more doc pass
* fixup
* really fixup
2019-02-10 17:35:50 +11:00
hong-revo
0c026b16c3
reenable adls token test
2019-02-06 17:01:52 +11:00
hong-revo
e59be3ec06
rename upload/download_from_url; format news.md
2019-02-02 02:05:56 +11:00
hong-revo
f7886f2a7e
skip adls aad test for now
2019-01-23 18:04:33 +08:00
hong-revo
c3b14b1312
some tidying
2019-01-23 18:04:01 +08:00