Граф коммитов

102 Коммитов

Автор SHA1 Сообщение Дата
Hong Ooi 962edb6ae8
Versioning and snapshotting (#121)
* versions

* tests, docs

* redoc

* fixes

* rm cruft
2022-05-22 13:03:08 +10:00
Hong Ooi 90b573efde create snapshot generics 2022-03-11 06:41:28 +11:00
Hong Ooi 97a55051d0
Blob snapshot support (#117)
Add support for blob snapshots:
- New functions `create_blob_snapshot`, `list_blob_snapshots` and `delete_blob_snapshots` to manage snapshots
- Argument `snapshot` added to `download_blob`, `get_storage_properties` and `get_storage_metadata` to work with specific snapshots

closes #113
2022-03-11 04:57:38 +11:00
Hong Ooi c9776008af
Add dir_exists functions (#108)
* implement dir_exists

* blob direxist working correctly

* file direxist

* adls dir exist

* add generics, redoc

* update news

* enable hns for new accounts
2021-12-12 02:26:10 +11:00
Hong Ooi 0a4cff9315
Allow passing Authorization header to [multi]copy_url_to_storage (#107)
* add auth_header arg

* fix passing auth to multicopy

* this time for sure

* fix sending a null auth_header
2021-12-04 21:11:38 +11:00
Hong Ooi b3df2fbb2f
Recursive dir deletion for file/blob storage (#101)
Implements `delete_storage_dir(*, recursive=TRUE)`, something that is needed for the pins package
2021-10-16 05:10:51 +11:00
Hong Ooi 18fa61f8e7 redocument 2021-05-15 16:15:54 +10:00
Hong Ooi 2eb4e0ae55
Update API version (#91)
* doc pass

* update to 2020-04-08 api

* quick fix for user delegation sas

* rm stray rcst param (?)

* update doc

* support dir resource, fix broken tests

* rm stray debug code

* update doc

* notable feature change from api update
2021-05-15 02:44:51 +10:00
Hong Ooi 236c008b42
Service SAS (#90)
closes #89
2021-05-09 23:46:47 +10:00
Hong Ooi 62a612c693
storage_load_rds fix (#84)
fixes #83
2021-04-15 13:54:58 +10:00
Hong Ooi f64b2c7920 change sas start time to allow for clock skew 2021-02-25 17:57:04 +11:00
Hong Ooi 59245a70c6 some fixes 2021-01-13 12:25:58 +11:00
Hong Ooi 0c7d8d0c15
Add file format helpers (#75)
* change org

* Revert "change org"

This reverts commit 512e64fb94.

* better cloudyr checking

* Format helpers (#1)

* better cloudyr checking

* add format helpers

* document

* update mds, desc
2021-01-12 05:27:00 +11:00
Hong Ooi c47df7face
Md5 (#73)
Implements MD5 hashing:
- store hash on upload
- check hash on download
- add Content-MD5 header on transfers for error checking
2020-09-24 02:06:33 +10:00
Hong Ooi 8df7b6fa61 azcopy does not support appending right now 2020-09-12 05:11:25 +10:00
Hong Ooi 5ebd3a66eb
Append blob (#71)
* commit

* append blob uploading

* list_blobs working

* document, implement actual appending

* redocument

* update mds

* fix example

* tests

* regression error fixes

* more regression fixes

* doc refresh
2020-09-07 16:31:42 +10:00
Hong Ooi b0dcdff533
Emulator support (#68)
Adds support for the Azurite and Azure SDK storage emulators, closes #66
2020-08-24 16:31:39 +10:00
Hong Ooi 47bad2ddb9 update link to adls namespaces doc page 2020-08-15 11:45:31 +10:00
Hong Ooi 5619a1ba10 redoc with latest roxygen 2020-07-01 20:10:46 +10:00
Hong Ooi 25632dda2e
Implement create/delete dirs for blob storage (#59)
* blob create/delete

* implement generics

* works

* update news

* better wording

* also update readme

* update readme again
2020-07-01 19:20:41 +10:00
Hong Ooi adb2550407 rm broken delete_azure_dir(recursive=TRUE) 2020-07-01 06:44:13 +10:00
Hans Van Slooten 1a30a9c054
Adds hierarchy functionality to list_blobs mentioned in issue #55 (#56)
* Adds hierarchy functionality to list_blobs mentioned in issue #55

* documentation

* update documentation for list_blobs

* Formatting fixes for suggestions.

* linting

* style

* by_hierarchy -> recursive

* test flipped

* add tests

* document

* consistent behaviour for recursive arg

* simplifying logic

Co-authored-by: Hans Van Slooten <HansVanSlooten@twinsbaseball.com>
Co-authored-by: Hong Ooi <hongooi@microsoft.com>
2020-07-01 02:21:51 +10:00
Hong Ooi f3bf08a625 more list_blobs fixes 2020-06-28 10:14:20 +10:00
Hong Ooi b25daedf6f doc tweaking 2020-04-10 12:35:37 +10:00
Hong Ooi b2e209c39f
Generate sas (#49)
Greater support for generating an account or user-delegated SAS. Adds S3 generics/methods for `get_account_sas`, `get_user_delegation_key`, `get_user_delegation_sas`, `revoke_user_delegation_keys`. Closes #26
2020-04-09 21:43:07 +10:00
Hong Ooi e9402fdebd redocument 2020-04-04 19:54:24 +11:00
Hong Ooi a98859df89
adls bug fixes (#42) 2020-02-25 05:33:51 +11:00
Hong Ooi bdb5841fd3
Make sign_request generic (#41)
* generic sign_request

* update news

* get it to work
2020-02-11 08:44:57 +11:00
Hong Ooi bda6337687 doc update 2020-01-15 12:18:35 +08:00
Hong Ooi dbabefa0bc
Azcopy update (#37)
Refactoring, expanding azcopy support
2020-01-14 15:55:59 +11:00
Hong Ooi c40c98132a fix dest defaults for generics 2020-01-10 07:10:50 +11:00
Hong Ooi 34c2b97c6c storage_file_exists generic + methods 2019-12-23 09:57:03 +11:00
Christian Grotheer b8e089742b Added ability to check if a blob exists (#34)
* Added ability to check if a blob exists

* Fixing Rd file

* Fixing Rd file
2019-12-23 01:45:02 +11:00
Hong Ooi 9b94a87584 fix multidownload_blob 2019-11-24 13:11:19 +11:00
Hong Ooi 2216b26245
Blob-ADLS interop fixes (#29)
closes #28
2019-11-12 10:04:06 +11:00
Hong Ooi f42675c450 update for next release 2019-11-02 03:46:22 +11:00
Hong Ooi cda0178881 redocument 2019-10-31 04:40:14 +11:00
Hong Ooi 67bedbe158
Properties (#23)
closes #19
2019-10-31 01:43:41 +11:00
Hong Ooi 41b8f7f83b allow returning headers 2019-10-29 08:18:35 +11:00
Hong Ooi a976478b54
Dev (#20)
- definitive treatment for multiple file transfers
- file storage method changes
- smaller changes for other storage types
- export low-level methods
2019-10-27 09:43:30 +08:00
Hong Ooi 2efabb3987
Vectorised transfers (#18)
* seems to be working

* file also works

* minor reorg

* adls now supports sas

* update news/desc

* improve multiupload

* also vectorise copy_url_to_blob

* documenting

* update doc, vignette

* md fixups

* refactor

* update news/desc

* update news
2019-10-22 12:11:16 +08:00
Hong Ooi f80beac1cb refresh doc, change error to warning on bad url 2019-10-14 21:56:45 +11:00
Hong Ooi 7eefa13be4 add hexagon, rebranding 2019-08-01 02:22:22 +10:00
Hong Ooi 66c343d363
Copy url to blob (#6)
closes #3
2019-07-18 13:29:28 +10:00
Hong Ooi d30ad5306e also display progress bar for uploads 2019-05-18 09:51:39 +10:00
Hong Ooi ebfe2c915c revise retry logic 2019-05-17 15:07:54 +10:00
Hong Ooi b8a2518ae4 doc refresh 2019-05-17 08:45:24 +10:00
Hong Ooi 43757670f9
Retry transfers (#22)
closes #23 
closes #21
2019-05-17 06:44:48 +10:00
Hong Ooi fa6ac7880b dl progress bar 2019-03-17 03:14:50 +11:00
hong-revo bd4fa2847a update docs 2019-02-17 19:21:55 +11:00