Граф коммитов

43 Коммитов

Автор SHA1 Сообщение Дата
Hong Ooi 25632dda2e
Implement create/delete dirs for blob storage (#59)
* blob create/delete

* implement generics

* works

* update news

* better wording

* also update readme

* update readme again
2020-07-01 19:20:41 +10:00
Hans Van Slooten 1a30a9c054
Adds hierarchy functionality to list_blobs mentioned in issue #55 (#56)
* Adds hierarchy functionality to list_blobs mentioned in issue #55

* documentation

* update documentation for list_blobs

* Formatting fixes for suggestions.

* linting

* style

* by_hierarchy -> recursive

* test flipped

* add tests

* document

* consistent behaviour for recursive arg

* simplifying logic

Co-authored-by: Hans Van Slooten <HansVanSlooten@twinsbaseball.com>
Co-authored-by: Hong Ooi <hongooi@microsoft.com>
2020-07-01 02:21:51 +10:00
Hong Ooi 94ba062e2b fix list_blobs bug with azcopy (fixes #52) 2020-06-09 23:58:24 +10:00
Hong Ooi 6e22a028e9 update tests 2020-06-05 19:45:21 +10:00
Hong Ooi 2683134c57 r cmd check passes 2020-04-11 01:22:24 +10:00
Hong Ooi c2c1f3a7f0 fixing tests to run under check() 2020-04-11 00:07:21 +10:00
Hong Ooi b2e209c39f
Generate sas (#49)
Greater support for generating an account or user-delegated SAS. Adds S3 generics/methods for `get_account_sas`, `get_user_delegation_key`, `get_user_delegation_sas`, `revoke_user_delegation_keys`. Closes #26
2020-04-09 21:43:07 +10:00
Hong Ooi a71fcf88a9
Dev (#47)
* check for continuation markers

* basic support for file perms API

* set blob content-type more efficiently

* add content-type tests

* update news

* fix rmds for updated call_azcopy

* more rmd fixes
2020-04-03 01:59:18 +11:00
Hong Ooi dbabefa0bc
Azcopy update (#37)
Refactoring, expanding azcopy support
2020-01-14 15:55:59 +11:00
Hong Ooi 34c2b97c6c storage_file_exists generic + methods 2019-12-23 09:57:03 +11:00
Christian Grotheer b8e089742b Added ability to check if a blob exists (#34)
* Added ability to check if a blob exists

* Fixing Rd file

* Fixing Rd file
2019-12-23 01:45:02 +11:00
Hong Ooi 2cee24d801 allow sas with leading ? 2019-11-16 04:47:08 +11:00
Hong Ooi 2216b26245
Blob-ADLS interop fixes (#29)
closes #28
2019-11-12 10:04:06 +11:00
Hong Ooi f42675c450 update for next release 2019-11-02 03:46:22 +11:00
Hong Ooi 36317e84a8 set default dest for file transfers 2019-10-31 04:31:19 +11:00
Hong Ooi 8c1a4a7078 copy url dispatch (fixes #22) 2019-10-31 02:50:57 +11:00
Hong Ooi 67bedbe158
Properties (#23)
closes #19
2019-10-31 01:43:41 +11:00
Hong Ooi a976478b54
Dev (#20)
- definitive treatment for multiple file transfers
- file storage method changes
- smaller changes for other storage types
- export low-level methods
2019-10-27 09:43:30 +08:00
Hong Ooi 2efabb3987
Vectorised transfers (#18)
* seems to be working

* file also works

* minor reorg

* adls now supports sas

* update news/desc

* improve multiupload

* also vectorise copy_url_to_blob

* documenting

* update doc, vignette

* md fixups

* refactor

* update news/desc

* update news
2019-10-22 12:11:16 +08:00
Hong Ooi 66c343d363
Copy url to blob (#6)
closes #3
2019-07-18 13:29:28 +10:00
Hong Ooi d30ad5306e also display progress bar for uploads 2019-05-18 09:51:39 +10:00
Hong Ooi 43757670f9
Retry transfers (#22)
closes #23 
closes #21
2019-05-17 06:44:48 +10:00
Hong Ooi 87464cb450 fix tests for connection transfers 2019-03-18 05:34:54 +11:00
hong-revo 82d60ec275 fixes for R CMD check 2019-02-15 21:58:21 +11:00
Hong Ooi e6f792151b
Generics (#15)
* first commit

* add tests

* better filenames

* documenting

* update readme

* rewording

* missed one unrename

* one more doc pass

* fixup

* really fixup
2019-02-10 17:35:50 +11:00
hong-revo 0c026b16c3 reenable adls token test 2019-02-06 17:01:52 +11:00
hong-revo e59be3ec06 rename upload/download_from_url; format news.md 2019-02-02 02:05:56 +11:00
hong-revo f7886f2a7e skip adls aad test for now 2019-01-23 18:04:33 +08:00
hong-revo c3b14b1312 some tidying 2019-01-23 18:04:01 +08:00
hong-revo 45214f7713 test fixing 2019-01-22 22:32:48 +08:00
hong-revo 638786bcb7 add token auth testing 2019-01-22 13:05:01 +08:00
hong-revo 015c273f30 missed one 2019-01-22 00:27:16 +08:00
hong-revo 3ae742b7b5 #10 2019-01-21 17:17:55 +08:00
Hong Ooi 0f304abc70
File transfer features (#9)
* parallel upload for blobs

* more parallel blob transfer

* another header fix

* document

* blob download to memory

* all download to memory

* add multiple transfer tests

* cluster -> pool

* file multitransfer

* filetune file multitransfer

* fixing adls multi

* adls multi transfer working

* check for no files

* doc fixup

* more doc fixup

* yet more doc fixup
2019-01-20 00:09:10 +11:00
hong-revo 0a54e44700 adls and file upload from connection 2019-01-17 04:41:54 +11:00
hong-revo adda71a6c5 blob upload from connection 2019-01-17 03:51:53 +11:00
hong-revo 2ceaa47fe0 make tests not require AzureRMR in search path 2019-01-14 01:30:23 +11:00
hong-revo 507128f07f extend upload/download_url 2018-12-26 14:21:36 +11:00
hong-revo 972fe48caf cleanup test files 2018-12-06 17:39:26 +11:00
hong-revo 90f521d8dc update for adls beta hijinks 2018-12-06 17:28:05 +11:00
Hong Ooi 21b20304e9
Adlsv2 (#1)
* adls_endpoint

* adls client

* typo

* cleanup

* more adls funcs

* adls_endpoint

* adls client

* typo

* cleanup

* more adls funcs

* merge break

* Revert "merge break"

This reverts commit c451b2e1da980ed78b120819050c091a204d30f1.

* more adls fs ops

* kibozing for error messages

* 1st cut, adls file ops

* more adls ops

* adls upload working

* adls download working

* everything seems to be working

* adls doc

* doc update

* more doc update

* clarify hns setting

* adls testing

* more doc update

* adls tests working

* update docs for end of limited access preview

* readme edit

* reword readme

* update vignette

* oopsie

* oopsie again
2018-12-04 15:57:26 +08:00
hong-revo 4ddc2417e0 file testing 2018-11-22 09:06:49 +11:00
hong-revo 855c704155 resource and blob testing 2018-11-22 08:11:30 +11:00