Hong Ooi
25632dda2e
Implement create/delete dirs for blob storage ( #59 )
...
* blob create/delete
* implement generics
* works
* update news
* better wording
* also update readme
* update readme again
2020-07-01 19:20:41 +10:00
Hans Van Slooten
1a30a9c054
Adds hierarchy functionality to list_blobs mentioned in issue #55 ( #56 )
...
* Adds hierarchy functionality to list_blobs mentioned in issue #55
* documentation
* update documentation for list_blobs
* Formatting fixes for suggestions.
* linting
* style
* by_hierarchy -> recursive
* test flipped
* add tests
* document
* consistent behaviour for recursive arg
* simplifying logic
Co-authored-by: Hans Van Slooten <HansVanSlooten@twinsbaseball.com>
Co-authored-by: Hong Ooi <hongooi@microsoft.com>
2020-07-01 02:21:51 +10:00
Hong Ooi
94ba062e2b
fix list_blobs bug with azcopy ( fixes #52 )
2020-06-09 23:58:24 +10:00
Hong Ooi
6e22a028e9
update tests
2020-06-05 19:45:21 +10:00
Hong Ooi
2683134c57
r cmd check passes
2020-04-11 01:22:24 +10:00
Hong Ooi
c2c1f3a7f0
fixing tests to run under check()
2020-04-11 00:07:21 +10:00
Hong Ooi
b2e209c39f
Generate sas ( #49 )
...
Greater support for generating an account or user-delegated SAS. Adds S3 generics/methods for `get_account_sas`, `get_user_delegation_key`, `get_user_delegation_sas`, `revoke_user_delegation_keys`. Closes #26
2020-04-09 21:43:07 +10:00
Hong Ooi
a71fcf88a9
Dev ( #47 )
...
* check for continuation markers
* basic support for file perms API
* set blob content-type more efficiently
* add content-type tests
* update news
* fix rmds for updated call_azcopy
* more rmd fixes
2020-04-03 01:59:18 +11:00
Hong Ooi
dbabefa0bc
Azcopy update ( #37 )
...
Refactoring, expanding azcopy support
2020-01-14 15:55:59 +11:00
Hong Ooi
34c2b97c6c
storage_file_exists generic + methods
2019-12-23 09:57:03 +11:00
Christian Grotheer
b8e089742b
Added ability to check if a blob exists ( #34 )
...
* Added ability to check if a blob exists
* Fixing Rd file
* Fixing Rd file
2019-12-23 01:45:02 +11:00
Hong Ooi
2cee24d801
allow sas with leading ?
2019-11-16 04:47:08 +11:00
Hong Ooi
2216b26245
Blob-ADLS interop fixes ( #29 )
...
closes #28
2019-11-12 10:04:06 +11:00
Hong Ooi
f42675c450
update for next release
2019-11-02 03:46:22 +11:00
Hong Ooi
36317e84a8
set default dest for file transfers
2019-10-31 04:31:19 +11:00
Hong Ooi
8c1a4a7078
copy url dispatch ( fixes #22 )
2019-10-31 02:50:57 +11:00
Hong Ooi
67bedbe158
Properties ( #23 )
...
closes #19
2019-10-31 01:43:41 +11:00
Hong Ooi
a976478b54
Dev ( #20 )
...
- definitive treatment for multiple file transfers
- file storage method changes
- smaller changes for other storage types
- export low-level methods
2019-10-27 09:43:30 +08:00
Hong Ooi
2efabb3987
Vectorised transfers ( #18 )
...
* seems to be working
* file also works
* minor reorg
* adls now supports sas
* update news/desc
* improve multiupload
* also vectorise copy_url_to_blob
* documenting
* update doc, vignette
* md fixups
* refactor
* update news/desc
* update news
2019-10-22 12:11:16 +08:00
Hong Ooi
66c343d363
Copy url to blob ( #6 )
...
closes #3
2019-07-18 13:29:28 +10:00
Hong Ooi
d30ad5306e
also display progress bar for uploads
2019-05-18 09:51:39 +10:00
Hong Ooi
43757670f9
Retry transfers ( #22 )
...
closes #23
closes #21
2019-05-17 06:44:48 +10:00
Hong Ooi
87464cb450
fix tests for connection transfers
2019-03-18 05:34:54 +11:00
hong-revo
82d60ec275
fixes for R CMD check
2019-02-15 21:58:21 +11:00
Hong Ooi
e6f792151b
Generics ( #15 )
...
* first commit
* add tests
* better filenames
* documenting
* update readme
* rewording
* missed one unrename
* one more doc pass
* fixup
* really fixup
2019-02-10 17:35:50 +11:00
hong-revo
0c026b16c3
reenable adls token test
2019-02-06 17:01:52 +11:00
hong-revo
e59be3ec06
rename upload/download_from_url; format news.md
2019-02-02 02:05:56 +11:00
hong-revo
f7886f2a7e
skip adls aad test for now
2019-01-23 18:04:33 +08:00
hong-revo
c3b14b1312
some tidying
2019-01-23 18:04:01 +08:00
hong-revo
45214f7713
test fixing
2019-01-22 22:32:48 +08:00
hong-revo
638786bcb7
add token auth testing
2019-01-22 13:05:01 +08:00
hong-revo
015c273f30
missed one
2019-01-22 00:27:16 +08:00
hong-revo
3ae742b7b5
#10
2019-01-21 17:17:55 +08:00
Hong Ooi
0f304abc70
File transfer features ( #9 )
...
* parallel upload for blobs
* more parallel blob transfer
* another header fix
* document
* blob download to memory
* all download to memory
* add multiple transfer tests
* cluster -> pool
* file multitransfer
* filetune file multitransfer
* fixing adls multi
* adls multi transfer working
* check for no files
* doc fixup
* more doc fixup
* yet more doc fixup
2019-01-20 00:09:10 +11:00
hong-revo
0a54e44700
adls and file upload from connection
2019-01-17 04:41:54 +11:00
hong-revo
adda71a6c5
blob upload from connection
2019-01-17 03:51:53 +11:00
hong-revo
2ceaa47fe0
make tests not require AzureRMR in search path
2019-01-14 01:30:23 +11:00
hong-revo
507128f07f
extend upload/download_url
2018-12-26 14:21:36 +11:00
hong-revo
972fe48caf
cleanup test files
2018-12-06 17:39:26 +11:00
hong-revo
90f521d8dc
update for adls beta hijinks
2018-12-06 17:28:05 +11:00
Hong Ooi
21b20304e9
Adlsv2 ( #1 )
...
* adls_endpoint
* adls client
* typo
* cleanup
* more adls funcs
* adls_endpoint
* adls client
* typo
* cleanup
* more adls funcs
* merge break
* Revert "merge break"
This reverts commit c451b2e1da980ed78b120819050c091a204d30f1.
* more adls fs ops
* kibozing for error messages
* 1st cut, adls file ops
* more adls ops
* adls upload working
* adls download working
* everything seems to be working
* adls doc
* doc update
* more doc update
* clarify hns setting
* adls testing
* more doc update
* adls tests working
* update docs for end of limited access preview
* readme edit
* reword readme
* update vignette
* oopsie
* oopsie again
2018-12-04 15:57:26 +08:00
hong-revo
4ddc2417e0
file testing
2018-11-22 09:06:49 +11:00
hong-revo
855c704155
resource and blob testing
2018-11-22 08:11:30 +11:00