Azure
/
AzureStor
зеркало из https://github.com/Azure/AzureStor.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
316 коммитов 3 Ветки 0 Теги 1,1 MiB
Граф коммитов

206 Коммитов

Автор SHA1 Сообщение Дата
Hong Ooi 9de05e364d set timeout correctly (fixes #105) 2021-10-28 23:50:15 +11:00
Hong Ooi 3a37ac6ba4
Support deletion of root directory (#104) 
* implement del adls rootdir

* also fix rootdir del for other services

* testsuite maintenance
 2021-10-28 12:40:55 +11:00
Hong Ooi 71b2e0eab6
Use vctrs for storage file lists (#103) 
Should resolve continuing issues with list_blobs and list_adls_files
 2021-10-23 07:29:13 +11:00
Hong Ooi b3df2fbb2f
Recursive dir deletion for file/blob storage (#101) 
Implements `delete_storage_dir(*, recursive=TRUE)`, something that is needed for the pins package
 2021-10-16 05:10:51 +11:00
Hong Ooi 8136935d74 fix file listing for empty filesystem 2021-10-13 13:28:47 +11:00
Hadley Wickham 2f162d7b72
Fix two partial name matches (#97) 2021-08-07 04:07:03 +10:00
Hong Ooi b027e98d41 retain option values on load (closes #96) 2021-08-06 17:14:22 +10:00
Hong Ooi acd046b0bd workaround for readr 2.0 (fixes #95) 2021-08-05 02:45:33 +10:00
Hong Ooi 78c7e46160 add service arg to storage_endpoint 2021-05-15 16:12:38 +10:00
Hong Ooi 2eb4e0ae55
Update API version (#91) 
* doc pass

* update to 2020-04-08 api

* quick fix for user delegation sas

* rm stray rcst param (?)

* update doc

* support dir resource, fix broken tests

* rm stray debug code

* update doc

* notable feature change from api update
 2021-05-15 02:44:51 +10:00
Hong Ooi 236c008b42
Service SAS (#90) 
closes #89
 2021-05-09 23:46:47 +10:00
Kyle Harris d25ea65b71
Use raw connection instead of raw vector with readr::read_delim, read_csv2 (#86) 
closes #85 
Co-authored-by: Kyle Harris <kyle.harris@claconnect.com>
Co-authored-by: Hong Ooi <hongooi73@gmail.com>
 2021-04-24 18:14:07 +10:00
Hong Ooi 4d24b4421b fix list_blobs when leases are present 2021-04-24 08:13:08 +10:00
Hong Ooi 62a612c693
storage_load_rds fix (#84) 
fixes #83
 2021-04-15 13:54:58 +10:00
Hong Ooi e4d3c407b1 handle missing date column in list_adls_files 2021-02-26 01:18:54 +11:00
Hong Ooi f64b2c7920 change sas start time to allow for clock skew 2021-02-25 17:57:04 +11:00
Hong Ooi 4d1d9a5da3
Lease fix (#80) 
* add lease header to put-blocklist

* load pkgs quietly

* fix for new behaviour with append blobs and hns

* also test blob transfers

* also test adls lease

* reword news
 2021-02-17 19:33:18 +11:00
Hong Ooi 0a9832edb2 fix blob lease functions 2021-02-14 20:47:42 +11:00
Hong Ooi b4db834ecf use namespace qualifiers 2021-01-13 12:30:49 +11:00
Hong Ooi 59245a70c6 some fixes 2021-01-13 12:25:58 +11:00
Hong Ooi 0c7d8d0c15
Add file format helpers (#75) 
* change org

* Revert "change org"

This reverts commit 512e64fb94.

* better cloudyr checking

* Format helpers (#1)

* better cloudyr checking

* add format helpers

* document

* update mds, desc
 2021-01-12 05:27:00 +11:00
Hong Ooi 39202d7301 fix missing arg 2020-10-13 03:34:34 +11:00
Hong Ooi c47df7face
Md5 (#73) 
Implements MD5 hashing:
- store hash on upload
- check hash on download
- add Content-MD5 header on transfers for error checking
 2020-09-24 02:06:33 +10:00
Hong Ooi 8df7b6fa61 azcopy does not support appending right now 2020-09-12 05:11:25 +10:00
Hong Ooi 5ebd3a66eb
Append blob (#71) 
* commit

* append blob uploading

* list_blobs working

* document, implement actual appending

* redocument

* update mds

* fix example

* tests

* regression error fixes

* more regression fixes

* doc refresh
 2020-09-07 16:31:42 +10:00
Hong Ooi cef6c5ee30 add fuzz factor for generated SAS 2020-09-06 16:38:27 +10:00
Hong Ooi 01fd5bca25 fix list_blobs paging, closes #69 2020-09-04 06:13:25 +10:00
Hong Ooi b0dcdff533
Emulator support (#68) 
Adds support for the Azurite and Azure SDK storage emulators, closes #66
 2020-08-24 16:31:39 +10:00
Hong Ooi 47bad2ddb9 update link to adls namespaces doc page 2020-08-15 11:45:31 +10:00
Hong Ooi 26a6d7ec8f
Fix transfers with non-ASCII filenames (#63) 
Fixes #62
 2020-07-20 13:22:19 +10:00
Hong Ooi 25632dda2e
Implement create/delete dirs for blob storage (#59) 
* blob create/delete

* implement generics

* works

* update news

* better wording

* also update readme

* update readme again
 2020-07-01 19:20:41 +10:00
Hong Ooi adb2550407 rm broken delete_azure_dir(recursive=TRUE) 2020-07-01 06:44:13 +10:00
Hans Van Slooten 1a30a9c054
Adds hierarchy functionality to list_blobs mentioned in issue #55 (#56) 
* Adds hierarchy functionality to list_blobs mentioned in issue #55

* documentation

* update documentation for list_blobs

* Formatting fixes for suggestions.

* linting

* style

* by_hierarchy -> recursive

* test flipped

* add tests

* document

* consistent behaviour for recursive arg

* simplifying logic

Co-authored-by: Hans Van Slooten <HansVanSlooten@twinsbaseball.com>
Co-authored-by: Hong Ooi <hongooi@microsoft.com>
 2020-07-01 02:21:51 +10:00
Hong Ooi f3bf08a625 more list_blobs fixes 2020-06-28 10:14:20 +10:00
Hong Ooi 94ba062e2b fix list_blobs bug with azcopy (fixes #52) 2020-06-09 23:58:24 +10:00
Hong Ooi 6b8e4d833b extend storage_error_message for odata 2020-06-05 19:32:39 +10:00
Hong Ooi b25daedf6f doc tweaking 2020-04-10 12:35:37 +10:00
Hong Ooi b2e209c39f
Generate sas (#49) 
Greater support for generating an account or user-delegated SAS. Adds S3 generics/methods for `get_account_sas`, `get_user_delegation_key`, `get_user_delegation_sas`, `revoke_user_delegation_keys`. Closes #26
 2020-04-09 21:43:07 +10:00
Hong Ooi ee7f935480 fix make_signature, parse_storage_url 2020-04-06 07:26:08 +10:00
Hong Ooi e9402fdebd redocument 2020-04-04 19:54:24 +11:00
Hong Ooi 826a166c3e
List containers (#48) 
* change blob listing

* also fix files
 2020-04-03 04:13:26 +11:00
Hong Ooi a71fcf88a9
Dev (#47) 
* check for continuation markers

* basic support for file perms API

* set blob content-type more efficiently

* add content-type tests

* update news

* fix rmds for updated call_azcopy

* more rmd fixes
 2020-04-03 01:59:18 +11:00
Hong Ooi bb3151689e really fix stale date problem 2020-03-02 16:24:55 -05:00
Hong Ooi a98859df89
adls bug fixes (#42) 2020-02-25 05:33:51 +11:00
Hong Ooi bdb5841fd3
Make sign_request generic (#41) 
* generic sign_request

* update news

* get it to work
 2020-02-11 08:44:57 +11:00
Hong Ooi bda6337687 doc update 2020-01-15 12:18:35 +08:00
Hong Ooi 83ec923c28 fix exists check 2020-01-14 14:38:21 +08:00
Hong Ooi dbabefa0bc
Azcopy update (#37) 
Refactoring, expanding azcopy support
 2020-01-14 15:55:59 +11:00
Hong Ooi c40c98132a fix dest defaults for generics 2020-01-10 07:10:50 +11:00
Hong Ooi 1b704639df fix #36 2020-01-06 16:52:41 +11:00