AzureStor/NEWS.md

56 строки
4.5 KiB
Markdown
Исходник Обычный вид История

# AzureStor 2.1.1.9000
- The multiple-file transfer functions now accept vectors as their source and destination arguments. Each element of the source can be a filename, or a wildcard expanding to multiple files, eg `multiupload_adls_file(container, c("file1", "name.*", "*.csv"), "destdir")`. Th destination should be either a single name giving the destination directory, or a vector of file/pathnames with one element for each file transferred. See the examples for more details.
- Creating a service-specific endpoint (`file_endpoint`, `blob_endpoint`, `adls_endpoint`) with an invalid URL will now warn, instead of throwing an error. This enables using tools like Azurite, which use a local address as the endpoint. Calling `storage_endpoint` with an invalid URL will still throw an error, as the function has no way of telling which storage service is required.
- Remove the warning about ADLSgen2 not supporting shared access signatures (SAS).
- Background process pool functionality has been moved to AzureRMR. This removes code duplication, and also makes it available for other packages that may benefit.
2019-09-11 04:11:59 +03:00
# AzureStor 2.1.1
- Correctly handle ADLSgen2 and file storage listings with more than 5000 files.
2019-09-12 06:16:24 +03:00
- Fix a bug in confirmation prompts. On R >= 3.5, prompts will now use `utils::askYesNo`; as a side-effect, Windows users who are using RGUI.exe will see a popup dialog box instead of a message in the terminal.
2019-09-11 04:11:59 +03:00
2019-07-19 04:37:32 +03:00
# AzureStor 2.1.0
- Update client API versions to "2018-11-09".
2019-07-18 01:33:17 +03:00
- Fix bug with blob uploading using azcopy.
2019-07-18 06:42:24 +03:00
- Add `copy_url_to_blob` function, for directly copying a HTTP\[S\] URL to blob storage. The corresponding generic is `copy_url_to_storage`, with a method for blob containers (only).
2019-05-24 19:11:40 +03:00
# AzureStor 2.0.2
2019-05-17 08:07:54 +03:00
- By default, HTTP(S) requests to the storage endpoint will now be retried on encountering a network error. To change the number of retries, call `options(azure_storage_retries=N)` where N >= 0. Setting this option to zero disables retrying.
2019-05-18 00:21:13 +03:00
- Downloading now proceeds in blocks, much like uploading. The default block size is set to 16MB for blob and ADLSgen2, and 4MB for file storage. While this reduces the throughput slightly (basically there is at least one extra REST call involved), it allows retrying a failed transfer on a per-block basis rather than having to redownload the entire file.
2019-05-24 19:11:40 +03:00
- Also display the progress bar for uploads. The command to enable/disable the progress bar is now `options(azure_storage_progress_bar=TRUE|FALSE)`.
2019-03-21 15:48:51 +03:00
# AzureStor 2.0.1
2019-02-17 09:36:24 +03:00
- Display a progress bar when downloading single files. To turn this on or off, call `options(azure_dl_progress_bar=TRUE|FALSE)`.
2019-02-17 09:36:24 +03:00
- Fix `upload_to_url`/`download_from_url` bugs introduced in last update.
2019-02-13 17:15:21 +03:00
# AzureStor 2.0.0
2018-12-26 06:23:40 +03:00
## Significant user-visible changes
* Support authentication via Azure Active Directory tokens for blob and ADLSgen2 storage.
2019-01-19 16:14:53 +03:00
* Support uploading and downloading to in-memory R objects, without having to create a temporary file. Uploading can be done with `src` a `rawConnection` or `textConnection` object. For downloading, if `dest` is `NULL`, the downloaded data is returned as a raw vector, or if `dest` is a `rawConnection`, in the connection object. See the examples in the documentation.
* Implement parallel file transfers using a background pool of R processes. This can significantly speed up transfers when working with multiple small files.
2019-02-05 17:04:39 +03:00
* Experimental support for using the Microsoft AzCopy commandline utility to perform file transfers. Set the argument `use_azcopy=TRUE` in any upload or download function to call AzCopy rather than relying on internal R code. The `call_azcopy` function also allows you to run AzCopy with arbitrary arguments. Requires [AzCopy version 10](https://github.com/Azure/azure-storage-azcopy).
* New generics for storage operations:
- `storage_container`, `create_storage_container`, `delete_storage_container`, `list_storage_containers` for managing containers (blob containers, file shares, ADLSgen2 filesystems)
- `storage_upload`, `storage_download`, `storage_multiupload`, `storage_multidownload` for file transfers
- `list_storage_files`, `create_storage_dir`, `delete_storage_dir`, `delete_storage_file` for managing objects within a container
## Other changes
* Add ADLS upload/download support to `upload_to_url` and `download_from_url`.
2019-01-17 15:34:06 +03:00
* Set default blocksize for `upload_azure_file` to 4MB, the maximum permitted by the API (#5).
2019-02-07 13:48:40 +03:00
* Allow resource group and subscription accessor methods to work when AzureStor is not on the search path.
2018-12-26 06:23:40 +03:00
2018-12-06 09:28:05 +03:00
# AzureStor 1.0.0
* Submitted to CRAN
2018-10-23 19:38:57 +03:00
# AzureStor 0.9.0
2018-10-19 17:45:16 +03:00
* Moved to cloudyr organisation