2018-09-05 19:19:26 +03:00
|
|
|
[![Build Status](https://azurebatch.visualstudio.com/blobxfer/_apis/build/status/blobxfer-CI)](https://azurebatch.visualstudio.com/blobxfer/_build/latest?definitionId=12)
|
2017-09-02 02:38:27 +03:00
|
|
|
[![Build status](https://ci.appveyor.com/api/projects/status/qgth9p7jlessgp5i/branch/master?svg=true)](https://ci.appveyor.com/project/alfpark/blobxfer)
|
2017-10-13 19:51:04 +03:00
|
|
|
[![codecov](https://codecov.io/gh/Azure/blobxfer/branch/master/graph/badge.svg)](https://codecov.io/gh/Azure/blobxfer)
|
2017-06-01 23:02:31 +03:00
|
|
|
[![PyPI](https://img.shields.io/pypi/v/blobxfer.svg)](https://pypi.python.org/pypi/blobxfer)
|
2017-01-13 01:44:44 +03:00
|
|
|
|
2024-07-18 21:53:17 +03:00
|
|
|
## PROJECT STATUS
|
|
|
|
**This project is no longer actively maintained.** For tools officially supported by
|
|
|
|
Microsoft please refer to this
|
|
|
|
[documentation](https://docs.microsoft.com/azure/storage/common/storage-choose-data-transfer-solution).
|
|
|
|
|
2017-06-01 23:02:31 +03:00
|
|
|
# blobxfer
|
|
|
|
`blobxfer` is an advanced data movement tool and library for Azure Storage
|
|
|
|
Blob and Files. With `blobxfer` you can copy your files into or out of Azure
|
|
|
|
Storage with the CLI or integrate the `blobxfer` data movement library into
|
|
|
|
your own Python scripts.
|
2017-01-13 01:44:44 +03:00
|
|
|
|
2017-06-01 23:02:31 +03:00
|
|
|
## Major Features
|
|
|
|
* Command-line interface (CLI) providing data movement capability to and
|
|
|
|
from Azure Blob and File Storage
|
2017-06-01 23:55:54 +03:00
|
|
|
* Standalone library for integration with scripts or other Python packages
|
2017-06-01 23:02:31 +03:00
|
|
|
* High-performance design with asynchronous transfers and disk I/O
|
2018-04-16 01:28:35 +03:00
|
|
|
* Supports ingress, egress and synchronization of entire directories,
|
|
|
|
containers and file shares
|
2017-06-01 23:02:31 +03:00
|
|
|
* YAML configuration driven execution support
|
2018-10-17 18:32:44 +03:00
|
|
|
* Fine-grained resume support including resuming a broken operation
|
|
|
|
within a file or object
|
2017-06-02 06:38:15 +03:00
|
|
|
* Vectored IO support
|
2017-10-04 22:44:30 +03:00
|
|
|
* `stripe` mode allows striping a single file across multiple blobs (even
|
|
|
|
to multiple storage accounts) to break through single blob or fileshare
|
|
|
|
throughput limits
|
|
|
|
* `replica` mode allows replication of a file across multiple destinations
|
|
|
|
including to multiple storage accounts
|
2017-10-27 18:42:25 +03:00
|
|
|
* Synchronous copy with cross-mode (object transform) replication support
|
2019-07-12 18:30:22 +03:00
|
|
|
* Leverages server-side copies by default
|
2019-05-17 20:08:41 +03:00
|
|
|
* Arbitrary URL copy support
|
2017-06-01 23:02:31 +03:00
|
|
|
* Client-side encryption support
|
2017-06-03 06:06:34 +03:00
|
|
|
* Support all Azure Blob types and Azure Files for both upload and download
|
2017-06-01 23:02:31 +03:00
|
|
|
* Advanced skip options for rsync-like operations
|
|
|
|
* Store/restore POSIX filemode and uid/gid
|
2017-10-03 04:09:02 +03:00
|
|
|
* Support reading/pipe from `stdin` including to page blob destinations
|
2017-10-27 00:18:54 +03:00
|
|
|
* Support reading from blob and file share snapshots for downloading and
|
|
|
|
synchronous copy
|
2018-01-18 18:51:32 +03:00
|
|
|
* Support for setting access tier on objects for uploading and synchronous
|
|
|
|
copy
|
2017-06-02 06:38:15 +03:00
|
|
|
* Configurable one-shot block upload support
|
|
|
|
* Configurable chunk size for both upload and download
|
2017-06-03 06:06:34 +03:00
|
|
|
* Automatic block size selection for block blob uploading
|
2017-06-01 23:55:54 +03:00
|
|
|
* Automatic uploading of VHD/VHDX files as page blobs
|
|
|
|
* Include and exclude filtering support
|
2017-06-02 06:38:15 +03:00
|
|
|
* Rsync-like delete support
|
2017-06-01 23:02:31 +03:00
|
|
|
* No clobber support in either direction
|
2017-06-11 22:06:55 +03:00
|
|
|
* Automatic content type tagging
|
2019-02-26 21:43:55 +03:00
|
|
|
* Support for setting the Cache Control property of blobs and files
|
2017-06-01 23:02:31 +03:00
|
|
|
* File logging support
|
2017-10-27 00:18:54 +03:00
|
|
|
* Support for HTTP proxies
|
2017-01-13 01:44:44 +03:00
|
|
|
|
2017-06-01 23:02:31 +03:00
|
|
|
## Installation
|
2017-09-02 02:38:27 +03:00
|
|
|
There are three ways to install `blobxfer`:
|
2017-10-04 22:44:30 +03:00
|
|
|
|
2017-09-02 02:38:27 +03:00
|
|
|
* `blobxfer` Python package from [PyPI](https://pypi.python.org/pypi/blobxfer)
|
|
|
|
* Pre-built binaries available under [Releases](https://github.com/Azure/blobxfer/releases)
|
2019-05-20 21:18:30 +03:00
|
|
|
* Docker images are available for both Linux and Windows platforms on the
|
|
|
|
[Microsoft Container Registry](https://hub.docker.com/_/microsoft-blobxfer)
|
2017-09-02 02:38:27 +03:00
|
|
|
|
|
|
|
Please refer to the
|
2017-10-04 22:44:30 +03:00
|
|
|
[installation guide](http://blobxfer.readthedocs.io/en/latest/01-installation/)
|
2017-09-02 02:38:27 +03:00
|
|
|
for more information on how to install `blobxfer`.
|
2017-06-01 23:02:31 +03:00
|
|
|
|
|
|
|
## Documentation
|
2017-10-04 22:44:30 +03:00
|
|
|
Please refer to the [`blobxfer` documentation](http://blobxfer.readthedocs.io/)
|
2017-06-01 23:02:31 +03:00
|
|
|
for more details and usage information.
|
|
|
|
|
|
|
|
## Change Log
|
2017-10-05 18:10:16 +03:00
|
|
|
Please see the
|
|
|
|
[Change Log](http://blobxfer.readthedocs.io/en/latest/CHANGELOG/)
|
|
|
|
for project history.
|
2017-01-13 01:44:44 +03:00
|
|
|
|
2021-09-20 20:26:00 +03:00
|
|
|
## Support
|
2021-09-23 22:29:07 +03:00
|
|
|
This project is community supported and not officially supported by Microsoft.
|
|
|
|
There is no defined SLA for addressing features, issues, and bugs which are
|
|
|
|
exclusively serviced via GitHub issues. For tools officially supported by
|
|
|
|
Microsoft please refer to this
|
2021-09-20 20:26:00 +03:00
|
|
|
[documentation](https://docs.microsoft.com/azure/storage/common/storage-choose-data-transfer-solution).
|
|
|
|
|
2017-08-28 23:08:03 +03:00
|
|
|
* * *
|
|
|
|
Please see this project's [Code of Conduct](CODE_OF_CONDUCT.md) and
|
|
|
|
[Contributing](CONTRIBUTING.md) guidelines.
|