2017-06-01 23:02:31 +03:00
|
|
|
[![Build Status](https://travis-ci.org/Azure/blobxfer.svg?branch=master)](https://travis-ci.org/Azure/blobxfer)
|
2017-09-02 02:38:27 +03:00
|
|
|
[![Build status](https://ci.appveyor.com/api/projects/status/qgth9p7jlessgp5i/branch/master?svg=true)](https://ci.appveyor.com/project/alfpark/blobxfer)
|
2017-10-13 19:51:04 +03:00
|
|
|
[![codecov](https://codecov.io/gh/Azure/blobxfer/branch/master/graph/badge.svg)](https://codecov.io/gh/Azure/blobxfer)
|
2017-06-01 23:02:31 +03:00
|
|
|
[![PyPI](https://img.shields.io/pypi/v/blobxfer.svg)](https://pypi.python.org/pypi/blobxfer)
|
|
|
|
[![Docker Pulls](https://img.shields.io/docker/pulls/alfpark/blobxfer.svg)](https://hub.docker.com/r/alfpark/blobxfer)
|
|
|
|
[![Image Layers](https://images.microbadger.com/badges/image/alfpark/blobxfer:latest.svg)](http://microbadger.com/images/alfpark/blobxfer)
|
2017-01-13 01:44:44 +03:00
|
|
|
|
2017-06-01 23:02:31 +03:00
|
|
|
# blobxfer
|
|
|
|
`blobxfer` is an advanced data movement tool and library for Azure Storage
|
|
|
|
Blob and Files. With `blobxfer` you can copy your files into or out of Azure
|
|
|
|
Storage with the CLI or integrate the `blobxfer` data movement library into
|
|
|
|
your own Python scripts.
|
2017-01-13 01:44:44 +03:00
|
|
|
|
2017-06-01 23:02:31 +03:00
|
|
|
## Major Features
|
|
|
|
* Command-line interface (CLI) providing data movement capability to and
|
|
|
|
from Azure Blob and File Storage
|
2017-06-01 23:55:54 +03:00
|
|
|
* Standalone library for integration with scripts or other Python packages
|
2017-06-01 23:02:31 +03:00
|
|
|
* High-performance design with asynchronous transfers and disk I/O
|
|
|
|
* YAML configuration driven execution support
|
|
|
|
* Resume support
|
2017-06-02 06:38:15 +03:00
|
|
|
* Vectored IO support
|
2017-10-04 22:44:30 +03:00
|
|
|
* `stripe` mode allows striping a single file across multiple blobs (even
|
|
|
|
to multiple storage accounts) to break through single blob or fileshare
|
|
|
|
throughput limits
|
|
|
|
* `replica` mode allows replication of a file across multiple destinations
|
|
|
|
including to multiple storage accounts
|
2017-10-27 18:42:25 +03:00
|
|
|
* Synchronous copy with cross-mode (object transform) replication support
|
|
|
|
(including block-level copies for Block blobs)
|
2017-06-01 23:02:31 +03:00
|
|
|
* Client-side encryption support
|
2017-06-03 06:06:34 +03:00
|
|
|
* Support all Azure Blob types and Azure Files for both upload and download
|
2017-06-01 23:02:31 +03:00
|
|
|
* Advanced skip options for rsync-like operations
|
|
|
|
* Store/restore POSIX filemode and uid/gid
|
2017-10-03 04:09:02 +03:00
|
|
|
* Support reading/pipe from `stdin` including to page blob destinations
|
2017-10-27 00:18:54 +03:00
|
|
|
* Support reading from blob and file share snapshots for downloading and
|
|
|
|
synchronous copy
|
2017-06-02 06:38:15 +03:00
|
|
|
* Configurable one-shot block upload support
|
|
|
|
* Configurable chunk size for both upload and download
|
2017-06-03 06:06:34 +03:00
|
|
|
* Automatic block size selection for block blob uploading
|
2017-06-01 23:55:54 +03:00
|
|
|
* Automatic uploading of VHD/VHDX files as page blobs
|
|
|
|
* Include and exclude filtering support
|
2017-06-02 06:38:15 +03:00
|
|
|
* Rsync-like delete support
|
2017-06-01 23:02:31 +03:00
|
|
|
* No clobber support in either direction
|
2017-06-11 22:06:55 +03:00
|
|
|
* Automatic content type tagging
|
2017-06-01 23:02:31 +03:00
|
|
|
* File logging support
|
2017-10-27 00:18:54 +03:00
|
|
|
* Support for HTTP proxies
|
2017-01-13 01:44:44 +03:00
|
|
|
|
2017-06-01 23:02:31 +03:00
|
|
|
## Installation
|
2017-09-02 02:38:27 +03:00
|
|
|
There are three ways to install `blobxfer`:
|
2017-10-04 22:44:30 +03:00
|
|
|
|
2017-09-02 02:38:27 +03:00
|
|
|
* `blobxfer` Python package from [PyPI](https://pypi.python.org/pypi/blobxfer)
|
|
|
|
* Pre-built binaries available under [Releases](https://github.com/Azure/blobxfer/releases)
|
|
|
|
* Docker images are available for both Linux and Windows platforms on
|
|
|
|
[Docker Hub](https://hub.docker.com/r/alfpark/blobxfer/)
|
|
|
|
|
|
|
|
Please refer to the
|
2017-10-04 22:44:30 +03:00
|
|
|
[installation guide](http://blobxfer.readthedocs.io/en/latest/01-installation/)
|
2017-09-02 02:38:27 +03:00
|
|
|
for more information on how to install `blobxfer`.
|
2017-06-01 23:02:31 +03:00
|
|
|
|
|
|
|
## Documentation
|
2017-10-04 22:44:30 +03:00
|
|
|
Please refer to the [`blobxfer` documentation](http://blobxfer.readthedocs.io/)
|
2017-06-01 23:02:31 +03:00
|
|
|
for more details and usage information.
|
|
|
|
|
|
|
|
## Change Log
|
2017-10-05 18:10:16 +03:00
|
|
|
Please see the
|
|
|
|
[Change Log](http://blobxfer.readthedocs.io/en/latest/CHANGELOG/)
|
|
|
|
for project history.
|
2017-01-13 01:44:44 +03:00
|
|
|
|
2017-08-28 23:08:03 +03:00
|
|
|
* * *
|
|
|
|
Please see this project's [Code of Conduct](CODE_OF_CONDUCT.md) and
|
|
|
|
[Contributing](CONTRIBUTING.md) guidelines.
|