Azure Storage transfer tool and data movement library
Перейти к файлу
Fred Park 8c684419a6 Add upload to page blob support 2017-09-01 09:08:57 -07:00
blobxfer Add upload to page blob support 2017-09-01 09:08:57 -07:00
cli Add upload to page blob support 2017-09-01 09:08:57 -07:00
docker Add develop branch Dockerfile 2017-06-05 07:41:23 -07:00
docs Add upload to page blob support 2017-09-01 09:08:57 -07:00
tests Add upload to page blob support 2017-09-01 09:08:57 -07:00
.coveragerc Initial restructure 2017-01-24 14:28:09 -08:00
.gitignore Initial restructure 2017-01-24 14:28:09 -08:00
.travis.yml Add AppVeyor setup and builds 2017-08-30 14:16:24 -07:00
CHANGELOG.md Add upload to page blob support 2017-09-01 09:08:57 -07:00
CODE_OF_CONDUCT.md Add code of conduct file 2017-08-28 13:12:14 -07:00
CONTRIBUTING.md Add code of conduct file 2017-08-28 13:12:14 -07:00
LICENSE Initial commit from 2016-07-25 2016-07-28 11:18:24 -07:00
MANIFEST.in Initial commit from 2016-07-25 2016-07-28 11:18:24 -07:00
README.md Add upload to page blob support 2017-09-01 09:08:57 -07:00
appveyor.yml Add AppVeyor setup and builds 2017-08-30 14:16:24 -07:00
setup.cfg Initial commit from 2016-07-25 2016-07-28 11:18:24 -07:00
setup.py Add AppVeyor setup and builds 2017-08-30 14:16:24 -07:00
test_requirements.txt Add AppVeyor setup and builds 2017-08-30 14:16:24 -07:00
tox.ini Add AppVeyor setup and builds 2017-08-30 14:16:24 -07:00

README.md

Build Status Coverage Status PyPI PyPI Docker Pulls Image Layers

blobxfer

blobxfer is an advanced data movement tool and library for Azure Storage Blob and Files. With blobxfer you can copy your files into or out of Azure Storage with the CLI or integrate the blobxfer data movement library into your own Python scripts.

Major Features

  • Command-line interface (CLI) providing data movement capability to and from Azure Blob and File Storage
  • Standalone library for integration with scripts or other Python packages
  • High-performance design with asynchronous transfers and disk I/O
  • YAML configuration driven execution support
  • Resume support
  • Vectored IO support
    • stripe mode allows striping a single file across multiple blobs (even to multiple storage accounts) to break through single blob or fileshare throughput limits
    • replica mode allows replication of a file across multiple destinations including to multiple storage accounts
  • Synchronous copy with cross-mode replication support (including block-level copies for Block blobs)
  • Client-side encryption support
  • Support all Azure Blob types and Azure Files for both upload and download
  • Advanced skip options for rsync-like operations
  • Store/restore POSIX filemode and uid/gid
  • Support reading/pipe from stdin including page blob destinations
  • Support reading from blob snapshots for downloading and synchronous copy
  • Configurable one-shot block upload support
  • Configurable chunk size for both upload and download
  • Automatic block size selection for block blob uploading
  • Automatic uploading of VHD/VHDX files as page blobs
  • Include and exclude filtering support
  • Rsync-like delete support
  • No clobber support in either direction
  • Automatic content type tagging
  • File logging support

Installation

blobxfer is on PyPI and on Docker Hub. Please refer to the installation guide on how to install blobxfer.

Documentation

Please refer to the blobxfer documentation for more details and usage information.

Change Log

For recent changes, please refer to the CHANGELOG.md file.


Please see this project's Code of Conduct and Contributing guidelines.