Azure
/
blobxfer
зеркало из https://github.com/Azure/blobxfer.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
Azure Storage transfer tool and data movement library
134 коммитов 5 Ветки 35 Теги 1,4 MiB
Python 99.4%
Shell 0.3%
Dockerfile 0.3%
Перейти к файлу
Fred Park 04d3774be2
Fix retry of broken encrypted upload 
- Resolves #61
 		2018-04-05 12:35:51 -07:00
blobxfer Fix retry of broken encrypted upload 2018-04-05 12:35:51 -07:00
cli Fix mode conversion from CLI on synccopy (#57) 2018-01-30 10:41:47 -08:00
docker Update dependencies and 3rd party notices 2018-01-30 10:41:53 -08:00
docs Fix appveyor build and Python ref 2018-03-06 12:33:33 -08:00
tests Fix retry of broken encrypted upload 2018-04-05 12:35:51 -07:00
.codecov.yml Require codecov status checks 2017-10-23 10:55:53 -07:00
.coveragerc Switch from Coveralls to Codecov 2017-10-13 20:46:41 +01:00
.gitignore Initial restructure 2017-01-24 14:28:09 -08:00
.travis.yml Log interpreter arch 2018-02-16 14:02:03 -08:00
CHANGELOG.md Tag for 1.1.1 release 2018-01-30 10:41:54 -08:00
CODE_OF_CONDUCT.md Add code of conduct file 2017-08-28 13:12:14 -07:00
CONTRIBUTING.md Add code of conduct file 2017-08-28 13:12:14 -07:00
LICENSE Initial commit from 2016-07-25 2016-07-28 11:18:24 -07:00
MANIFEST.in Initial commit from 2016-07-25 2016-07-28 11:18:24 -07:00
README.md Add blob access tier support on upload/synccopy 2018-01-18 07:51:32 -08:00
THIRD_PARTY_NOTICES.txt Update dependencies and 3rd party notices 2018-01-30 10:41:53 -08:00
appveyor.yml Fix appveyor build and Python ref 2018-03-06 12:33:33 -08:00
mkdocs.yml Add Read the Docs builds 2017-10-04 12:56:34 -07:00
setup.cfg Initial commit from 2016-07-25 2016-07-28 11:18:24 -07:00
setup.py Update dependencies and 3rd party notices 2018-01-30 10:41:53 -08:00
test_requirements.txt Switch from Coveralls to Codecov 2017-10-13 20:46:41 +01:00
tox.ini Switch from Coveralls to Codecov 2017-10-13 20:46:41 +01:00

README.md

Build Status Build status codecov PyPI Docker Pulls Image Layers

blobxfer

blobxfer is an advanced data movement tool and library for Azure Storage Blob and Files. With blobxfer you can copy your files into or out of Azure Storage with the CLI or integrate the blobxfer data movement library into your own Python scripts.

Major Features

  • Command-line interface (CLI) providing data movement capability to and from Azure Blob and File Storage
  • Standalone library for integration with scripts or other Python packages
  • High-performance design with asynchronous transfers and disk I/O
  • YAML configuration driven execution support
  • Resume support
  • Vectored IO support
    • stripe mode allows striping a single file across multiple blobs (even to multiple storage accounts) to break through single blob or fileshare throughput limits
    • replica mode allows replication of a file across multiple destinations including to multiple storage accounts
  • Synchronous copy with cross-mode (object transform) replication support (including block-level copies for Block blobs)
  • Client-side encryption support
  • Support all Azure Blob types and Azure Files for both upload and download
  • Advanced skip options for rsync-like operations
  • Store/restore POSIX filemode and uid/gid
  • Support reading/pipe from stdin including to page blob destinations
  • Support reading from blob and file share snapshots for downloading and synchronous copy
  • Support for setting access tier on objects for uploading and synchronous copy
  • Configurable one-shot block upload support
  • Configurable chunk size for both upload and download
  • Automatic block size selection for block blob uploading
  • Automatic uploading of VHD/VHDX files as page blobs
  • Include and exclude filtering support
  • Rsync-like delete support
  • No clobber support in either direction
  • Automatic content type tagging
  • File logging support
  • Support for HTTP proxies

Installation

There are three ways to install blobxfer:

  • blobxfer Python package from PyPI
  • Pre-built binaries available under Releases
  • Docker images are available for both Linux and Windows platforms on Docker Hub

Please refer to the installation guide for more information on how to install blobxfer.

Documentation

Please refer to the blobxfer documentation for more details and usage information.

Change Log

Please see the Change Log for project history.

Please see this project's Code of Conduct and Contributing guidelines.