Azure
/
blobxfer
зеркало из https://github.com/Azure/blobxfer.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
142 коммитов 5 Ветки 35 Теги 1,4 MiB
Граф коммитов

50 Коммитов

Автор SHA1 Сообщение Дата
Fred Park e7a786b7ab
Add quiet option 
- Resolves #70
 2018-04-16 08:55:20 -07:00
Fred Park 906904c6b9
Fix mode conversion from CLI on synccopy (#57) 
- Resolves #57
 2018-01-30 10:41:47 -08:00
Fred Park 457241da58
Add blob access tier support on upload/synccopy 
- Update dependencies to latest
 2018-01-18 07:51:32 -08:00
Fred Park 4276dadcf3 Add custom exception handling for retries 
- Doc updates
 2017-11-06 11:53:43 -08:00
Fred Park 57eb9185e1 Add max_retries option 2017-10-26 09:09:53 -07:00
Fred Park 054414f0eb Add HTTP Proxy support 2017-10-24 16:53:47 -07:00
Fred Park 68bb2f49d4 Add --enable-azure-storage-logger option 
- Resolves #47
 2017-10-13 20:46:41 +01:00
Fred Park 607cb9b661 Fix cli options 
- Resolves #48
 2017-10-13 20:46:41 +01:00
Fred Park 939ccae615 Add --show-config option 2017-10-05 09:36:15 -07:00
Fred Park 6097c4b6a7 Migrate to azure-storage split library 
- Disable azure.storage logging
- Resolves #45
 2017-10-05 09:02:02 -07:00
Fred Park 9804036d06 Various fixes 
- Multiple --include and/or --exclude from the commandline
- --file-md5 option being ignored on download
- Incorrect MD5 computation for unaligned page blobs on upload
- stdin autoenable --rename
- Expand blobxfer.api surface
 2017-10-02 18:59:15 -07:00
Fred Park cda780707e Add version to config yaml 
- Add data movement library guide
 2017-09-12 13:42:17 -07:00
Fred Park 2479dae138 Tag for 1.0.0b2 release 
- Fix tagged release build issues
 2017-09-01 19:25:59 -07:00
Fred Park 8c684419a6 Add upload to page blob support 2017-09-01 09:08:57 -07:00
Fred Park 5c3c093f88 Add synccopy rename support 
- Fix YAML config merge with commandline options with YAML options not present
- Fix synccopy invocation from commandline without YAML
 2017-08-30 20:09:04 -07:00
Fred Park a89c4b30a8 Add AppVeyor setup and builds 2017-08-30 14:16:24 -07:00
Fred Park e7af3469d5 Add deployment artifacts to travis build 
- Tagged releases to PyPI
- PyInstaller packaged tagged releases to GitHub
 2017-08-29 14:08:02 -07:00
Fred Park bc2c632e1b Fix option retrieval 
- Remove travis workarounds for tox
- Decrease timeouts
- Update docs
 2017-08-28 12:51:44 -07:00
Fred Park 2aaa16f8b5 Simplify timeout passing 
- Remove monkey-patched timeout to storage sdk
- Allow fine-grained timeout control (connect/read)
- Update dependencies
 2017-08-28 10:23:15 -07:00
Fred Park 12f7a0c654 Allow CLI option override of YAML conf 
- Fix various upload issues (zero byte and dupes)
- Check for max page blob size
- --strip-components defaults to 0
 2017-08-15 09:46:10 -07:00
Fred Park 9f97e1cd4f Add cross-mode synccopy support 
- Resolves #37
 2017-07-10 08:46:26 -07:00
Fred Park 66b3c68d7c Begin synccopy work 2017-06-08 20:15:53 -07:00
Fred Park e1d97fa3cb Tag for 1.0.0a3 release 
- Rename some options
- Make thread join more robust on Python2
 2017-06-02 10:16:12 -07:00
Fred Park bb9f68a3bb More documentation 
- Rename some options
- Catch KeyErrors and rethrow for required options to clarify
 2017-06-01 21:03:09 -07:00
Fred Park 0dca02ce83 Doc updates 
- Remove useconfig command and instead use --config option
 2017-06-01 14:40:03 -07:00
Fred Park 6267551cc7 Add base documentation 
- Update README
- Rev version to 1.0.0a2
 2017-06-01 13:56:22 -07:00
Fred Park e308ed8595 Fix existing tests 
- Fix various issues uncovered from UTs
 2017-05-31 21:01:37 -07:00
Fred Park 4e0ee1b21f Fix packaging issues 2017-05-30 15:53:18 -07:00
Fred Park 351eee537c useconfig upload/download support 
- Fix various yaml/dict config issues
- Allow md5 checks through vectored io stripes
 2017-05-30 13:03:40 -07:00
Fred Park 5ae05958ed Append blob support 2017-05-30 08:55:36 -07:00
Fred Park 69edbc9fde Client-side encryption upload support 
- Split transfer threads into disk/transfer
- Various fixes
- Update dependencies to latest
 2017-05-25 09:01:57 -07:00
Fred Park ccd8db28d3 Block uploading 
- Fix striped uploads
- Add --delete support to upload
- Block size auto-select support
- Metadata support including file attr and vectored io
- Disable container create on insufficient sas token privilege
 2017-05-22 20:26:52 -07:00
Fred Park 28b9bc9df5 Continue upload work 
- Add one-shot parameter
- Begin accommodating vectorized output
 2017-05-19 15:01:49 -07:00
Fred Park 52c504ad6c Fix filter check on download 
- Retry interval shortened
- Allow multiple include/exclude filters to be specified on the CLI
 2017-05-18 08:18:14 -07:00
Fred Park 85183bae71 Begin upload work 2017-05-16 15:06:47 -07:00
Fred Park fbdd1b1f12 More download features 
- Add delete support on download
- Add recursive support on download
- Add common requests session for connection pooling support with
  matched transfer thread count
 2017-04-10 14:49:54 -07:00
Fred Park a09bbfb655 Add file log, param preamble and progress bar 2017-04-07 14:38:57 -07:00
Fred Park 2bcab1e605 Fix tests to align with refactor 
- Move some classes out of models to operations
 2017-04-05 14:14:41 -07:00
Fred Park bb81f29802 Reorganize sources into sensible hierarchy 2017-04-04 11:37:27 -07:00
Fred Park bc36c5d08b Add cleanup actions 2017-02-28 13:27:20 -08:00
Fred Park fa72fc92fa Fix file download issues 
- Update dependencies to latest
 2017-02-28 09:55:28 -08:00
Fred Park d70d404b46 Current download parity 
- Main download logic at parity with current blobxfer
- Refactor multiprocess offload into base class
- Add multiprocess crypto offload
 2017-02-26 02:23:45 -08:00
Fred Park e82890ada9 Download offsets 
- Bind ASE to DownloadDescriptor instead
- Add chunk size option to download and synccopy
 2017-02-23 23:47:16 -08:00
Fred Park 146fc24d35 Pre-download logic 
- Add concurrency options
- Centralize MD5 logic
 2017-02-23 14:57:01 -08:00
Fred Park e1d5f9f802 Add tests for MD5/download 
- Add more model tests
- Add noqa tags for ImportError except blocks
 2017-02-22 10:08:54 -08:00
Fred Park 290a1ebdf9 Refactor MD5/Downloader to classes 
- Eliminate global state
 2017-02-21 21:20:16 -08:00
Fred Park d862d74aa2 Begin list parsing for download and MD5 offload 
- Add AzureStorageEntity model
- Start MD5 offload api
- Start download api
 2017-02-21 15:06:43 -08:00
Fred Park 616c7666bc Add some crypto models 2017-02-17 07:29:32 -08:00
Fred Park f0a4209e43 Continue download model evolution with tests 2017-02-14 14:57:29 -08:00
Fred Park 8053cf69ec Continue layout restructure 
- Add base models
- Add client create ops
- Travis CI to tox
 2017-02-07 13:00:43 -08:00