Azure
/
blobxfer
зеркало из https://github.com/Azure/blobxfer.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
253 коммитов 5 Ветки 35 Теги 1,4 MiB
Граф коммитов

57 Коммитов

Автор SHA1 Сообщение Дата
Fred Park ea0af4a5bc
Update dependencies and support 
- Drop support for Python < 3.6 (including Python 2), resolves #94
- Some dependencies have less strict requirements, resolves #121
- Add Python 3.8 and 3.9 support
- Rebase Docker images on Python 3.9.4 and Alpine 3.13
- Update CI pipelines and remove Travis
 2021-04-16 20:24:55 +00:00
Fred Park 4841efaa6e
Fix synccopy issues 
- --storage-url was not accepted
- --sync-copy-dest-storage-url destination mode was not being properly
percolated
- Add additional synccopy auth limitations to docs
- Resolves #108
 2019-11-01 17:20:37 +00:00
Fred Park ac2b1d5830
Support strip components for synccopy 
- Resolves #103
 2019-07-22 16:50:21 +00:00
Fred Park d4e3f30de2
Support delete only option 
- Resolves #101
 2019-07-12 17:48:59 +00:00
Fred Park 6ce66b396b
Add arbitrary remote url synccopy 2019-05-28 19:49:40 +00:00
Fred Park 5a2797140e
Support server side copy for Azure sources 2019-05-21 20:05:54 +00:00
Fred Park ce8cba3343
Add support for explicit ContentType 
- Resolves #95
 2019-04-15 16:52:33 +00:00
Fred Park afb473b4b1
Add support for setting Cache Control 
- Support copying cache control property in synccopy operations
- Resolves #91
 2019-02-26 12:11:06 -08:00
Fred Park dff392dd9a
Add configurable max single object concurrency 2019-01-14 11:16:16 -08:00
Fred Park 950e2ff1fa
Add restore file LMT option on download 
- Breaking change with YAML configuration: restore_file_attributes bool
  has been replaced with restore_file_properties map
- Resolves #82
 2018-08-07 16:48:42 -07:00
Fred Park 8be2531c2d
Add Azure storage URL support to CLI 
- Support storage URLs for all modes
- Enhance documentation
- Resolves #79
 2018-08-07 12:57:03 -07:00
Fred Park ebd32510f1
Support dry run execution 
- Fix potential issue with logging of processed file counts
- Resolves #74
 2018-06-15 10:47:37 -07:00
Fred Park 5b55a94148
Improve retry handling 
- Update dependencies
- Resolves #75
 2018-06-15 10:40:04 -07:00
Fred Park 1b63ec9e5b
Fix omitted freeze support for multiprocessing 2018-04-17 11:05:22 -07:00
Fred Park 2a6dbbf4ce
Support strip-components on download 
- Resolves #69
 2018-04-16 10:57:10 -07:00
Fred Park e7a786b7ab
Add quiet option 
- Resolves #70
 2018-04-16 08:55:20 -07:00
Fred Park 457241da58
Add blob access tier support on upload/synccopy 
- Update dependencies to latest
 2018-01-18 07:51:32 -08:00
Fred Park 57eb9185e1 Add max_retries option 2017-10-26 09:09:53 -07:00
Fred Park 054414f0eb Add HTTP Proxy support 2017-10-24 16:53:47 -07:00
Fred Park 68bb2f49d4 Add --enable-azure-storage-logger option 
- Resolves #47
 2017-10-13 20:46:41 +01:00
Fred Park 607cb9b661 Fix cli options 
- Resolves #48
 2017-10-13 20:46:41 +01:00
Fred Park 939ccae615 Add --show-config option 2017-10-05 09:36:15 -07:00
Fred Park 6097c4b6a7 Migrate to azure-storage split library 
- Disable azure.storage logging
- Resolves #45
 2017-10-05 09:02:02 -07:00
Fred Park 9804036d06 Various fixes 
- Multiple --include and/or --exclude from the commandline
- --file-md5 option being ignored on download
- Incorrect MD5 computation for unaligned page blobs on upload
- stdin autoenable --rename
- Expand blobxfer.api surface
 2017-10-02 18:59:15 -07:00
Fred Park cda780707e Add version to config yaml 
- Add data movement library guide
 2017-09-12 13:42:17 -07:00
Fred Park 8c684419a6 Add upload to page blob support 2017-09-01 09:08:57 -07:00
Fred Park 5c3c093f88 Add synccopy rename support 
- Fix YAML config merge with commandline options with YAML options not present
- Fix synccopy invocation from commandline without YAML
 2017-08-30 20:09:04 -07:00
Fred Park a89c4b30a8 Add AppVeyor setup and builds 2017-08-30 14:16:24 -07:00
Fred Park e7af3469d5 Add deployment artifacts to travis build 
- Tagged releases to PyPI
- PyInstaller packaged tagged releases to GitHub
 2017-08-29 14:08:02 -07:00
Fred Park 2aaa16f8b5 Simplify timeout passing 
- Remove monkey-patched timeout to storage sdk
- Allow fine-grained timeout control (connect/read)
- Update dependencies
 2017-08-28 10:23:15 -07:00
Fred Park 12f7a0c654 Allow CLI option override of YAML conf 
- Fix various upload issues (zero byte and dupes)
- Check for max page blob size
- --strip-components defaults to 0
 2017-08-15 09:46:10 -07:00
Fred Park 9f97e1cd4f Add cross-mode synccopy support 
- Resolves #37
 2017-07-10 08:46:26 -07:00
Fred Park 66b3c68d7c Begin synccopy work 2017-06-08 20:15:53 -07:00
Fred Park e1d97fa3cb Tag for 1.0.0a3 release 
- Rename some options
- Make thread join more robust on Python2
 2017-06-02 10:16:12 -07:00
Fred Park bb9f68a3bb More documentation 
- Rename some options
- Catch KeyErrors and rethrow for required options to clarify
 2017-06-01 21:03:09 -07:00
Fred Park 0dca02ce83 Doc updates 
- Remove useconfig command and instead use --config option
 2017-06-01 14:40:03 -07:00
Fred Park 6267551cc7 Add base documentation 
- Update README
- Rev version to 1.0.0a2
 2017-06-01 13:56:22 -07:00
Fred Park e308ed8595 Fix existing tests 
- Fix various issues uncovered from UTs
 2017-05-31 21:01:37 -07:00
Fred Park 4e0ee1b21f Fix packaging issues 2017-05-30 15:53:18 -07:00
Fred Park 351eee537c useconfig upload/download support 
- Fix various yaml/dict config issues
- Allow md5 checks through vectored io stripes
 2017-05-30 13:03:40 -07:00
Fred Park 5ae05958ed Append blob support 2017-05-30 08:55:36 -07:00
Fred Park 69edbc9fde Client-side encryption upload support 
- Split transfer threads into disk/transfer
- Various fixes
- Update dependencies to latest
 2017-05-25 09:01:57 -07:00
Fred Park ccd8db28d3 Block uploading 
- Fix striped uploads
- Add --delete support to upload
- Block size auto-select support
- Metadata support including file attr and vectored io
- Disable container create on insufficient sas token privilege
 2017-05-22 20:26:52 -07:00
Fred Park 28b9bc9df5 Continue upload work 
- Add one-shot parameter
- Begin accommodating vectorized output
 2017-05-19 15:01:49 -07:00
Fred Park 52c504ad6c Fix filter check on download 
- Retry interval shortened
- Allow multiple include/exclude filters to be specified on the CLI
 2017-05-18 08:18:14 -07:00
Fred Park 85183bae71 Begin upload work 2017-05-16 15:06:47 -07:00
Fred Park fbdd1b1f12 More download features 
- Add delete support on download
- Add recursive support on download
- Add common requests session for connection pooling support with
  matched transfer thread count
 2017-04-10 14:49:54 -07:00
Fred Park a09bbfb655 Add file log, param preamble and progress bar 2017-04-07 14:38:57 -07:00
Fred Park bc36c5d08b Add cleanup actions 2017-02-28 13:27:20 -08:00
Fred Park fa72fc92fa Fix file download issues 
- Update dependencies to latest
 2017-02-28 09:55:28 -08:00