130 строки
5.2 KiB
Markdown
130 строки
5.2 KiB
Markdown
# Change Log
|
|
|
|
## [Unreleased]
|
|
### Added
|
|
- Comprehensive data movement support. Please see the configuration doc for
|
|
more information.
|
|
- Ingress from local machine with `files` in global configuration
|
|
- To GlusterFS shared volume
|
|
- To Azure Blob Storage
|
|
- To Azure File Storage
|
|
- Ingress from Azure Blob or File Storage with `input_data` in pool and jobs
|
|
configuration
|
|
- Pool-level: to compute nodes
|
|
- Job-level: to compute nodes prior to running the specified job
|
|
- Task-level: to compute nodes prior to running a task of a job
|
|
- Egress to local machine as actions
|
|
- Single file from compute node
|
|
- Entire task-level directories from compute node
|
|
- Egress to Azure Blob of File Storage with `output_data` in jobs
|
|
configuration
|
|
- Task-level: to Azure Blob or File Storage on succesful completion of a
|
|
task
|
|
- Experimental support for OpenSSH with HPN patches on Ubuntu
|
|
- Additional actions: `ingressdata`, `gettaskallfiles`, `listjobs`,
|
|
`listtasks`. Please see the usage doc for more information.
|
|
- Torch-CPU as an option in quickstart guide
|
|
|
|
### Changed
|
|
- **Breaking Change:** `ssh_docker_tunnel` in the `pool_specification` has
|
|
been replaced by the `ssh` property. `generate_tunnel_script` has been renamed
|
|
to `generate_docker_tunnel_script`. Please see the configuration doc for
|
|
more information.
|
|
- `streamfile` no longer has an arbitrary max streaming time; the action will
|
|
stream the file indefinitely until the task completes
|
|
- Ensure `storage_entity_prefix` is valid and validate container name lengths
|
|
- `delpool` action now cleans up and deletes some storage containers
|
|
immediately afterwards (with confirmation prompts)
|
|
- Modularized code base
|
|
|
|
### Fixed
|
|
- GlusterFS mount ownership/permissions fixed such that SSH users can
|
|
read/write
|
|
- Azure File shared volume setup when invoked from Windows
|
|
|
|
## [1.1.0] - 2016-10-05
|
|
### Added
|
|
- Transparent Infiniband assist for SUSE SLES-HPC 12-SP1 image
|
|
- Add version for shipyard.py script
|
|
- NAMD-GPU, OpenFOAM-Infiniband-IntelMPI, Torch-CPU, Torch-GPU recipes
|
|
|
|
### Changed
|
|
- GlusterFS mountpoint is now within `$AZ_BATCH_NODE_SHARED_DIR` so files can
|
|
be viewed/downloaded with Batch APIs
|
|
- NAMD-Infiniband-IntelMPI recipe now contains a real Docker image link
|
|
|
|
### Fixed
|
|
- GlusterFS not properly starting on Ubuntu
|
|
|
|
## [1.0.0] - 2016-09-22
|
|
### Added
|
|
- Automated GlusterFS support
|
|
- Added `configdir` argument for convenience in loading configuration files,
|
|
please see the usage documentation for more details
|
|
- Ability to retrieve files from live compute nodes in addition to streaming
|
|
- Added `filespec` argument for non-interactive `streamfile` and `gettaskfile`
|
|
actions
|
|
- Added .gitattributes to designate Unix line-endings for text files
|
|
- Sample configuration files for each recipe
|
|
- Caffe-CPU, OpenFOAM-TCP-OpenMPI, TensorFlow-CPU, TensorFlow-Distributed
|
|
recipes
|
|
|
|
### Changed
|
|
- Updated configuration docs to detail which properties are required vs. those
|
|
that are optional
|
|
- SSH tunnel user is now added with a default expiry time of 7 days which can
|
|
be modified through the pool configuration file
|
|
- Configuration is not output to console by default, `-v` flag added for
|
|
verbose output
|
|
- Determinstic remote login settings output (node, ip, port) that can be
|
|
easily parsed
|
|
- Update Azurefile Docker Volume Driver plugin to 0.5.1
|
|
|
|
### Fixed
|
|
- Cascade (container-only) start issue with no private registry
|
|
- Non-shipyard docker image node prep with new azure-storage package
|
|
- Inter-node communication not specified key error on addpool
|
|
- Cross-platform fixes:
|
|
- Temp file creation used for environment variables
|
|
- SSH tunnel creation disabled on Windows if public key is not supplied
|
|
- Batch Shipyard Docker container not getting cleaned up if peer-to-peer is
|
|
disabled
|
|
|
|
### Removed
|
|
- `gpu`:`nvidia_driver`:`version` property removed from pool configuration
|
|
and is no longer required as the version is now automatically detected
|
|
|
|
## [0.2.0] - 2016-09-08
|
|
### Added
|
|
- Transparent GPU support for Azure N-Series VMs
|
|
- New recipes added: Caffe-GPU, CNTK-CPU-OpenMPI, CNTK-GPU-OpenMPI,
|
|
FFmpeg-GPU, NAMD-Infiniband-IntelMPI, NAMD-TCP, TensorFlow-GPU
|
|
|
|
### Changed
|
|
- Multi-instance tasks now automatically complete their job by default. This
|
|
removes the need to run the `cleanmijobs` action in the shipyard tool.
|
|
Please refer to the
|
|
[multi-instance documentation](docs/80-batch-shipyard-multi-instance-tasks.md)
|
|
for more information and limitations.
|
|
- Dumb back-off policy for DHT router convergence
|
|
- Optimzed Docker image storage location for Azure VMs
|
|
- Prompts added for destructive operations in the shipyard tool
|
|
|
|
### Fixed
|
|
- Incorrect file location of node prep finished
|
|
- Blocking wait for global resource on pool can now be disabled
|
|
- Incorrect process call to query for docker image size when peer-to-peer
|
|
transfer is disabled
|
|
- Use azure-storage 0.33.0 to fix Edm.Int64 overflow issue
|
|
|
|
## [0.1.0] - 2016-09-01
|
|
#### Added
|
|
- Initial release
|
|
|
|
[Unreleased]: https://github.com/Azure/batch-shipyard/compare/1.1.0...HEAD
|
|
[1.1.0]: https://github.com/Azure/batch-shipyard/compare/1.0.0...1.1.0
|
|
[1.0.0]: https://github.com/Azure/batch-shipyard/compare/0.2.0...1.0.0
|
|
[0.2.0]: https://github.com/Azure/batch-shipyard/compare/0.1.0...0.2.0
|
|
[0.1.0]: https://github.com/Azure/batch-shipyard/compare/ab1fa4d...0.1.0
|
|
|