b0d3b9ba69
Data ingress support to Azure Blob Storage
2016-10-14 07:42:53 -07:00
d88475baa7
Add listjobs, listtasks, gettaskallfiles actions
2016-10-13 14:11:52 -07:00
4ce2f1d6c2
Add HPN-SSH support for Ubuntu
...
- Fix some issues with azure file setup and Windows
- Add some validation with container naming
- Clean up storage with delpool action
- Update .gitignore
2016-10-13 10:55:49 -07:00
8101a1407f
Add arbitrary file split support
2016-10-12 15:23:27 -07:00
1bc8e60fe2
Add include/exclude filter support for source path
2016-10-12 09:30:06 -07:00
261984020e
Add rsync transfer methods
...
- Refactor data transfer functions into single/multinode
- Expand docs for data ingress
2016-10-11 10:39:54 -07:00
ae1e3c19d9
Further refactor shipyard into components
...
- Add convoy path for travis
2016-10-09 21:01:11 -07:00
a4ec217f66
First stage in shipyard modularization
...
- Update configuration docs for new data ingress spec
2016-10-09 15:22:15 -07:00
edec6f0584
Add scp and multinode_scp ingress support
2016-10-09 11:51:02 -07:00
487223e8fa
Change pool config ssh_docker_tunnel to ssh
2016-10-06 11:03:10 -07:00
c9648c5cfd
Fix GlusterFS mount ownership/permissions
2016-10-06 09:29:53 -07:00
d83d39f64c
Add version
2016-10-05 09:39:02 -07:00
3590f7bf2d
Add Torch-CPU and Torch-GPU recipes
2016-10-03 20:02:29 -07:00
b7a5335874
Add preliminary SUSE SLES-HPC support for IB
2016-09-30 22:00:16 -07:00
88862ad57d
Fix GlusterFS setup on Ubuntu
...
- OpenFOAM default swap from v1606+ to 4.0
2016-09-29 19:15:38 -07:00
be36e2face
Add OpenFOAM-Infiniband-IntelMPI recipe
...
- Add real NAMD-Infiniband-IntelMPI image
- GlusterFS mountpoint now inside AZ_BATCH_NODE_SHARED_DIR
2016-09-28 21:03:36 -07:00
2ac48b846d
Add NAMD-GPU recipe
2016-09-26 11:17:50 -07:00
968a542fa8
Typos in README
2016-09-22 13:44:42 -07:00
c57abc8636
Add OpenFOAM-TCP-OpenMPI recipe
2016-09-22 13:39:18 -07:00
b28df08730
Reorder parsing of --configdir switch ( #2 )
...
* Reorder parsing of --configdir switch
* Set args.pool when only --configdir is supplied
2016-09-22 13:27:21 -07:00
a4e271d93f
Increase max stream file time to 30min
2016-09-21 13:05:46 -07:00
6aea6782ce
Update Azure File DVD to 0.5.1
...
- Update quickstart to accommodate choice
- Change STANDARD_F1 to STANDARD_D1_V2 for some recipes
2016-09-21 09:23:00 -07:00
a0b21e6995
Update quickstart guide with recipe config changes
2016-09-19 14:40:54 -07:00
a3d19ddb9d
Add Caffe-CPU, TensorFlow-CPU recipes
2016-09-19 14:26:57 -07:00
c2228de34e
Tidy up sample configurations for recipes
2016-09-19 13:13:27 -07:00
1188a1e885
Fix shipyard container detach/cleanup
...
- Add @FIRSTRUNNING task id for streamfile/gettaskfile
2016-09-18 17:01:42 -07:00
cd9a4e5bb5
Deterministic remote login settings output
2016-09-16 22:20:07 -07:00
d4d32fb699
Fix inter-node comm omitted keyerror
2016-09-16 17:54:49 -07:00
a2f99720f7
Add --configdir argument for convenience
2016-09-16 14:39:44 -07:00
ea702d3a43
Add quickstart doc
...
- Disable ssh tunnel creation without public key on Windows
2016-09-16 13:45:12 -07:00
9d12dab8be
Fix cascade start issue without private registry
...
- Add GlusterFS support for ubuntu and opensuse/sles
- Add --filespec and --verbose parameters
2016-09-16 11:46:59 -07:00
08204092be
Add CentOS GlusterFS support
...
- Update recipes
2016-09-15 12:47:43 -07:00
646cff6631
Add TensorFlow-Distributed recipe
...
- Fix SSH user expiry within 1 day
- Fix some README/dockerfile typos
2016-09-13 11:43:28 -07:00
d80ea9aeed
Fix json errors in sample recipe configs
2016-09-11 15:03:11 -07:00
f16e185520
Fix CNTK sample configs
2016-09-09 14:30:28 -07:00
7254e217ec
Add README note for install doc
2016-09-09 14:06:49 -07:00
af98bdfb57
Add sample configs for all existing recipes
...
- Fix temp file creation for cross-platform
2016-09-09 13:49:59 -07:00
e8d5e7a8a3
Automatically detect nvidia driver version
...
- Fix azure-storage dependencies for non-shipyard docker image setup
- Add no-install-recommends to apt-gets in node prep
2016-09-08 21:06:21 -07:00
0338fc612f
Add gettaskfile/getnodefile actions
...
- Add .gitattributes to designate text files eol as LF
- Update configuration doc with required/optional tags
2016-09-08 20:15:11 -07:00
c2a51abfa6
Fix some typos
...
- Add missing gpu pool config block for GPU recipes
2016-09-08 14:26:35 -07:00
b4e6e90f1d
Add FFmpeg GPU recipe
...
- Fix NV-series provisioning
- Fix up various READMEs
- Add maintained by tags in Dockerfiles
- Add missing config flag in jobs json
- Fix non-Docker shipyard azure-storage req
2016-09-08 11:52:21 -07:00
028768a61a
Add CNTK recipes
...
- Add TCP optimization
- Fix job autocompletion
- Update azure-storage requirement to 0.33.0
2016-09-07 21:40:57 -07:00
12cf14b363
Add auto multi-instance task cleanup
...
- Add Caffe-GPU recipe
- Add prompt for destructive actions in shipyard.py
- Add option to automatically assume yes on prompts
2016-09-06 13:25:30 -07:00
eea254aeb9
Add job auto-completion for multi-instance tasks
2016-09-06 10:32:42 -07:00
e52e30cf0c
Fix docker images issue with non-p2p transfer
...
- Fix node prep cascade timing issues
- Update various READMEs
2016-09-02 15:02:07 -07:00
f9dac5bd93
Add GPU documentation
...
- Fix node prep issues with GPU
- Correct node prep finished file location
- Add TensorFlow-GPU recipe
2016-09-02 09:39:35 -07:00
ada1feb00a
Add GPU support
2016-09-02 01:42:54 -07:00
c698197e34
Add NAMD-Infiniband recipe
2016-09-01 21:23:37 -07:00
d412772973
Update NAMD-TCP README
2016-09-01 14:55:56 -07:00
04292f2f26
Add NAMD-TCP recipe
2016-09-01 14:49:57 -07:00
Fred Park
jasper-schneider