Fred Park
c2a51abfa6
Fix some typos
...
- Add missing gpu pool config block for GPU recipes
2016-09-08 14:26:35 -07:00
Fred Park
b4e6e90f1d
Add FFmpeg GPU recipe
...
- Fix NV-series provisioning
- Fix up various READMEs
- Add maintained by tags in Dockerfiles
- Add missing config flag in jobs json
- Fix non-Docker shipyard azure-storage req
2016-09-08 11:52:21 -07:00
Fred Park
028768a61a
Add CNTK recipes
...
- Add TCP optimization
- Fix job autocompletion
- Update azure-storage requirement to 0.33.0
2016-09-07 21:40:57 -07:00
Fred Park
12cf14b363
Add auto multi-instance task cleanup
...
- Add Caffe-GPU recipe
- Add prompt for destructive actions in shipyard.py
- Add option to automatically assume yes on prompts
2016-09-06 13:25:30 -07:00
Fred Park
eea254aeb9
Add job auto-completion for multi-instance tasks
2016-09-06 10:32:42 -07:00
Fred Park
e52e30cf0c
Fix docker images issue with non-p2p transfer
...
- Fix node prep cascade timing issues
- Update various READMEs
2016-09-02 15:02:07 -07:00
Fred Park
f9dac5bd93
Add GPU documentation
...
- Fix node prep issues with GPU
- Correct node prep finished file location
- Add TensorFlow-GPU recipe
2016-09-02 09:39:35 -07:00
Fred Park
ada1feb00a
Add GPU support
2016-09-02 01:42:54 -07:00
Fred Park
c698197e34
Add NAMD-Infiniband recipe
2016-09-01 21:23:37 -07:00
Fred Park
d412772973
Update NAMD-TCP README
2016-09-01 14:55:56 -07:00
Fred Park
04292f2f26
Add NAMD-TCP recipe
2016-09-01 14:49:57 -07:00
Fred Park
6a414ca829
Add multi-instance task doc
...
- Ensure --net=host for multi-instance task coordination command
2016-09-01 14:00:14 -07:00
Fred Park
3f5e1782fa
Add CentOS-HPC restriction
2016-09-01 10:02:55 -07:00
Fred Park
cc0a3401ff
Update Changelog for tag
2016-09-01 09:40:24 -07:00
Fred Park
2000cc7b32
Add installation doc
2016-09-01 09:36:26 -07:00
Fred Park
3d9b16befe
Update docs README
2016-09-01 09:26:30 -07:00
Fred Park
9a13826ad2
Move limitations to docs
2016-09-01 09:25:15 -07:00
Fred Park
50a45c77df
Add README to base docs
...
- Fix dir typo
2016-09-01 09:13:29 -07:00
Fred Park
53c6e5a673
Add del mi cleanup job and stream file actions
...
- Add base recipes readme
2016-09-01 09:07:05 -07:00
Fred Park
a666d7d9f4
Add explicit inter node comm property for pool
...
- Allow inter node comm to work independently of p2p transfers
2016-08-31 22:20:18 -07:00
Fred Park
a5387fc904
Update README
2016-08-31 21:43:03 -07:00
Fred Park
457ca75e6f
Add GitHub link to README
2016-08-31 20:57:10 -07:00
Fred Park
75a27746a4
Complete guide/docs
...
- Add pool_current_dedicated support for multi-instance tasks
2016-08-31 20:44:44 -07:00
Fred Park
7f49641074
First part of the guide/docs
...
- Modify placement of some configuration settings
2016-08-31 15:35:33 -07:00
Fred Park
d53436b6ca
Prep for ghpages
...
- Update for pathlib2
- Add bare start point for docs
2016-08-31 11:16:43 -07:00
Fred Park
5014276f1f
Update README
...
- Remove layer from Dockerfile
2016-08-31 10:44:38 -07:00
Fred Park
dad22994bc
Rename sample configs as config templates
...
- Add Changelog file
2016-08-31 09:38:33 -07:00
Fred Park
f551e07da3
Finalize repo for batch shipyard docker image
2016-08-31 09:19:22 -07:00
Fred Park
e813bbeae7
Enforce VM size check for infiniband tasks
2016-08-31 09:07:33 -07:00
Fred Park
c5368207cd
Add more features to pool/tasks
...
- Add infiniband support
- Add max tasks per node
- Properly handle multi-instance tasks with docker run <-> exec
- Add docker multi-instance cleanup helper
2016-08-31 02:21:50 -07:00
Fred Park
351800344d
Add multi-instance support for tasks
2016-08-30 15:31:23 -07:00
Fred Park
0d48919afa
Azure file dvd support for all supported hosts
...
- Add default init scripts to avoid surprise config changes
- Add block flag to pool for image ready
2016-08-29 12:12:50 -07:00
Fred Park
35fb3f588b
Add support for more host OSes
...
- Ubuntu 14.04, Debian 8, CentOS 7.x, RHEL 7.x, OpenSUSE 13.2/42.1,
SLES 12/12-sp1
- Improve graphing
- Prevent metadata clear on existing pool
2016-08-28 19:43:53 -07:00
Fred Park
459391707c
Add sample config json files
2016-08-27 17:48:49 -07:00
Fred Park
4cb1f79c07
Update docstrings and typing information
...
- Add MIT license text to all py files
2016-08-27 17:42:36 -07:00
Fred Park
703e9e7fd1
Reorganize project
2016-08-27 11:35:32 -07:00
Fred Park
0da28d7e0a
Add stderr redirect to logger
...
- Refactor some common functions
- Rename services table to images
2016-08-27 11:30:55 -07:00
Fred Park
e9ce32e69f
Fix shipyard container issues
...
- Downgrade libtorrent to 1.0.9 due to DHT issues
- Add task dependency support
- Add CONTRIBUTING.md, requirements.txt and .travis.yml
2016-08-26 23:09:10 -07:00
Fred Park
aa4add34d5
Support shipyard as docker container
...
- Add Dockerfile
- Add command file for container
2016-08-26 15:34:30 -07:00
Fred Park
bc30023330
Scale fixes
...
- Add timing recording toggle
2016-08-25 13:07:57 -07:00
Fred Park
1fbad08ee5
Add ssh docker user/tunnel generation
...
- Compact some vars
2016-08-24 20:32:53 -07:00
Fred Park
359dfdad85
Use proper logging in shipyard and cascade
...
- Fix shipyard.py for Python2.7 compatibility
- Allow option to reboot nodes that go into start task failed state
- Correctly pin gr-done events
- Reduce chattiness of torrent info dumps
2016-08-24 15:36:23 -07:00
Fred Park
39dd9bf5c6
Fix storage env var issues
...
- Add support for additional resource files on docker jobs
2016-08-24 09:09:37 -07:00
Fred Park
a99bee7100
Pass through more storage endpoint info
...
- Compact env vars
- Azure file endpoint
- Docker private registry realm
2016-08-23 15:32:49 -07:00
Fred Park
ee242c21d6
Split configuration files further
...
- Allow docker public hub passthrough in private context
- Pass config through in more places in shipyard
2016-08-23 14:50:17 -07:00
Fred Park
6fb2d7e221
Add azurefile docker volume driver support
...
- Add auto packaging of registry:2 docker image if not present
2016-08-19 15:13:33 -07:00
Fred Park
8182a73847
Add docker job/task support
...
- Fix cascade compression bug
- Add full job and task spec support
2016-08-19 11:28:29 -07:00
Fred Park
f1a666db41
Add redirect for torrents to blob
...
- Always install private registry to every node
- Fix uncompressed torrenting
2016-08-18 15:17:04 -07:00
Fred Park
21dedebb6e
Reproducible compressed tarballs for torrents
...
- Fix image size bug
- Fix concurrent download message queue bug
2016-08-17 15:59:41 -07:00
Fred Park
e4f58c6ff4
Allow non-p2p and no dpr modes
...
- Add jp block script
- Fix some data graph bugs
- Begin fixing non-reproducible .tar.gz docker save images
2016-08-17 08:30:53 -07:00