Граф коммитов

14 Коммитов

Автор SHA1 Сообщение Дата
JS Tan 6ea20a76ba Merged PR 2: Merge ssh-update to master
## ssh update:
enabled jupyter, attached user to the cluster lvl (as opposed to job level)

## features:
* new cli cmd: spark-cluster-create-user (create user is needed because we cannot automatically create a user on pool creation since we don't necessarily wait for cluster creation to finish)
* new cli cmd: spark-cluster-jupyter
* new cli cmd: spark-cluster-webui
* spark-cluster-ssh does not tunnel any ports by default
2017-04-17 05:10:41 +00:00
jiata aaa1cad029 mpi task in pool creation + regular task to submit 2017-04-16 03:34:41 +00:00
paselem 8b80fff5a3 Merged PR 1: force the runtim to use python3
force the runtim to use python3
2017-04-15 23:16:07 +00:00
Pablo Selem 46b0fc0304 fix bug when listing tasks and ignoring completed tasks 2017-04-15 14:54:58 -07:00
Pablo Selem 29733e72c2 fix typo 2017-04-15 14:36:57 -07:00
Pablo Selem 52f5e4355a force the runtim to use python3 2017-04-15 14:19:37 -07:00
Pablo Selem 6c8312a35a basic get a list cluster commands 2017-04-15 14:05:05 -07:00
jiata 8dd0e13577 typo in spark app ssh 2017-04-15 09:15:10 +00:00
jiata 336f08d408 list apps + jupyter + refactor 2017-04-14 06:04:12 +00:00
jiata 73b2b6d531 created spark-app-ssh 2017-04-13 07:34:19 +00:00
jiata e17d8776ff renamed submit-job to subimt-app 2017-04-13 06:59:39 +00:00
jiata febea4425e renamed scripts to new convention 2017-04-13 06:56:43 +00:00
jiata c9441f3ab3 convert spark app from job to task 2017-04-13 03:52:19 +00:00
jiata 04db504987 sparklib.py file created 2017-04-11 01:48:15 +00:00