Azure
/
aztk
зеркало из https://github.com/Azure/aztk.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
146 коммитов 22 Ветки 17 Теги 9,2 MiB
Граф коммитов

146 Коммитов

Автор SHA1 Сообщение Дата
JS 3d753440c8 Merge pull request #5 from Azure/readme-update 
Update README.md
 2017-06-20 17:06:54 -04:00
JS 0e9da1cfba Update README.md 2017-06-20 01:03:11 -04:00
Pablo Selem 2f324fca9c Feature/low pri (#4) 
* initial working version

* update requirements.txt and commands to use low-pri

* cluster commands should use --id instead of --cluster-id

* make --size and --size-low-pri mutually exclusive

* update readme to include low-pri flag
 2017-06-19 21:58:56 -07:00
JS 5abeaceb66 Update README.md 2017-06-15 22:46:01 -07:00
JS ba08e0369f Merge pull request #3 from Azure/feature/syntax-cleanup 
syntax fixes
 2017-06-15 20:47:20 -07:00
jiata 6bf092a4fe streamlined command params 2017-06-15 01:11:03 -07:00
jiata 0677b3d25e syntax fixes 2017-06-15 00:05:54 -07:00
JS 4952e22142 Merge pull request #2 from Azure/feature/custom-script 
Feature/custom script
 2017-06-14 21:50:40 -07:00
jiata f5b835319f bug fix 2017-06-13 07:50:46 -07:00
jiata 6bc5842dad custom script for centos 2017-06-13 07:46:16 -07:00
JS 5e2f053987 refactor + user agent (#1) 2017-06-09 22:16:52 -07:00
JS Tan 49c6c85c11 Merged PR 8: Merge feature/submit-args to master 
added additional driver_<options> to spark submit
 2017-06-06 00:02:52 +00:00
paselem 85e7e3d752 Merged PR 7: Merge submit-app to master 2017-05-19 17:11:22 +00:00
paselem d2d3d8d70c Merged PR 6: Merge feature/refactor to master 2017-05-19 03:09:48 +00:00
Pablo f31da1883f Merge branch 'master' of ssh://jiata.visualstudio.com:22/_git/redbull 2017-05-12 15:23:40 -07:00
Pablo ca11926084 add user should be added for a year 2017-05-12 15:23:33 -07:00
paselem 6cd8c8ce62 Merged PR 5: Merge feature/batch2.0.0 to master 2017-05-12 20:25:47 +00:00
JS Tan 85c1d27ab0 Merged PR 4: Merge readme-update to master 2017-04-20 23:54:36 +00:00
JS Tan 7427f3bc0a Merged PR 3: removed jupyter + webui cmds 
removed jupyter + webui cmds
 2017-04-19 07:24:10 +00:00
jiata c62811086d merge conflict 2017-04-18 16:17:53 +00:00
jiata f4d68cc1b7 remove app-list cmd 2017-04-18 16:15:34 +00:00
jiata 9bbd3b80b0 remove jupyter/webui cmds, add as options in ssh 2017-04-18 16:13:02 +00:00
JS Tan 6ea20a76ba Merged PR 2: Merge ssh-update to master 
## ssh update:
enabled jupyter, attached user to the cluster lvl (as opposed to job level)

## features:
* new cli cmd: spark-cluster-create-user (create user is needed because we cannot automatically create a user on pool creation since we don't necessarily wait for cluster creation to finish)
* new cli cmd: spark-cluster-jupyter
* new cli cmd: spark-cluster-webui
* spark-cluster-ssh does not tunnel any ports by default
 2017-04-17 05:10:41 +00:00
jiata 4954d6997d attach user to the cluster 2017-04-16 23:47:18 +00:00
jiata 0de0450843 jupyter remove auth 2017-04-16 08:27:33 +00:00
jiata a73e8b5026 clean up 2017-04-16 03:48:58 +00:00
jiata aaa1cad029 mpi task in pool creation + regular task to submit 2017-04-16 03:34:41 +00:00
paselem 8b80fff5a3 Merged PR 1: force the runtim to use python3 
force the runtim to use python3
 2017-04-15 23:16:07 +00:00
Pablo Selem 46b0fc0304 fix bug when listing tasks and ignoring completed tasks 2017-04-15 14:54:58 -07:00
Pablo Selem 29733e72c2 fix typo 2017-04-15 14:36:57 -07:00
Pablo Selem 52f5e4355a force the runtim to use python3 2017-04-15 14:19:37 -07:00
Pablo Selem 6c8312a35a basic get a list cluster commands 2017-04-15 14:05:05 -07:00
jiata 8dd0e13577 typo in spark app ssh 2017-04-15 09:15:10 +00:00
jiata 336f08d408 list apps + jupyter + refactor 2017-04-14 06:04:12 +00:00
jiata 73b2b6d531 created spark-app-ssh 2017-04-13 07:34:19 +00:00
jiata e17d8776ff renamed submit-job to subimt-app 2017-04-13 06:59:39 +00:00
jiata febea4425e renamed scripts to new convention 2017-04-13 06:56:43 +00:00
jiata c9441f3ab3 convert spark app from job to task 2017-04-13 03:52:19 +00:00
jiata 50073cf2c9 readme.md 2017-04-13 01:47:44 +00:00
jiata 40e6ad233a configured bin dir for scripts + setup.py 2017-04-12 08:14:31 +00:00
jiata 04db504987 sparklib.py file created 2017-04-11 01:48:15 +00:00
jiata cb757138bf refactor code: remove resource files dependency, etc 2017-04-10 23:36:20 +00:00
jiata ef78b85d5c moved bash scripts to python code 2017-04-10 23:18:32 +00:00
jiata d239a11c32 az_spark_stop created 2017-04-07 23:07:21 +00:00
jiata 757efbcefb az_spark_start + az_spark_submit 2017-04-07 20:55:05 +00:00
jiata ace37b0fea first commit 2017-04-06 21:02:15 +00:00