Граф коммитов

56 Коммитов

Автор SHA1 Сообщение Дата
Timothee Guerin 5149eacb22 Fix showing password in plain text (#52) 2017-08-22 09:54:18 -07:00
JS 577ff296b5 Feature/wasb (#47)
* update configuration.cfg to secrets.cfg

* fix node count pretty print

* add more unit tests

* configure pytest to only run tests from the 'tests' directory

* add missing space

* remove static call to loading secrets file

* initial commit for automatic wasb support

* wasb native support

* fix for wasb

* bug fix in azure_api

* clean up setup_wasb

* README for wasb

* README updates for wasb

* configure wasb creds in start task environment variables

* add missing merged files

* revert back to working state

* added storage account suffix

* removed zip to secrets
2017-08-22 11:57:45 -04:00
Pablo Selem 4822172b6a Feature/secrets.cfg (#43)
* update configuration.cfg to secrets.cfg

* fix node count pretty print

* add more unit tests

* configure pytest to only run tests from the 'tests' directory

* add missing space

* remove static call to loading secrets file
2017-08-21 12:36:45 -07:00
JS 213f9226b0 removed dsvm code (#48) 2017-08-21 02:08:40 -04:00
Timothee Guerin b21cae0cc2 Fix: windows path given in the command line (#41)
* Fix windows path

* Upload custom-script

* Custom script works with windows path

* Fix util

* 24 Hours
2017-08-19 13:47:44 -07:00
Timothee Guerin d552624705 Feature: read/tail spark submit logs (#40)
* Tail log command

* tail log is working

* Cleanup code

* fix cr

* Fix cr

* Submit

* Comment

* fix tail

* Sleep
2017-08-18 12:35:04 -07:00
JS d94c43ed82 Feature: docker
Feature: docker
2017-08-17 09:21:00 -07:00
Timothee Guerin ca1517acfc Feature: logging instead of prints and more sdk like (#34)
* Getting started on logging

* new logger

* Cluster list and get api like

* SSH sdk like

* Job submit log

* util

* Cluster create log

* fix cr
2017-08-02 08:43:26 -07:00
Timothee Guerin aea5e36690 Feature: Setup user with ssh public key instead of password (#32)
* Login with ssh public key

* Update to have ssh-key command

* Fix readme

* Fix Cr

* remove unused files

* Change head to master
2017-07-27 10:45:31 -07:00
Timothee Guerin 9236bc883b Fix software circular (#35) 2017-07-24 13:02:46 -07:00
Timothee Guerin 4fe6c66190 Only list spark clusters (#31)
* Only list spark clusters

* reformat

* reformat

* reformat

* fix cr

* Spark use enum

* Version

* Fix
2017-07-24 09:17:42 -07:00
Timothee Guerin 17d09ee659 Force convert to bool (#33) 2017-07-21 08:52:28 -07:00
Timothee Guerin 9e45f78600 Simplify the commands to all be under azb and make windows experience better (#29)
* Added some commands

* More

* Missing file

* Refactor

* update

* Constant exe name

* List and get command

* Added user

* update cluster create, and job submit

* Remove legacy scripts

* Fix cr comments

* remove leftover print
2017-07-19 10:48:23 -07:00
Timothee Guerin d92df3c0be Initial structure for test framework and CI (#30)
* Command builder tests

* Setup travis

* Update to travis

* Update to travis

* Update to travis

* Error only

* builder to array
2017-07-18 14:07:11 -07:00
Timothee Guerin 4a1d9adf25 Revert "Revert "Feature: Setup the cluster with the start task." (#26)" (#28)
This reverts commit dc1618ae94.
2017-07-14 12:00:47 -04:00
JS dc1618ae94 Revert "Feature: Setup the cluster with the start task." (#26) 2017-07-13 20:57:04 -07:00
Timothee Guerin 8f5757cea3 Fix broken code after CR 2017-07-13 13:56:52 -07:00
Timothee Guerin 27b14e6adc Finish reviewing 2017-07-13 13:23:19 -07:00
Timothee Guerin aeecacc194 Some cr fixes 2017-07-13 12:44:10 -07:00
Timothee Guerin 9dc24bd7f6 Pep8 config file 2017-07-12 13:23:16 -07:00
Timothee Guerin 583eefec79 Command builder 2017-07-12 13:10:13 -07:00
Timothee Guerin f334de60c7 Cleanup cluster lib 2017-07-12 12:33:18 -07:00
Timothee Guerin 1ee0225f67 Merge master 2017-07-12 12:25:29 -07:00
Timothee Guerin 96f94e7714 job submit is working 2017-07-12 11:33:42 -07:00
Timothee Guerin 4358042e8c Remove blob client 2017-07-12 10:38:53 -07:00
Timothee Guerin dc8f397494 Fix juypiter? 2017-07-11 14:52:40 -07:00
Timothee Guerin e9c7f74e79 more 2017-07-11 14:25:17 -07:00
Timothee Guerin d60f647540 more fixes 2017-07-10 17:03:04 -07:00
Timothee Guerin f9e7db4f41 Fix 2017-07-10 16:34:54 -07:00
Timothee Guerin a4026fa702 Setup spark from the start task 2017-07-10 16:04:17 -07:00
Timothee Guerin 0385df991f Working 2017-07-10 14:20:50 -07:00
Timothee Guerin 58201d1b0d Refactor 2017-07-10 12:33:49 -07:00
Timothee Guerin d59acb69f7 Fix running on windows 2017-07-10 09:54:42 -07:00
Timothee Guerin 6ebf205e2e Fix build error 2017-07-10 09:23:57 -07:00
Timothee Guerin e88a1e37ab more 2017-07-10 09:03:34 -07:00
Timothee Guerin ca1fbab024 picks master from the create 2017-07-07 14:53:08 -07:00
Timothee Guerin b7871bd8d7 Merge master 2017-07-07 11:23:46 -07:00
Timothee Guerin 54086f76fe Merge master 2017-07-07 11:23:27 -07:00
Timothee Guerin bd4e3d18ed Merge pull request #19 from Azure/feature/sdk-helper
Refactor clients and config into a shared util
2017-07-07 11:21:24 -07:00
Timothee Guerin f829ad1c65 review comments 2017-07-07 10:35:39 -07:00
Amol Thacker f58f1b0790 Propagate Spark App Name (#21) 2017-07-06 20:28:13 -07:00
Timothee Guerin 73e5dc4b25 format 2017-07-06 14:27:57 -07:00
Timothee Guerin f1dfd337c1 Finish refactoring 2017-07-06 14:25:44 -07:00
Timothee Guerin c8768cb876 Missing files 2017-07-06 13:58:45 -07:00
Timothee Guerin 6d73ede1c0 Created shared config and azure api 2017-07-06 13:52:55 -07:00
Timothee Guerin f127c15ac9 Wip 2017-07-06 13:30:45 -07:00
Pablo Selem f2932b4287 do not show node states when pool is deleting (#13) 2017-07-06 08:25:22 -07:00
jiata 4eadb9612e refactor 2017-07-05 11:01:54 -07:00
jiata e88d4e3238 typo on print line 2017-06-26 18:37:51 -04:00
jiata 3aa68eb4c4 handle error when create user when cluster is not rdy + create user with cluster 2017-06-26 18:12:11 -04:00