Граф коммитов

26 Коммитов

Автор SHA1 Сообщение Дата
Jacob Freck 43dd8e57f1 Bug: Move commands under app to cluster (#82)
* moved azb spark app commands to azb spark cluster

* fixed docs to reflect new cli structure

* renamed commands for clarity
2017-09-19 08:29:23 -07:00
JS 03baff6a26 Feature: custom docker images (#68)
* symlink /home/spark-version to /home/spark-current

* working checkpoint

* working checkpoint

* docker readme update

* removed deprecated dockerfile

* docker cli + docs for docker

* docs update

* docs update

* remove unneeded comments

* docker version and docs updates, misc fixes
2017-09-15 20:57:16 -07:00
Amol Thacker 551d8a1a45 Fix documentation links and typos (#56) 2017-09-11 21:34:49 -07:00
JS 636cd2e1d6 Update README.md (#54)
* Update README.md

update readme for a more descriptive introduction

* upper case S for spark

* fix
2017-09-11 13:41:33 -07:00
JS 5edd120c52 fix broken links in docs/README (#55)
* fix broken links in docs/README

* typo
2017-09-11 13:17:46 -07:00
Pablo Selem 219cf412c0 update docs with new name 'Thunderbolt' (#53)
* update docs with new name 'Thunderbolt'

* update instructions around pip for clarity
2017-08-23 11:37:13 -07:00
JS fdd87c0a99 Feature/samples (#50)
* added snapshot of examples from spark-2.2.0

* jupyter samples

* fixed bug

* rename 'pyspark' to 'jupyter'

* curated samples

* Readme update for samples
2017-08-22 18:36:25 -04:00
Pablo Selem ae26453ba5 Feature/docs (#51)
* update configuration.cfg to secrets.cfg

* fix node count pretty print

* add more unit tests

* configure pytest to only run tests from the 'tests' directory

* add missing space

* remove static call to loading secrets file

* initial docs layout

* rename files and add images to getting started

* fix typos

* Add next steps to clusters docs

* Add custom scripts doc

* Initial text for spark submit

* fix merge conflict

* finish spark submit docs

* cloud storage docs

* fix typo in storage docs

* refactor some docs

* pr feedback

* add link to Getting Started in creating account details in main readme
2017-08-22 09:13:10 -07:00
JS 577ff296b5 Feature/wasb (#47)
* update configuration.cfg to secrets.cfg

* fix node count pretty print

* add more unit tests

* configure pytest to only run tests from the 'tests' directory

* add missing space

* remove static call to loading secrets file

* initial commit for automatic wasb support

* wasb native support

* fix for wasb

* bug fix in azure_api

* clean up setup_wasb

* README for wasb

* README updates for wasb

* configure wasb creds in start task environment variables

* add missing merged files

* revert back to working state

* added storage account suffix

* removed zip to secrets
2017-08-22 11:57:45 -04:00
Pablo Selem 4822172b6a Feature/secrets.cfg (#43)
* update configuration.cfg to secrets.cfg

* fix node count pretty print

* add more unit tests

* configure pytest to only run tests from the 'tests' directory

* add missing space

* remove static call to loading secrets file
2017-08-21 12:36:45 -07:00
Timothee Guerin d552624705 Feature: read/tail spark submit logs (#40)
* Tail log command

* tail log is working

* Cleanup code

* fix cr

* Fix cr

* Submit

* Comment

* fix tail

* Sleep
2017-08-18 12:35:04 -07:00
JS d94c43ed82 Feature: docker
Feature: docker
2017-08-17 09:21:00 -07:00
JS fbfdaf489d remove deprecated instructions (#39)
* remove deprecated instructions

* Update README.md
2017-08-10 11:00:43 -07:00
Timothee Guerin aea5e36690 Feature: Setup user with ssh public key instead of password (#32)
* Login with ssh public key

* Update to have ssh-key command

* Fix readme

* Fix Cr

* remove unused files

* Change head to master
2017-07-27 10:45:31 -07:00
Timothee Guerin 9e45f78600 Simplify the commands to all be under azb and make windows experience better (#29)
* Added some commands

* More

* Missing file

* Refactor

* update

* Constant exe name

* List and get command

* Added user

* update cluster create, and job submit

* Remove legacy scripts

* Fix cr comments

* remove leftover print
2017-07-19 10:48:23 -07:00
JS 0b99e86307 added naming condition to spark jobs & clusters (#14)
* added naming condition to spark jobs

* Update README.md
2017-07-06 11:33:09 -07:00
JS b98ae85726 Merge pull request #7 from Azure/feature/create-user-with-cluster
create user option on cluster create
2017-07-05 10:04:36 -07:00
Amol Thacker 1fe33c3d55 Corrections to README (#8) 2017-07-04 21:27:46 -07:00
JS 61dc9d32b2 Update README.md 2017-06-26 18:49:40 -04:00
JS 0e9da1cfba Update README.md 2017-06-20 01:03:11 -04:00
Pablo Selem 2f324fca9c Feature/low pri (#4)
* initial working version

* update requirements.txt and commands to use low-pri

* cluster commands should use --id instead of --cluster-id

* make --size and --size-low-pri mutually exclusive

* update readme to include low-pri flag
2017-06-19 21:58:56 -07:00
JS 5abeaceb66 Update README.md 2017-06-15 22:46:01 -07:00
paselem 6cd8c8ce62 Merged PR 5: Merge feature/batch2.0.0 to master 2017-05-12 20:25:47 +00:00
JS Tan 85c1d27ab0 Merged PR 4: Merge readme-update to master 2017-04-20 23:54:36 +00:00
jiata 50073cf2c9 readme.md 2017-04-13 01:47:44 +00:00
jiata ace37b0fea first commit 2017-04-06 21:02:15 +00:00