Граф коммитов

12 Коммитов

Автор SHA1 Сообщение Дата
Pablo Selem b56c551189
always upgrade jupyter to the latest version on install (#336) 2018-01-18 19:46:37 -08:00
Jacob Freck 2fa4e69d67
Bug: fix logic for worker custom scripts (#295) 2017-12-22 13:35:52 -05:00
JS 89f0e54182
jupyter azfiles bug + gpu sample (#291)
* gpu sample + jupyter mnt point

* rename jupyter gpu sample
2017-12-19 11:16:12 -08:00
Brian 0efadefb98
Feature: Sparklyr (#243)
* Added rstudio server script

* Added rstudio server port to aztk sdk

* Added R dockerfiles

* Added new line on dockerfiles

* Pointing dockerfiles to new aztk-base

* allow any user or application in the server to write to the history server log directory
2017-12-08 11:17:27 -08:00
Pablo Selem 62f3995c2c
remove redundant setting in non-master code section and use non-os drive to mount HDFS (#242) 2017-11-30 12:17:50 -08:00
Jacob Freck 60cae3b8dd
Feature: HDFS plugin (#215)
* hdfs plugin initial

* fix passwordless ssh key, allow raw ip for datanodes

* remoe debug statement

* description of forwarded ports

* add prcryptodome to requirements.txt

* fix file copy bug

* add namenode ui to ssh command, add docs
2017-11-22 14:51:11 -08:00
JS 65a56dd657
Feature/python container (#210)
* added python container, jupyter install script, vanilla container

* Update README.md

* Create README.md

* Create README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update jupyter.sh

* Update README.md

* Update README.md

* python

* readme update

* docker updates

* Update README.md

* Update 12-docker-image.md

* Update constants.py

* add image files for wiki

* update imageS

* .

* dockerfile typo

* dockerfiles

* Removed r

* readme

* update constants.py

* update readme

* readme updates

* readme updates
2017-11-09 00:43:32 -08:00
Jacob Freck 37c5d873a0 Feature: Support for multiple custom scripts and master only scrips (#93)
* added IS_MASTER environment variable, moved custom script execution to python

* allow for custom_scripts to check if executing on spark master

* allow for multiple custom scripts

* updated docs, fixed overwrite bug, more precise typing

* added support for script ordering, consolidated file uploading

* rename custom script on upload to prevent conflicts

* removed unnecessary import

* added environment variable IS_MASTER back

* white space

* updated docs

* updated docs

* fix pylint errors

* undo previous commit error

* clearer docs

* removed cli custom script functionality, fixed no custom scirpts bug

* fixed pylint errors

* changed location to runOn, removed unused parameters, add error checking

* removed unused parameter

* added information about storage account

* remove unused functions to upload scripts

* chagned dtde to aztk
2017-10-02 13:20:11 -07:00
JS cf6ceff6f7 removed deprecated wasb-dsvm custom script & removed depcredated wasb docker image (#49) 2017-08-23 11:29:27 -04:00
JS d94c43ed82 Feature: docker
Feature: docker
2017-08-17 09:21:00 -07:00
jiata 818bb041c5 updates to custom wasb template 2017-07-11 18:36:00 -04:00
jiata b09f4fe172 custom-script for wasb connection 2017-07-06 18:15:58 -07:00