Граф коммитов

4 Коммитов

Автор SHA1 Сообщение Дата
Jacob Freck 603a413d12
Feature: nvBLAS and OpenBLAS plugin (#539)
* add openblas plugin, update gpu docker images with netlib-lgpl

* update images and plugins

* add nvblas plugin

* revert gpu docker image change, add -Pnetlib-lgpl to base images

* change configuraitons to functions, add pugins to cluster.yaml
2018-05-15 17:47:41 -07:00
Jacob Freck 779bffb2da
Feature: refactor docker images (#510)
* add spark2.3.0 hadoop2.8.3 dockerfile

* start update to docker image

* add SPARK_DIST_CLASSPATH to bashrc, source .bashrc in docker run

* add maven install for jars

* docker image update and code fix

* add libthrift (still broken)

* start image refactor, build from source,

* add refactor to r base image

* finish refactor r image

* add storage jars and deps

* exclude netty to get rid of dependency conflict

* add miniconda image

* update 2.2.0 base, anaconda image

* remove unused cuda-8.0 image

* start pipenv implementation

* miniconda version arg

* update anaconda and miniconda image

* style

* pivot to virtualenv

* remove virtualenv from path when submitting apps

* flatten layers

* explicit calls to aztk python instead of activating virtualenv

* update base, miniconda, anaconda

* add compatibility version for base aztk images

* typo fix

* update pom

* update environment variable name

* update environment variables

* add anaconda images base & gpu

* update gpu and miniconda base images

* create venv in cluster create

* update base docker files, remove virtualenv

* fix path

* add exclusion to base images

* update r images

* delete python images (in favor of anaconda and miniconda)

* add miniconda gpu images

* update comment

* update aztk_version_compatibility to dokcer image version

* add a build script

* virutalenv->pipenv, add pipfile & pipfile.lock remove secretstorage

* aztk/staging->aztk/spark

* remove jars, add .null to keep directory

* update pipfile, update jupyter and jupyterlab

* update default images

* update base images to fix hdfs

* update build script with correct path

* add spark1.6.3 anaconda, miniconda, r base and gpu images

* update build script to include spark1.6.3

* mkdir out

* exclude commons lang and slf4j dependencies

* mkdir out

* no fail if dir exists

* update node_scripts

* update env var name

* update env var name

* fix the docker_repo docs

* master->0.7.0
2018-04-30 17:19:01 -07:00
Brian 89948de905
R GPU Dockerfiles (#341)
* Added dockerfiles for aztk r gpu

* Removed tensorflow/cntk cpu versions

* Enabled configure option for shared lib for python

* Removed temp paths

* Replaced python version with aztk version

* Cleaning up args

* Added variable definition for tensorflow, shorten lines
2018-01-22 16:36:36 -08:00
JS 65a56dd657
Feature/python container (#210)
* added python container, jupyter install script, vanilla container

* Update README.md

* Create README.md

* Create README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update jupyter.sh

* Update README.md

* Update README.md

* python

* readme update

* docker updates

* Update README.md

* Update 12-docker-image.md

* Update constants.py

* add image files for wiki

* update imageS

* .

* dockerfile typo

* dockerfiles

* Removed r

* readme

* update constants.py

* update readme

* readme updates

* readme updates
2017-11-09 00:43:32 -08:00