76f9afebc5
remove dev builds
2018-08-07 16:58:38 -07:00
6be599dac1
reenable dev builds
2018-08-07 16:31:01 -07:00
9e4f41af94
fix diagnostic tool return value
2018-08-07 15:03:58 -07:00
a3a220e44d
up the number of parallel processes
2018-08-07 14:33:31 -07:00
3eb54d0f58
whitespace
2018-08-07 12:53:52 -07:00
f5e8e172da
remove dev trigger
2018-08-07 12:52:25 -07:00
8f297fbbfd
separate unit and integration tests in vsts
2018-08-07 12:33:52 -07:00
531e0fbdf5
remove debug statements
2018-08-07 12:31:51 -07:00
5db241ccd6
make vsts use python 3.6
2018-08-07 12:28:12 -07:00
fbf1e46085
typo
2018-08-07 12:16:40 -07:00
a4f4bde600
print yapf version
2018-08-07 12:13:46 -07:00
37f9844921
explicit style configuration, add pylint to vsts
2018-08-06 17:57:22 -07:00
7730c46ee4
Internal: verify code formatting in build ( #633 )
...
* format all files, enforce formatting in travis build
* add yapf to vsts build
* update vsts build
* fix
* fix
* fix
* change queue to ubuntu
* revert
* temporarily enable builds on pushes to this branch
* change to non preview
* revert
* update yapf version, rerun
* update pytest parallelism
* add retry to arm call to avoid failures
* remove non-master trigger
* update builds, formatting style
2018-08-06 15:29:06 -07:00
b18eb695a1
Feature: SDK refactor ( #622 )
...
* start refactor
* continue refactor for cluster and job functions
* fix imports
* fixes
* fixes
* refactor integration test secrets management
* fix cluster create, add new test
* add tests for new sdk api and fix bugs
* fix naming and bugs
* update job operations naming, bug fixes
* fix cluster tests
* fix joboperations and tests
* update cli and fix some bugs
* start fixes
* fix pylint errors, bugs
* add deprecated warning checks, rename tests
* add docstrings for baseoperations
* add docstrings
* docstrings, add back compat for coreclient, fix init for spark client
* whitespace
* docstrings, whitespace
* docstrings, fixes
* docstrings, fixes
* fix the sdk documentation, bugs
* fix method call
* pool_id->id
* rename ids
* cluster_id->id
* cluster_id->id
* add todo
* fixes
* add some todos
* rename pool to cluster, add todo for nodes params
* add todos for nodes param removal
* update functions names
* remove deprecated fucntion calls
* update docs and docstrings
* update docstrings
* get rid of TODOs, fix docstrings
* remove unused setting
* inheritance -> composition
* fix models bugs
* fix create_user bug
* update sdk_example.py
* fix create user argument issue
* update sdk_example.py
* update doc
* use Software model instead of string
* add job wait flag, add cluster application wait functions
* add docs for wait, update tests
* fix bug
* add clientrequesterror catch to fix tests
2018-08-03 15:20:05 -07:00
c9fd8bbfeb
Release: v0.8.1 ( #616 )
...
* changelog update
* version update
* change release date of 0.8.0 to accurate date
2018-06-21 12:30:53 -07:00
a8f8e92629
Fix: docs links version ( #614 )
...
* update changelog
* update versions
2018-06-20 14:55:13 -07:00
4e0b1ecd0f
Fix: spark debug tool filter out .venv, make debug tool testable ( #612 )
...
* filter out .venv
* add NodeOutput model
* add debug tool integration test
* add test for debug tool
* split condition
* revert style change
* remove debug print
* whitespace
* remove other model implementation
* fix cluster copy
* fix cluster run and cluster copy
2018-06-20 14:26:35 -07:00
883980d345
Suppress msrest warnings ( #611 )
2018-06-18 12:59:28 -07:00
5306a2ad24
Fix: set defaults for SparkConfiguration, add tests ( #606 )
...
* add SparkConfiguration tests
* change test directory structure
2018-06-15 14:05:40 -07:00
34b25855d5
Fix: release v0.8.0 ( #600 )
...
* update changelog and version
* update changelog
* add deprecation version and tests
* fix tests
* update changelog with deprecations
* update changelog
2018-06-11 15:48:08 -07:00
4b2acc8491
Fix: add toolkit to sdk docs and example ( #602 )
2018-06-11 15:34:29 -07:00
2cb56f8cfd
Release: v0.8.0 ( #599 )
...
* update changelog and version
* update changelog
2018-06-11 12:15:45 -07:00
1cc71c7a59
Fix: allow cluster config to be printed when no username has been set ( #597 )
2018-06-11 10:42:24 -07:00
98c601ceb8
Fix: Deprecation messages cause TypeError in non-verbose mode ( #596 )
...
* Stop deprecate() from throwing when not in verbose mode
* Improve deprecation warning messages
2018-06-08 10:59:13 -07:00
7d7a814c50
Fix: fix typos ( #595 )
2018-06-07 09:57:43 -07:00
88d04195ec
Feature: add cluster list quiet flag, ability to compose with delete ( #581 )
...
* add quiet flag, ability to compose with delete
* log.print instead of print
* add some docs
2018-06-06 16:03:34 -07:00
fbf1bab704
Conda, Apt-Get and Pip Install Plugins ( #594 )
...
* Added install plugins
* Moved packages to directory
* Removed channel from conda install
* changed default to none
* Added line
* fixed template
* Fixed naming of apt get
2018-06-06 15:16:27 -07:00
fa3ac0eb3b
Fix: --size-low-pri being ignored ( #593 )
2018-06-05 10:54:02 -07:00
3f0c8f9bfc
Fix: set logger to stdout ( #588 )
...
* set logger to stdout
* typo
* add log.print level
2018-06-04 17:39:24 -07:00
f16aac091e
Feature: pure python ssh ( #577 )
...
* forward multiple ports
* plumb through cli
* continue cli implementation
* fixes
* pylint ignore
* spacing
* remove debug stuff, fix bug
* add --internal support
* add to init
* add comment
* remove nesting
* add logging
* add some docs
2018-06-04 17:16:51 -07:00
af449dc194
Feature: add node run command ( #572 )
...
* add node run command
* whitespace
* add node-run doc
* add host flag
* refactor, print->log
* generated username
* more secure random
* better handling of find node, type conversion
* add generate_user_on_node
* docs update
* fix docs
* remove duplicate import, sort
2018-06-04 13:58:33 -07:00
b9a863b2f5
Warnings show stacktrace on verbose ( #587 )
2018-06-04 08:10:00 -07:00
dbde8bc05a
Fix: remove deprecated vm_count call ( #586 )
2018-06-01 14:24:36 -07:00
e5e529a734
Fix: optimize start task ( #582 )
...
* optimize start task
* functions for setup_host
2018-05-31 14:41:55 -07:00
1eeff23d06
Fix: models v2 deserialization ( #584 )
...
* fix model deserialization
* whitespace
2018-05-30 16:42:42 -07:00
49a890a5df
Fix: switch create user to pool wide ( #574 )
...
* switch create user to pool wide
* fix password bug
* update doc
2018-05-30 13:36:59 -07:00
8b8cd6260f
Fix: Remove old spark-defaults.conf jars ( #567 )
2018-05-30 13:05:55 -07:00
8fea9ce092
Feature: Disable scheduling on group of nodes ( #540 )
2018-05-30 13:02:48 -07:00
02f336b0a0
Feature: New Models design with auto validation, default and merging ( #543 )
2018-05-30 09:07:09 -07:00
f6735cc6dd
Feature: Support passing of remote executables via aztk spark cluster submit ( #549 )
2018-05-24 10:29:23 -07:00
66037fd5cb
Feature: Add VSTS CI ( #561 )
...
* fix job submission bug and integration tests
* merge
* update tests, add vsts-ci.yml
* add python step
* debug statements
* update build
* update build add print
* build update
* fix bug
* debug
* undo
* parallelize build
* add trigger
* typo
* remove env
* whitespace
* whitespace
* whitespace
* remove debug branch
2018-05-22 15:17:02 -07:00
1527929e30
Feature: TensorflowOnSpark python plugin ( #525 )
...
* initial commit
* update
* update
* add gpu support
* remove comment
* change class to function
* fix merge issue
* add some docs
2018-05-21 13:22:55 -07:00
19dde429a7
Fix: switch from pycryptodome to pycryptodomex ( #564 )
...
Fix: switch from pycryptodome to pycryptodomex
2018-05-21 12:57:28 -07:00
3d16cf3954
Fix: getting started script reuse aad application ( #569 )
...
* start fix for existing aad application
* add start_date graph rbac client bug workaround
* remove debug
* typos
2018-05-21 12:36:48 -07:00
603a413d12
Feature: nvBLAS and OpenBLAS plugin ( #539 )
...
* add openblas plugin, update gpu docker images with netlib-lgpl
* update images and plugins
* add nvblas plugin
* revert gpu docker image change, add -Pnetlib-lgpl to base images
* change configuraitons to functions, add pugins to cluster.yaml
2018-05-15 17:47:41 -07:00
94e551c8c3
Release: 0.7.1 ( #554 )
2018-05-14 10:55:57 -07:00
5717fc3669
Feature: Increase max task per node ( #529 )
2018-05-11 14:06:12 -07:00
0534057be3
Fix: create virtual environment even if container exists ( #553 )
2018-05-11 13:58:32 -07:00
a18660bd30
Fix gitattributes for jar files ( #548 )
2018-05-09 10:43:54 -07:00
a99bbe19e6
Fix pass docker repo command back to the cluster config ( #538 )
2018-05-03 08:48:38 -07:00
Jake Freck
Timothee Guerin
mmduyzend
Brian
lachiemurray
Emlyn Corrin