Граф коммитов

22 Коммитов

Автор SHA1 Сообщение Дата
Jacob Freck 7730c46ee4
Internal: verify code formatting in build (#633)
* format all files, enforce formatting in travis build

* add yapf to vsts build

* update vsts build

* fix

* fix

* fix

* change queue to ubuntu

* revert

* temporarily enable builds on pushes to this branch

* change to non preview

* revert

* update yapf version, rerun

* update pytest parallelism

* add retry to arm call to avoid failures

* remove non-master trigger

* update builds, formatting style
2018-08-06 15:29:06 -07:00
Jacob Freck b18eb695a1
Feature: SDK refactor (#622)
* start refactor

* continue refactor for cluster and job functions

* fix imports

* fixes

* fixes

* refactor integration test secrets management

* fix cluster create, add new test

* add tests for new sdk api and fix bugs

* fix naming and bugs

* update job operations naming, bug fixes

* fix cluster tests

* fix joboperations and tests

* update cli and fix some bugs

* start fixes

* fix pylint errors, bugs

* add deprecated warning checks, rename tests

* add docstrings for baseoperations

* add docstrings

* docstrings, add back compat for coreclient, fix init for spark client

* whitespace

* docstrings, whitespace

* docstrings, fixes

* docstrings, fixes

* fix the sdk documentation, bugs

* fix method call

* pool_id->id

* rename ids

* cluster_id->id

* cluster_id->id

* add todo

* fixes

* add some todos

* rename pool to cluster, add todo for nodes params

* add todos for nodes param removal

* update functions names

* remove deprecated fucntion calls

* update docs and docstrings

* update docstrings

* get rid of TODOs, fix docstrings

* remove unused setting

* inheritance -> composition

* fix models bugs

* fix create_user bug

* update sdk_example.py

* fix create user argument issue

* update sdk_example.py

* update doc

* use Software model instead of string

* add job wait flag, add cluster application wait functions

* add docs for wait, update tests

* fix bug

* add clientrequesterror catch to fix tests
2018-08-03 15:20:05 -07:00
Jacob Freck 1eeff23d06
Fix: models v2 deserialization (#584)
* fix model deserialization

* whitespace
2018-05-30 16:42:42 -07:00
Timothee Guerin 02f336b0a0
Feature: New Models design with auto validation, default and merging (#543) 2018-05-30 09:07:09 -07:00
Jacob Freck 66037fd5cb
Feature: Add VSTS CI (#561)
* fix job submission bug and integration tests

* merge

* update tests, add vsts-ci.yml

* add python step

* debug statements

* update build

* update build add print

* build update

* fix bug

* debug

* undo

* parallelize build

* add trigger

* typo

* remove env

* whitespace

* whitespace

* whitespace

* remove debug branch
2018-05-22 15:17:02 -07:00
Timothee Guerin a99bbe19e6
Fix pass docker repo command back to the cluster config (#538) 2018-05-03 08:48:38 -07:00
Timothee Guerin 7a7e63c54f
Feature: New Toolkit configuration (#507) 2018-05-01 16:36:44 -07:00
Timothee Guerin e361c3b0b3
Feature: Readthedocs support (#497) 2018-04-26 14:03:45 -07:00
Timothee Guerin de7898334c
Feature: Plugin V2: Running plugin on host (#461) 2018-04-23 17:20:43 -07:00
Timothee Guerin 2bed496c39
Internal: Cluster data helpers and upload_node_script into cluster_data module (#401) 2018-03-08 10:34:19 -08:00
Timothee Guerin c237501a9f
Feature: Pypi auto deployement (#428) 2018-03-05 17:18:47 -08:00
Timothee Guerin c724d9403f
Feature: Plugins (#387) 2018-02-26 16:36:31 -08:00
Jacob Freck 17755e0ffa
Feature: Basic Cluster and Job Submission SDK Tests (#344)
* add initial cluster tests

* add cluster tests, add simple job submission test scenario

* sort imports

* fix job tests

* fix job tests

* remove pytest from travis build

* cluster per test, parallel pytest plugin

* delete cluster after tests, wait until deleted

* fix bugs

* catch right error, change cluster_id to base_cluster_id

* fix test name

* fixes

*  move tests to intregration_tests dir

* update travis to run non-integration tests

* directory structure, decoupled job tests

* fix job tests, issue with submit_job

* fix bug

* add test docs

* add cluster and job delete to finally clause
2018-02-22 14:06:16 -08:00
Timothee Guerin d7d5faaf7a
Fix: Custom scripts not read from cluster.yaml (#388) 2018-02-09 09:56:53 -08:00
Timothee Guerin 4a1d9adf25 Revert "Revert "Feature: Setup the cluster with the start task." (#26)" (#28)
This reverts commit dc1618ae94.
2017-07-14 12:00:47 -04:00
JS dc1618ae94 Revert "Feature: Setup the cluster with the start task." (#26) 2017-07-13 20:57:04 -07:00
Timothee Guerin 27b14e6adc Finish reviewing 2017-07-13 13:23:19 -07:00
Timothee Guerin 9dc24bd7f6 Pep8 config file 2017-07-12 13:23:16 -07:00
Timothee Guerin de32bf6590 Added editorconfig and settings 2017-07-12 12:41:15 -07:00
Timothee Guerin 58201d1b0d Refactor 2017-07-10 12:33:49 -07:00
Timothee Guerin 9a00ea984d Move pylintrc 2017-07-10 09:14:09 -07:00
paselem 6cd8c8ce62 Merged PR 5: Merge feature/batch2.0.0 to master 2017-05-12 20:25:47 +00:00