Jacob Freck
|
4408c4fc41
|
Feature: Spark scheduling target (#661)
* initial
* update pipfile and pipfile.lock
* uncomment scheduling target, start ssh_submit impl
* get rid of debug code
* finish ssh_submit implementation
* serialize object instead of properties
* fix upload log bug, temp workaround for get logs
* remove unused function
* clean up node_scripts submit, remove debug code
* ensure warns on deprecated test
* remove commented timeout
* start scheduling_target for job_submission
* continue job scheduling target implementation
* update pipefile.lock
* update Pipfile deps, pin pynacl to fix build failure
* fix syntax
* fix pipfile with latest azure-nspkg
* update path for scheduling scripts
* update config.py import
* add nohup dependency
* use nohup and exit immediately
* remove bad dep
* remove nohup
* remove commented code
* add block to ssh, get retcode from node_exec
* fix typo
* fix some imports, add test stubs
* fixes
* start implementation of task table service
* add scheduling_target support for get_application_log
* todos
* remove useless statement
* move get_application_status to core, add scheduling_target support
* update deps in requirements.txt
* fix false positive pylint import error
* remove bad import
* bad local variable
* add batch task abstraction, add datetime field
* mediate table insertion with task abstraction
* fix issues with task abstraction usage
* fix pylint import error
* fix update task on run
* update job submission test
* make test package, update pylint
* update job submission with scheduling_target
* add job support for scheduling_target
* fix taskstate serialization to storage
* fix job submission job manager task, catch table storage errors
* fix import
* fix imports for batch sdk 5.0+
* fix test model module
* fix node election exception catch
* start fix job tests
* move get_task_status to base
* fix job tests
* fix get_application, add abstraction to batch task gets
* fix some bugs, remove some debug statements
* fix test
* use jobstate and application state
* add start_task retries
* make jobstate an enum
* fix import
* fixes
* fixes
* revert settings.json
* fixes for application state in cli
* conditionally create storage table
* remove commented code
* conditionally create storage table
* remove commented code
* fix test
* respond to comments
* fix debug statement, fix starttask issue
* remove debug test print
* formatting
* update doc string with correct return value
* revert settings.json
* more robust starget test, fix get_application for starget
* whitespace
|
2018-10-23 15:47:54 -07:00 |
|
Jacob Freck
|
828162ef10
|
Internal: fix pylint warnings (#651)
* inital, remove unused imports
* run yapf
* remove unused imports and variables, fix declaration outside init
* fix some pylint warnings, add ssh_into_master
* remove unused imports
* unused variables
* string and function normalization
* stop using list comprehension for side effects, make method function
* stop using protected member
* various pylint fixes
* formatting
* formatting
* add retry decorator with tests
* start adding retry decorator, retry docker compose download
* update pip and tests
* logic fix
* change no delete if
* factor out reused functions
* fix wait_for_all_nodes
* fix download return type bug
* test vsts ci update
* temporarily disable integration tests
* syntax fix
* update vsts build
* add back integration tests, remove debug branch
* remove parallel unit tests
* more verbose clis
* update pylint
* typo
* fix imports
* function returns nothing, don't return
* make iterator list
* change debug value
|
2018-08-24 17:21:22 -07:00 |
|
Jacob Freck
|
7730c46ee4
|
Internal: verify code formatting in build (#633)
* format all files, enforce formatting in travis build
* add yapf to vsts build
* update vsts build
* fix
* fix
* fix
* change queue to ubuntu
* revert
* temporarily enable builds on pushes to this branch
* change to non preview
* revert
* update yapf version, rerun
* update pytest parallelism
* add retry to arm call to avoid failures
* remove non-master trigger
* update builds, formatting style
|
2018-08-06 15:29:06 -07:00 |
mmduyzend
Timothee Guerin