- Provide an option for setup type
- Allow explicit setting of the number of instances for the
autoscratch volume
- Fix autopool and autoscratch interaction
- Modify singularity_images global resources to support encryption
options
- Automatically bind certificates to encrypted containers when a task
executes
- Update to Docker CE 19.03.1
- Use "native" Docker/containerd GPU support
- Breaking change in jobs configuration to allow arbitrary configuration
- Update docs
- Resolves#293
* Add MPI config support for MPICH
* Add MPI config support for Docker containers
* Resolve PR comments
* Make use of the script runner with MPI and Docker
* Minor fixes
* Resolve PR comments
* Add MPI config support for IntelMPI
* Separate prologue command into user and system
* Add MpiSettings
* Add MPI config support for Open MPI
* Fix MPI config support for IntelMPI
* Workaround for Open MPI btl tcp
* Correct documentation
* Fix non mpi multi instance execution
* Resolve PR comments
* Resolve PR comments
* Partially address #287
* Create one log file per container mode
* Make singularity 3 work
* Minor fixes
* Fix cascade with docker image and singularity image
* Add capability to pull from library://
* Add singularity signed images to config file
* Add singularity signed images to the global resource table
* Pull and verify signed singularity images
* Put the singularity sypgp directory in the mount directory
* Add ability to provide key file to verify a singularity image
* Resolve PR comments
* Fix Singularity registry credemtials
- Package and use Slurm 18.08 instead of default from distro repo
- Slurm "master" contains separate controller and login nodes
- Integrate RemoteFS shared file system into Slurm cluster
- Auto feature tagging on Slurm nodes
- Support CentOS 7, Ubuntu 16.04, Ubuntu 18.04 Batch pools as Slurm
node targets
- Unify login and Batch pools on cluster user based on login user
- Auto provision passwordless SSH user on compute nodes with login user
context
- Add slurm cluster commands, including orchestrate command
- Add separate SSH for controller, login, nodes
- Add Slurm configuration doc
- Add Slurm guide
- Add Slurm recipe
- Update usage doc
- Remove deprecated MSI VM extension from monitoring and federation
- Fix pool nodes count on non-existent pool
- Refactor SSH info to allow offsets
- Add fs cluster orchestrate command
* Add env vars option to pool configuration
- Add the option to include custom environment variables in the pool
configuration
- This allows users to setup Batch environment variables for the start
task
- This in turn could allow for the ability to use batch insights
* Add env var spec to pool schema for validation
- CHANGELOG updated with pool env var feature
* Add a keyvault option for pool env vars
- Added a keyvault option to the pool configuration
- Updated docs, schemas and templates accordingly
- Changed schema type from `str` to `text` for env vars
* Add keyvault client check
- Add a keyvault client check to ensure a valid client is used when
using keyvault to add env vars to the start task.
- BLAST and RNASeq pipelines
- Fix adding tasks to an existing job with existing merge tasks
- Add support for force_enable_task_dependencies at the job level
- Fix doc typos
- Federation proxy lifecycle management
- Federation lifecycle management
- Federation job submission and management
- Mount Azure File share for auto-rotated log persistence
- FIFO within job support
- Constraint matching
- Federations can be created in "unique job id" mode requiring all
submitted jobs via fed jobs add be unique across the entire federation
- Supports nearly 15K actions per job (in non-unique job id mode)
- Task dependency rewrite engine for federated jobs
- Verify dependencies only within task group
- Uniquely identify task dependencies
- Allow tuning of scheduling behavior options
- Package federation logic on proxy into Docker container
- Full guide/walkthrough for federation feature
- Refactor common code between monitor/fed proxy into resource
- Other doc updates
- Resolves#216
- Add generate sas option for diag logs upload command
- Allow multiple poolid for storage clear and del
- Add diagnostics log option to storage clear and del
- Allow storage sas create command to create container and share level
SAS tokens
- Refactor package uploader for pool
- Auto install node exporter and cadvisor for prom enabled pools
- Add configuration
- Create monitoring resource
- Start work on picket monitor
Fred Park
Vincent Labonté
jackpimbert