Граф коммитов

3529 Коммитов

Автор SHA1 Сообщение Дата
Jason Rupert f02df85438 Update Training-Configuration-File.md (#59)
* Update Training-Configuration-File.md

Doc says "behavior_cloning" when it should say "behavioral_cloning".

* Update Learning-Environment-Design-Agents.md

Minor correction to wording.  (https://github.com/Unity-Technologies/ml-agents/issues/5745)
2022-05-24 21:14:06 -07:00
GitHub Actions - update submodules 7d6eaaf48b Update submodules 2022-05-16 21:13:50 +00:00
Andrew Cohen 9785407d41 add poca ref in docs (#58) 2022-05-06 09:13:38 -07:00
Andrew Cohen 0893f1b199 Add poca reference and update to latex refs (#57) 2022-05-05 12:58:53 -07:00
Miguel Alonso Jr eba741f952 Update submodules (#56)
Co-authored-by: GitHub Actions - update submodules <bot@noreply.github.com>
2022-05-05 12:33:30 -04:00
Miguel Alonso Jr f5e70477ee Updated Unity version to 2020.3.33f1. (#53) 2022-05-04 14:26:48 -04:00
GitHub Actions - update submodules eee9b8389e Update submodules 2022-04-29 20:06:39 +00:00
Andrew Cohen d697fcc65f Add shared critic configurability for PPO (#45) 2022-04-29 08:51:17 -07:00
Florence Rolland d6666d50d1 Use pinned version of package-ci/mac image (#50) 2022-04-13 10:35:53 +02:00
Miguel Alonso Jr 61fc4981a1 Removed dead links in pull request template. (#48) 2022-04-05 15:11:50 -04:00
Jason Bowman 23fc08a04b Update automated trigger references to support develop branch (#36)
* Update automated trigger references to support develop branch

* Update pull request template links to refer to develop branch.

* Fix release branch name for github actions

* Update pre-commit pattern

* Removing test that no longer applys to this repo
2022-04-03 09:22:38 -04:00
GitHub Actions - update submodules c2a9a835d1 Update submodules 2022-04-01 19:57:58 +00:00
Maryam Honari a516950f29 bump version to 0.29.0 (#42)
* bump version to 0.29.0

* remove dev tag

* add checks for pytorch-gpu install

* pin black version to 22.3.0
2022-04-01 07:57:53 -07:00
GitHub Actions - update submodules eff75427f8 Update submodules 2022-03-31 23:12:07 +00:00
Xun Cao f5840e6fc8 fix-sonar-bugs (#44) 2022-03-31 11:41:09 -07:00
Maryam Honari bf4a017502 pin black version to 22.3.0 (#46) 2022-03-30 16:52:43 -07:00
GitHub Actions - update submodules 78fde8143e Update submodules 2022-03-30 21:25:44 +00:00
Miguel Alonso Jr e81591bdb7 Pinning markdown link check to 3.8.7 on nightly gha. (#43) 2022-03-28 17:44:44 -04:00
Xun Cao 68dde8cbd2 Add sonarqube yamato job (#38) 2022-03-25 09:37:59 -07:00
Maryam Honari 04b229dc9f Updated submodule com.unity.ml-agents (#41) 2022-03-24 13:21:09 -07:00
Xun Cao 70610483e7 fix markdown docs linking issue (#40) 2022-03-23 13:53:10 -07:00
Miguel Alonso Jr 734c9a3348 Feature/mla 2394 update web docs (#37)
* Added mkdocs and refactored docs.

* Updated docs.

* Added gh action to manually public docs. Updated mkdocs.yml.
2022-03-23 14:43:12 -04:00
Maryam Honari 21bba3a6fe bump to barracuda 3.0.0 (#30)
* bump to barracuda 3.0.0 & Updated submodule com.unity.ml-agents
2022-03-23 11:38:28 -07:00
Andrew Cohen fe7bff83df Move SB3 dependencies to colab (#29)
* Basic example running with multiple envs in sb3

* Merge & cleanup

* trains 3dball

* move SB3 helpers into colab

* remove sb3/supersuit hard reqs

* remove sb3 funcs

* remove unused imports

* remove sb3 example directory and script

* remove vec env tests

* clean colab

* fix link

Co-authored-by: Henry Peteet <henry.peteet@unity3d.com>
Co-authored-by: mahon94 <maryam.honari@unity3d.com>
2022-03-23 14:23:41 -04:00
Brandon Henry cc25ea8abf update logo (#39) 2022-03-23 14:22:17 -04:00
Xun Cao 22bf5d4777 Fix pypi publish github action (#35) 2022-03-16 11:14:10 -07:00
Maryam Honari ef40796651 yamato promotion min editor bumped to 2020.3 (#34) 2022-03-11 11:57:40 -08:00
Xun Cao 521e328faf Add github action to publish python API to PYPI (#28) 2022-03-07 13:24:35 -08:00
Maryam Honari 9ab59f790c update to main on com.unity.ml-agents submodule (#27) 2022-03-02 13:54:07 -08:00
Miguel Alonso Jr af3cc1085c Set execution order to be negative to make sure scripts run before de… (#26)
* Set execution order to be negative to make sure scripts run before default time.

* Fixed issue with the basic environment. Updated submodule.

* Removed execution order class attribute from project settings overrides and added it to basic controller.

* Updated submodule. Added platform #if to BasicController awake.

* Removed execution order from basic controller. Added execution order to project settings through editor.

* Updated submodule.
2022-02-28 16:37:43 -05:00
Miguel Alonso Jr 56faf4e1b4 Fixed failing tests. (#24)
* Fixed failing tests.

* Updated validate meta files.

* Updated com.unity.ml-agents submodule.

* Added default execution order to com.unity.ml-agents package are removed it from main project.

* Updated com.unity.ml-agents submodule. Fixed agent scripts that implemented Awake for refactored com.unity.ml-agents Agent.

* Updated submodule.

* Fixed execution order issue with ProjectSetttingsOverride.

* Updated protobuf make file.

* Updated c# package submodule.
2022-02-24 18:33:55 -05:00
Henry Peteet e22d651835 Update nightly to checkout submodules (#23) 2022-02-22 10:28:16 -05:00
Miguel Alonso Jr a3e777c959 Updated com.unity.ml-agents submodule. (#22) 2022-02-18 16:17:16 -05:00
Miguel Alonso Jr a81dddb53a Develop pro package refactor (#21)
* Removed com.unity.ml-agents package.

* Added com.unity.ml-agents submodule.

* Updated yamato pack to recurse submodules.

* Updated all yamato to recurse submodules.

* Fixed bug in precommit gh workflow.

* Updated validate meta files.

* Fix for protobuf gen test.
2022-02-17 17:38:40 -05:00
Henry Peteet 55485be302 [Markdown link check] Ignore network issue for GHE (#20) 2022-02-17 16:38:29 -05:00
Henry Peteet 3959172f8a Speed up pytest GitHub check (#15) 2022-02-17 16:38:10 -05:00
Henry Peteet ee49d16b1f Add make_mla_sb3_env factory (#11)
Adds a new factory method for creating stable_baselines3 vector environments from Unity environments (including the registry).
2022-02-16 14:42:22 -05:00
Henry Peteet f588f73e8d Update docs regarding the "range" field in AddOneHotObservation (#16) 2022-02-16 14:36:52 -05:00
Henry Peteet 729d113328 Fix cattrs register calls for 3.9.10 (#17) 2022-02-15 19:58:08 -05:00
Henry Peteet e00f47e651 Pin dotnet version for GHA formatting (#19)
Pins dotnet version for dotnet-format
2022-02-15 18:39:33 -05:00
Henry Peteet fca587c64d Fix dead markdown links (#18)
* Remove outdated "interface" tutorial for Unity

* Update out of date link for microsoft docs

* Rephrase sentence to fit new  link
2022-02-15 14:37:01 -05:00
Henry Peteet a053db19d5 Upgrade remote registry entries to be threadsafe (#14)
Update the registry to be threadsafe via filelocks. This is needed if we want to use the registry with vectorized environments.

Previously if you tried to make 2 of the same environment from the same remote registry entry they would stomp on each others downloads.
2022-02-09 16:43:17 -05:00
Henry Peteet 9a5a1418ff Upgrade pre-commit tools (#12) 2022-02-07 21:18:16 -05:00
Miguel Alonso Jr 1bde547068 Pinned max python version in setup.py for ml-agents and ml-agents-envs (#9) 2022-02-03 20:31:34 -05:00
Miguel Alonso Jr 28303adf6c Develop python api ga (#6)
* Dropped support for python 3.6

* Pinning python 3.9.9 for tests due to typing issues with 3.9.10

* Testing new bokken image.

* Testing new bokken image.

* Updated yamato standalone build test.

* Updated yamato standalone build test.

* Updated standalone build test.

* Updated yamato configs to use mla bokken vm.

* Bug fixes for yamato yml files.

* Fixed com.unity.ml-agents-test.yml

* Bumped min python version to 3.7.2

* pettingzoo api prototype

* add example

* update file names

* support multiple behavior names

* fix multi behavior action index

* add install in colab

* add setup

* update colab

* fix __init__

* clone single branch

* import tags only

* import in init

* catch import error

* update colab

* move colab and add readme

* handle agent dying

* add tests

* update doc

* add info

* add action mask

* fix action mask

* update action masks in colab

* change default env

* set version

* fix hybrid action

* fix colab for hybrid actions

* add note on auto reset

* Updated colab name.

* Update README.md

* Following petting_zoo registry API (#5557)

* init petting_zoo registry

* cherrypick Custom trainer editor analytics (#5511)

* cherrypick "Update dotnet-format to address breaking changes introduced by upstream changes (#5528)"

* Update colab to match pettingZoo import api

* ToRevert: pull exp-petting-registry branch

* Add init file to tests

* Install pettingzoo-unity requirements for pytest

* update pytest command

* Add docstrings and comments

* update coverage to pettingzoo folder

* unset log level

* update env string

* Two small bugfixes (#5589)

1. Add the missing `_cumulative_rewards` property
2. Update `agent_selection` to not error out when an agent finishes an episode.

* Updated gym to 0.21.0 and petting zoo to 1.13.1, fixed bugs with AEC wrapper for gym and PZ updates. API tests are passing.

* Some refactoring.

* Finished inital implementation of parallel. Tests not passing.

* Finished parallel API implementation and refactor. All PZ tests passing.

* Cleanup.

* Refactoring.

* Pinning numpy version.

* add metadata and behavior_specs initialization

* addressing behaviour_spec issues

* Bumped PZ version to 1.14.0. Fixed failing tests.

* Refactored gym-unity and petting-zoo into ml-agents-envs

* Added TODO to pydoc-config.yaml

* Refactored gym and pz to be under a subpackage in mlagents_env package

* Refactored ml-agents-envs docs.

* Minor update to PZ API doc.

* Updated mlagents_envs docs and colab.

* Updated pytest gh workflow to remove ref to gym and pz.

* Refactored to remove some test coupling between trainers and envs.

* Updated installation doc.

* Update ml-agents-envs/README.md

Co-authored-by: Andrew Cohen <andrew.cohen@unity3d.com>

* Updated failing yamato jobs.

* pettingzoo api prototype

* add example

* update file names

* support multiple behavior names

* fix multi behavior action index

* add install in colab

* add setup

* update colab

* fix __init__

* clone single branch

* import tags only

* import in init

* catch import error

* update colab

* move colab and add readme

* handle agent dying

* add tests

* update doc

* add info

* add action mask

* fix action mask

* update action masks in colab

* change default env

* set version

* fix hybrid action

* fix colab for hybrid actions

* add note on auto reset

* Updated colab name.

* Update README.md

* Following petting_zoo registry API (#5557)

* init petting_zoo registry

* cherrypick Custom trainer editor analytics (#5511)

* cherrypick "Update dotnet-format to address breaking changes introduced by upstream changes (#5528)"

* Update colab to match pettingZoo import api

* ToRevert: pull exp-petting-registry branch

* Add init file to tests

* Install pettingzoo-unity requirements for pytest

* update pytest command

* Add docstrings and comments

* update coverage to pettingzoo folder

* unset log level

* update env string

* Two small bugfixes (#5589)

1. Add the missing `_cumulative_rewards` property
2. Update `agent_selection` to not error out when an agent finishes an episode.

* Updated gym to 0.21.0 and petting zoo to 1.13.1, fixed bugs with AEC wrapper for gym and PZ updates. API tests are passing.

* Some refactoring.

* Finished inital implementation of parallel. Tests not passing.

* Finished parallel API implementation and refactor. All PZ tests passing.

* Cleanup.

* Refactoring.

* Pinning numpy version.

* add metadata and behavior_specs initialization

* addressing behaviour_spec issues

* Bumped PZ version to 1.14.0. Fixed failing tests.

* Refactored gym-unity and petting-zoo into ml-agents-envs

* Added TODO to pydoc-config.yaml

* Refactored gym and pz to be under a subpackage in mlagents_env package

* Refactored ml-agents-envs docs.

* Minor update to PZ API doc.

* Updated mlagents_envs docs and colab.

* Updated pytest gh workflow to remove ref to gym and pz.

* Refactored to remove some test coupling between trainers and envs.

* Updated installation doc.

* Update ml-agents-envs/README.md

Co-authored-by: Andrew Cohen <andrew.cohen@unity3d.com>

* Updated CHANGELOG.

* Updated Migration guide.

* Doc updates based on CR.

* Updated github workflow for colab tests.

* Updated github workflow for colab tests.

* Updated github workflow for colab tests.

* Fixed yamato import error.

Co-authored-by: Ruo-Ping Dong <ruoping.dong@unity3d.com>
Co-authored-by: Miguel Alonso Jr <miguelalonsojr>
Co-authored-by: jmercado1985 <75792879+jmercado1985@users.noreply.github.com>
Co-authored-by: Maryam Honari <honari.m94@gmail.com>
Co-authored-by: Henry Peteet <henry.peteet@unity3d.com>
Co-authored-by: mahon94 <maryam.honari@unity3d.com>
Co-authored-by: Andrew Cohen <andrew.cohen@unity3d.com>
2022-02-02 19:32:23 -05:00
Miguel Alonso Jr b4cbaa6840 Develop deprecate python 3.6 (#5)
* Dropped support for python 3.6

* Pinning python 3.9.9 for tests due to typing issues with 3.9.10

* Testing new bokken image.

* Testing new bokken image.

* Updated yamato standalone build test.

* Updated yamato standalone build test.

* Updated standalone build test.

* Updated yamato configs to use mla bokken vm.

* Bug fixes for yamato yml files.

* Fixed com.unity.ml-agents-test.yml

* Bumped min python version to 3.7.2

* Updated failing yamato jobs.

* Updated github workflow for colab tests.

* Updated github workflow for colab tests.

* Updated github workflow for colab tests.
2022-02-02 08:53:34 -05:00
Henry Peteet b388f51b69 Fix GitHub Actions for GitHub Enterprise (#4)
* Reformat coalb files (#2)

* Update GitHub actions for GitHub Enterprise Compat (#1)

### Proposed change(s)

Update the GitHub actions to work in GitHub Enterprise (move from public to enterprise + public mirror).

### Useful links (Github issues, JIRA tickets, ML-Agents forum threads etc.)

https://jira.unity3d.com/browse/MLA-2344

### Types of change(s)

- [x] Code refactor

### Depends on https://github.cds.internal.unity3d.com/unity/actions-syncer/pull/44 
### Depends on #2 to reformat some colab notebooks

### Verified working actions vs untested (need to test once this is checked in):
- [x] colab
- [x] pre-commit
- [x] pytest
- [ ] nightly (will automatically be tested upon submission)
- [ ] publish pypi (this needs to be careful)
- [ ] Lock Threads (should only run on public mirror of repo once mirroring is complete)

* Reformat coalb files (#2)

* Update GitHub actions for GitHub Enterprise Compat (#1)

### Proposed change(s)

Update the GitHub actions to work in GitHub Enterprise (move from public to enterprise + public mirror).

### Useful links (Github issues, JIRA tickets, ML-Agents forum threads etc.)

https://jira.unity3d.com/browse/MLA-2344

### Types of change(s)

- [x] Code refactor

### Depends on https://github.cds.internal.unity3d.com/unity/actions-syncer/pull/44 
### Depends on #2 to reformat some colab notebooks

### Verified working actions vs untested (need to test once this is checked in):
- [x] colab
- [x] pre-commit
- [x] pytest
- [ ] nightly (will automatically be tested upon submission)
- [ ] publish pypi (this needs to be careful)
- [ ] Lock Threads (should only run on public mirror of repo once mirroring is complete)
2022-02-01 16:32:54 -05:00
Maryam Honari 71b121ca7a
upgrade gym to 0.21.0 (#5639) 2022-01-18 14:58:59 -08:00
Miguel Alonso Jr d2bb03c33b
Fixed build-docker and updated CHANGELOG to add unreleased section. (#5682)
* Fixed build-docker and updated CHANGELOG to add unreleased section.

* Updated backward compat mac training yamato test. (#5685)
2022-01-18 14:52:43 -05:00
Miguel Alonso Jr 88f186aca8 README updated. 2022-01-17 12:34:59 -05:00