Граф коммитов

3524 Коммитов

Автор SHA1 Сообщение Дата
Miguel Alonso Jr. 22a59aad34
Fix failing ci post upgrade (#6141)
* Update PerformancProject and DevProject.

* Removed mac perf tests.
2024-09-01 11:27:18 -04:00
Miguel Alonso Jr. 2b50f60f4a
Develop upgrade Sentis 2.0.0 (#6137)
* Upgraded to Sentis v1.4.0-pre.3

* Disabling sonar qube yamato job. Will add gha sonar scanner at a later date.

* Addressing PR comments.

* Addressing feedback.

* Upgraded to sentis 2.0.0.

* Fixed failing tests.

* Fixed soccertwos policy.

* Fixed pytorch deprecation message during training startup. Updated Installation.md

* Updated installation docs.

* Fixed failing torch utils test.
2024-08-25 20:07:16 -04:00
Miguel Alonso Jr a66ffbf062
Restored reference to GCP gym registry. (#6108) 2024-05-03 06:25:36 -04:00
Miguel Alonso Jr d3667986aa
Removed reference to GCP gym registry. (#6107) 2024-05-02 13:54:31 -04:00
Miguel Alonso Jr dbb819b1f7
Fixed missing assembly reference for google protobuf. (#6099) 2024-04-19 18:56:05 -04:00
alex-mccarthy-unity fb2af761a1
Use dotnet 8.x in pre-commits to fix flaky failures (#6083)
The 8.x release should contain https://github.com/dotnet/runtime/pull/90342 which fixes https://github.com/dotnet/runtime/issues/80619.

I hope this will fix flaky failures like https://github.com/Unity-Technologies/ml-agents/actions/runs/8268945605/job/22623023348 of the form:
```
dotnet-format............................................................Failed
- hook id: dotnet-format
- exit code: 1

System.IO.IOException: The system cannot open the device or file specified. : 'NuGet-Migrations'
   at System.Threading.Mutex.CreateMutexCore(Boolean initiallyOwned, String name, Boolean& createdNew)
   at System.Threading.Mutex..ctor(Boolean initiallyOwned, String name)
   at NuGet.Common.Migrations.MigrationRunner.Run(String migrationsDirectory)
   at Microsoft.DotNet.Configurer.DotnetFirstTimeUseConfigurer.Configure()
   at Microsoft.DotNet.Cli.Program.ConfigureDotNetForFirstTimeUse(IFirstTimeUseNoticeSentinel firstTimeUseNoticeSentinel, IAspNetCertificateSentinel aspNetCertificateSentinel, IFileSentinel toolPathSentinel, Boolean isDotnetBeingInvokedFromNativeInstaller, DotnetFirstRunConfiguration dotnetFirstRunConfiguration, IEnvironmentProvider environmentProvider, Dictionary`2 performanceMeasurements)
   at Microsoft.DotNet.Cli.Program.ProcessArgs(String[] args, TimeSpan startupTime, ITelemetry telemetryClient)
   at Microsoft.DotNet.Cli.Program.Main(String[] args)
```
2024-03-14 05:45:07 -04:00
hamidrexa ghahremani 692c91005a
Fix sample code indentation in migrating.md (#5840)
Fix markdown indentation
2024-03-14 07:49:33 +01:00
alex-mccarthy-unity b2a6b5be17
Raise minimum numpy version to 1.23.5 to fix installation errors on windows (#6082)
Fixes https://github.com/Unity-Technologies/ml-agents/issues/6047

Fixes the following errors when installing ml-agents-envs on windows if numpy 1.21.2 is already installed:
```
  Building wheel for numpy (pyproject.toml) ... error
  error: subprocess-exited-with-error

  × Building wheel for numpy (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [326 lines of output]
      setup.py:63: RuntimeWarning: NumPy 1.21.2 may not yet support Python 3.10.
        warnings.warn(
      Running from numpy source directory.
```
2024-03-14 06:56:48 +01:00
alex-mccarthy-unity 93221d4cd9
Fix continuous integration tests across incompatible editor versions (2022 and trunk) (#6079)
* Fix com.unity.ml-agents test 2022.3 on win by upgrading Unity versions

Run all CI tests against 2023.2 (required by Sentis), not 2022.3

Sample failing sub-jobs before: https://unity-ci.cds.internal.unity3d.com/job/35022030/dependency-graph
Sample passing sub-jobs after: https://unity-ci.cds.internal.unity3d.com/job/35033024/dependency-graph

Note that `trunk` jobs are still failing after this fix.
Those will be investigated separately since they've been failing since March 8: https://unity-ci.cds.internal.unity3d.com/job/34919178/dependency-graph

* Ignore yamato-parser output files

* Disable `trunk` tests, which break with Unity 6

Clean run of "Run All Combinations of Editors/Platforms Tests" after this change: https://unity-ci.cds.internal.unity3d.com/job/35037130/dependency-graph

* Print full diffs when a sensor mismatch occurs in tests

* Refactor tests to use positions instead of hardcoded numbers

* Disable `RigidBodySensorTests.TestBodiesWithJoint` which fails in 2023.2

* Fix editor version in test_versions.metafile (use 2023.2)
2024-03-13 13:23:15 -04:00
alex-mccarthy-unity c4dc0a27fe
Fix bad link format introduced by #6033 (#6078) 2024-03-13 13:14:51 -04:00
xyz2022 ed807e307c
Update Installation.md (#6004)
Removing "or higher" because:
(i) ./ml-agents/setup.py requires >=3.10.1,<=3.10.12 
(ii) python 3.10.13 is the default conda install, and 3.10.13 does not work correctly with numpy 1.21.2
2024-03-11 11:18:27 +01:00
Ibrahim Alhas d9d5e0f058
Update Using-Virtual-Environment.md (#6033)
Added the rest of the incomplete sentence around using anaconda (conda for using mlagents).
2024-03-11 11:18:01 +01:00
alex-mccarthy-unity b51eecf85e
Update to Sentis 1.3.0-pre.3 release (#6070)
Co-authored-by: Miguel Alonso Jr <76960110+miguelalonsojr@users.noreply.github.com>
2024-03-09 07:52:20 -05:00
alex-mccarthy-unity 10887de8d3
Upgrade to Unity 2023.2 (#6071)
This is the minimum version supported by the latest Sentis release 1.3.0: https://discussions.unity.com/t/about-sentis-beta/260899

Remove the TextMeshPro package, which is deprecated in 2023.2 (and causes duplicate symbol errors): https://forum.unity.com/threads/2023-2-latest-development-on-textmesh-pro.1434757/

Tested: ran models in the 3DBall scene on OS X
2024-03-09 07:47:15 -05:00
alex-mccarthy-unity 92cbaad8ec
Fix GPU continuous build: correct torch version, and remove torchaudio and torchvideo (#6074)
* Fix GPU continuous build: correct torchaudio version

torchaudio 0.17 doesn't exist, but 2.2 does.

Use a slightly older cuda version, since that makes cuda detection work on the machines we're running on (RTX 2080's on Ubuntu 18.04, which presumably aren't compatible with CUDA 12).

(I'm not sure if the tests actually need torchaudio or torchvision, since those aren't listed dependencies of any of our software, but let's at least install a valid one)

Passing yamato run with this change: https://unity-ci.cds.internal.unity3d.com/job/34869354/logs

* Don't install torchaudio and torchvision, since they're unused

Sample passing GPU test run: https://unity-ci.cds.internal.unity3d.com/job/34891013/logs
2024-03-09 07:35:03 -05:00
alex-mccarthy-unity b9ac3f1059
Fix dead links to Tensorboard (#6075)
Ignore spurious dead links to tensorflow.org pages, since we're seeing an infinite redirect for some reason that doesn't reproduce in the browser or with `curl`.
2024-03-09 07:34:12 -05:00
alex-mccarthy-unity f6486fc637
Deprecated actions (#6077)
* Upgrade git up actions versions to fix deprecation warnings

Sample deprecation warnings this fixes:
https://github.com/Unity-Technologies/ml-agents/actions/runs/8189380401
https://github.com/Unity-Technologies/ml-agents/actions/runs/8189380425
https://github.com/Unity-Technologies/ml-agents/actions/runs/8189380389

* Give artifacts unique names

This is a required change for upload-artifact v4: ef09cdac3e/docs/MIGRATION.md (multiple-uploads-to-the-same-named-artifact)

* Migrate away from set-ouput

Following the example on the migration guide: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

* Upgrade some more deprecated actions

Sample deprecation warnings:
https://github.com/Unity-Technologies/ml-agents/actions/runs/8191144402
2024-03-09 07:33:29 -05:00
alex-mccarthy-unity 4f2cfd1b6b
Fix documentation typos and list rendering (#6066)
* Fix list being rendered incorrectly in webdocs

I assume this extra blank line will fix the list not being correctly formatted on https://unity-technologies.github.io/ml-agents/#releases-documentation

* Fix typos in docs

* Fix more mis-rendered lists

Add a blank line before bulleted lists in markdown files to avoid them being rendered as in-paragraph sentences that all start with hyphens.

* Fix typos in python comments used to generate docs
2024-03-06 14:58:57 +01:00
alex-mccarthy-unity 1bee58f5bb
Fix cuda not being used on windows: update pytorch version (#6064)
These references were missed when upgrading from pytorch 1.x to 2.x in #6013

References found by running `grep -R '1\.13\.1' .`

Install command chosen from the guide at https://pytorch.org/get-started/locally/
2024-03-06 14:58:26 +01:00
alex-mccarthy-unity 6004556ec9
Upgrade ONNX to 1.15.0 (#6062)
This fixes builds of ONNX on OS X while installing ml-agents.

OS X builds use Xcode by default, and the Xcode compiler defaults to using C++98 mode for C++ ( https://stackoverflow.com/a/21349148 ). This causes errors building protocol buffer libraries, which need to be compiled with support for C++14 or newer ( https://github.com/protocolbuffers/protobuf/issues/12393#issuecomment-1508983035 ).

[This ONNX commit](a979e75613) changes its compilation to use C++14 mode: releases that include this commit (1.15.0 or newer) build with Xcode by default.

ONNX 1.15.0 uses a newer protocol buffer library, so allow newer versions here too.
2024-03-06 14:58:02 +01:00
alex-mccarthy-unity 66f6b34030
Document grpcio installation for OS X (#6067)
Before installing `grpcio` on my Apple Silicon mac, running `mlagents-learn --help` threw the following error:

```
ImportError: dlopen(/Users/alex.mccarthy/miniconda3/envs/mlagents/lib/python3.10/site-packages/grpc/_cython/cygrpc.cpython-310-darwin.so, 0x0002): symbol not found in flat namespace '_CFRelease'
```

After installing `grpcio` (which I did from conda, rather than pip), `mlagents-learn --help` ran cleanly.
2024-03-06 14:57:22 +01:00
alex-mccarthy-unity e322b6160e
Fix nightly test runs (#6069)
* Specify python 3.10.12 for nightly runs

Both ml-agents and ml-agents-envs only allow Python versions <=3.10.12: make sure the nightly uses a valid version.

(We might want to consider allowing any 3.10 version so that we can be using the latest security bugfixes, such as 3.10.13: https://www.python.org/downloads/release/python-31013/ )

Sample failure of nightly full-pytest before: https://github.com/alex-mccarthy-unity/ml-agents/actions/runs/8152427823/job/22281884176
Sample passing run afterwards: https://github.com/alex-mccarthy-unity/ml-agents/actions/runs/8153333182/job/22284499278

* Fix dead links in documentation

Together with #6065, fix the `markdown-link-check-full` component of nightly runs.

Sample failing run before: https://github.com/alex-mccarthy-unity/ml-agents/actions/runs/8152427823/job/22281884377
Sample passing run after: https://github.com/alex-mccarthy-unity/ml-agents/actions/runs/8154489456/job/22288022888
2024-03-06 14:57:04 +01:00
alex-mccarthy-unity 3fc8d8ec22
Update links to PettingZoo homepage (#6065)
This new website was introduced in the docs for PettingZoo 1.21.0 in 2022: https://pypi.org/project/pettingzoo/1.21.0/
(compare to https://pypi.org/project/pettingzoo/1.20.1/ )
2024-03-06 14:56:11 +01:00
alex-mccarthy-unity 86a3a6e5f7
Fix pre-commit action failures: switch to ruby/setup-ruby (#6063)
Fixes pre-commit errors of the form:
```
Run actions/setup-ruby@v1
  with:
    ruby-version: 2.6
  env:
    pythonLocation: /opt/hostedtoolcache/Python/3.10.13/x64
    LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.10.13/x64/lib
    ImageOS: ubuntu20
------------------------
NOTE: This action is deprecated and is no longer maintained.
Please, migrate to https://github.com/ruby/setup-ruby, which is being actively maintained.
------------------------
Error: Version 2.6 not found
```

While we're upgrading this pre-commit, also upgrade from ruby 2.6 to ruby 2.7.
2024-03-04 14:46:49 +01:00
Miguel Alonso Jr f442194297
Fix yamato bokken images and perf tests (#6032)
* Updated yamato CI to use updated bokken images.

* Fixed performance tests.
2023-12-02 14:21:25 -05:00
Miguel Alonso Jr b14c4008ce
Added new 3DBall sample package. (#6030)
* Added new 3DBall sample package.

* Updated CHANGELOG.
2023-12-02 08:31:07 -05:00
Miguel Alonso Jr ee80a7f404
Fix tensor disposal (#6028)
* Upgraded to Sentis 1.3.0-pre.2

* Fixed tensor disposal bug in ModelRunner.
2023-11-30 07:20:16 -05:00
Miguel Alonso Jr 209d258dab
Fixed broken link issues in roller ball tutorial doc. (#6024) 2023-11-26 06:57:40 -05:00
Miguel Alonso Jr ffa2e8155f
Upgraded to pytorch 2.1.1, fixed some windows related test issues. Upgrade to Sentis 1.3.0-pre.2 (#6013)
* Upgraded to pytorch 2.1.1, fixed some windows related test issues.

* Upgraded to Sentis 1.3.0-pre.2

* Updated changelog.
2023-11-25 13:07:39 -05:00
Miguel Alonso Jr 98338f282b
Added no graphics monitor feature. (#6014)
* Added no graphics monitor feature.

* Fixed precommit issues.

* Fixed installation docs for incorrect python version causing conflicts in Windows.
2023-11-22 08:25:45 -05:00
Miguel Alonso Jr 643df3599f
Fix mkdocs (#6003)
* Fixed mkdocs config.

* Updated README.
2023-10-29 07:31:36 -04:00
Siddharth a6cf25ac37
Updated mkdocs.yml (#5957)
added feature to toggle between light and dark mode
2023-10-29 07:22:12 -04:00
Miguel Alonso Jr 8b86648e53
Updated references to Unity Inference Engine to Sentis. (#5998) 2023-10-15 06:57:02 -04:00
Miguel Alonso Jr f3dc8f6150
Bumped numpy version. (#5997)
* Bumped numpy version.

* Updated CHANGELOG.

* Lowered upper python version to <1.24
2023-10-11 06:56:16 -04:00
Miguel Alonso Jr 97386af74e Updated push to pypi gha. 2023-10-09 15:53:38 -04:00
Miguel Alonso Jr af47660898 Updated README version table. 2023-10-09 15:53:38 -04:00
Miguel Alonso Jr 005ace3889 Release fixes. 2023-10-09 15:53:38 -04:00
Miguel Alonso Jr a4973ce030 Updating release 20 -> release 21 in docs and docstrings. 2023-10-09 15:53:38 -04:00
Miguel Alonso Jr 44eb2bdf8f
Updated version numbers. (#5993) 2023-10-09 12:58:01 -04:00
Miguel Alonso Jr 9ff803a094
Updated changelog for release. (#5992) 2023-10-09 12:40:37 -04:00
Miguel Alonso Jr 8aa3c85036
Develop timeout (#5991)
* Added timeout cli.

* Updated docs.

* Updated mlagents learn cli test.
2023-10-09 12:19:08 -04:00
Miguel Alonso Jr 6203c7e2db
Updated lock gha. (#5990) 2023-10-08 18:19:12 -04:00
Miguel Alonso Jr e0f490f6f5
Updated installation instructions. Added installation instructions to doc home page. (#5989) 2023-10-08 11:57:35 -04:00
Miguel Alonso Jr fc2f79cd67
Updated installation instructions. (#5988) 2023-10-08 11:44:57 -04:00
Miguel Alonso Jr 7b55335e89
Updated docs. (#5986) 2023-10-06 15:47:17 -04:00
Miguel Alonso Jr 63b71a8d17
Updated yamato pytest GPU tests for torch 1.13.1 (#5985) 2023-10-05 20:23:13 -04:00
Miguel Alonso Jr fb24597b16
Develop sentis upgrade (#5979)
* Commiting changes.

* Initial barracuda 4 upgrade.

* Play mode tests passing.

* Edit mode tests passing.

* Training fixes.

* Fixed performance issue with stacking sensor.

* Fixed failing tests and issue with stacking sensor.

* Updated examples for barracuda 4 upgrade.

* Fixed issue with attention ONNX export w.r.t. dimensions.

* Fixed issue with Buffer Sensor and Recurrent In/Out.

* Retrained old policies and updated with ONNX policies. Deprecated old policy versions.

* Saving work.

* Saving work.

* Updating to Sentis 1.1.1-exp.2

* Fixed more errors with Sentis upgrade.

* Fixed tensor allocation issue in TensorUtils.ResizeTensor. Inference is working for 3DBall with Sentis.

* Fixed broken Sentis model links for some example environments.

* Fixed some broken edit mode tests.

* Fixed some failing tests.

* Fixing bugs with GPU inference on Sentis.

* Updated packages lock and onnx meta files.

* Refactoring all Barracuda related naming to Sentis.

* Python max version bump.

* Precommit fixes.

* Pinned tensorboard version

* Revert tensorboard version.

* Fixed rpc tests.

* Fixed failing python tests.

* Fixed some more failing tests. Added six as an explicit dependency due to tensorboard requirements.

* gha fix.

* Updated environment registry for Sentis.

* Fixed texture sensor test.

* Develop python 3.10 (#5981)

* Deprecated python 3.8.x and 3.9.x.

* Updated colab gha test to 3.10.12

* Updated colabs for Sentis and python 3.10.

* Test fix.

* Minor update to colabs.

* Develop torch 1.13.1 (#5982)

* Bumped PyTorch version to 1.13.1

* Added potential fixes to model overrider TBD at a later date.

* Updated changelog.

* Updated protobufs. (#5983)

* Updated training init tests to remove inference test temporarily. (#5984)
2023-10-05 18:28:39 -04:00
Miguel Alonso Jr 8bcedabd80
Updated DevProject physics settings to turn on autosync transforms. (#5960) 2023-08-07 18:32:02 -07:00
Miguel Alonso Jr 4ea89950c4
Update to 2022.3 LTS and batched raycasts (#5950)
* Updated to Unity 2022.3.

* Added support for batched raycasting in ray perception sensor. Only for 3D (batched raycasting is only supported in 3D).

* Added batched raycast tests and docs.

* Updated meta file validation exclude list.

* Added unity physics module dependency to core package.
2023-07-25 11:50:49 -07:00
Miguel Alonso Jr 4cfe3c02aa
Fixed ws on contributing.md. (#5953) 2023-07-24 11:06:19 -04:00