4f983518a6
Fix the issue with supporting new evaluationresult asset types ( #3544 )
...
* updating model evaluation environment with modelling_llama patch.
* add cost, quality, performance tags for evaluationresult.
* reverting the changes for transformers patch.
* updating the changelog and bump up the version.
* fix the issue with supporting new evaluationresult assets.
* updated the change log file.
* updating the test cases.
* updating the test cases.
* fixing unit tests.
* fixing change log file.
---------
Co-authored-by: Chandra Sekhar Gupta Aravapalli <caravapalli@microsoft.com>
2024-11-04 08:34:59 +05:30
f6ed9db5b8
Allow Azure-AI prefix for models ( #3431 )
...
* Allow Azure-AI prefix for models
* update
* flake
* flake brrr
* fix tests
2024-09-26 10:07:26 -04:00
5e290e4b61
Upgrade test resource python version to 3.10 ( #3421 )
...
Co-authored-by: lykelly19 <kellyly@microsoft.com>
2024-09-24 15:00:01 +00:00
99c48b3638
Validation for vision results ( #3377 )
...
* Validation for vision results.
* Changelog and setup updates.
2024-09-16 16:46:18 -07:00
c816362a65
Upgrade test resource python version to 3.10 ( #3349 )
...
Co-authored-by: Kelly <kellyly@microsoft.com>
Co-authored-by: Louie Larson <elesel@gmail.com>
2024-09-09 14:22:26 +00:00
4195df9c58
Upgrade dependencies from Python 3.8 to 3.10 ( #3346 )
...
Co-authored-by: Kelly <kellyly@microsoft.com>
2024-09-06 15:09:02 -04:00
259d038767
Run scripts-syntax on all files and update issues to unblock gate ( #3326 )
...
* Move path filtering to unblock status check requirements
* Update condition
* Update variable
* test using 2 jobs
* update types
* revert some changes
* duplicated gate for testing
* [testing] variables update
* [testing] add python script for testing
* [testing] update job dependency
* [testing] use new output var
* [testing] revert small change
* [testing] echo statement
* [testing] use env var and update test py script
* [testing] update condition
* [testing] remove if condition
* [testing] update if for job 2 and more testing
* [testing] update condition
* [testing] update again
* [testing] var update
* [testing] run scripts-syntax on all files
* Update files based on scripts-syntax
* Update spacing
* [scripts-syntax] updates 2
* [scripts-syntax] update copyright
* [scripts-syntax] update spacing
* [scripts-syntax] add new line
* [scripts-syntax] more updates
* [scripts-syntax] update again
* [scripts-syntax] update
* Remove testing gate and update scripts-syntax to run on all files
* remove if condition
* remove test file
---------
Co-authored-by: lykelly19 <kellyly@microsoft.com>
2024-09-04 15:17:08 -04:00
18249adf35
Return string value instead of Path if string doesn't resolve to a path ( #3254 )
...
* fix
* fix
* fix
* fix
* fix
* fix
---------
Co-authored-by: Ali Soylemezoglu <alisoy@microsoft.com>
2024-08-12 16:49:35 -04:00
d5d4c09ebf
Upgrade from Python 3.8 dependency to 3.10 for test assets ( #3147 )
...
Co-authored-by: Kelly <kellyly@microsoft.com>
2024-07-12 14:23:32 -07:00
d45f3796fd
Revert "save"
...
This reverts commit f845a5dc277a54b91f3a
2024-07-01 14:10:32 -04:00
f845a5dc27
save
2024-07-01 13:39:37 -04:00
4255905416
Add embeddings asset and update embeddings asset' task type ( #2956 )
...
* add and update embeddings asset
* update task types for text embeddings
* update CHANGELOG
* update test
2024-05-22 12:56:16 +05:30
a0df559b5d
Add EvaluationResult assets for embeddings ( #2923 )
...
* update asset validation for evaluationresult
* fix code style
* add tests and fix PR comments
* update setup.py and CHANGELOG
* update setup.py
* add embeddings result
* fix typo
* update logic
2024-05-17 04:45:33 -07:00
3d0e59dbcd
add hiddenlayerscanned tags valdn ( #2907 )
...
* add hiddenlayerscanned tags valdn
* update error msg
* update spec
* fix img build failure
* address comments
* update
2024-05-16 21:49:21 +05:30
29439c3b90
Exclude yanked version for latest-pypi-version ( #2637 )
...
* mlflow upgrade
* Upgrade base image pytorch version
* Exclude yanked versions
* Test package version changes
* Fix tests
* Fix tests
* Add changelog
2024-04-03 12:06:16 -04:00
7a1a0f8cc0
Exclude yanked version for latest-pypi-version ( #2637 )
...
* mlflow upgrade
* Upgrade base image pytorch version
* Exclude yanked versions
* Test package version changes
* Fix tests
* Fix tests
* Add changelog
2024-04-03 12:06:16 -04:00
90e707c81b
Fix for pinning package version with extras ( #2476 )
...
* Fix for pinning package version with extras
* Adding unit tests, Updating CHANGELOG, setup.py
* Fixing gate
---------
Co-authored-by: Sarthak Singhal <sarsinghal@microsoft.com>
2024-03-11 19:31:35 +05:30
5b55d7c2e5
Fix for pinning package version with extras ( #2476 )
...
* Fix for pinning package version with extras
* Adding unit tests, Updating CHANGELOG, setup.py
* Fixing gate
---------
Co-authored-by: Sarthak Singhal <sarsinghal@microsoft.com>
2024-03-11 19:31:35 +05:30
816703443d
Update model valdn for shared quota usage ( #2031 )
...
* Update model valdn for shared quota usage
* update res
* address comments
* fix flakes
2024-01-03 17:16:40 +05:30
d25b1e3834
Update model valdn for shared quota usage ( #2031 )
...
* Update model valdn for shared quota usage
* update res
* address comments
* fix flakes
2024-01-03 17:16:40 +05:30
9380dddf36
Model spec validation ( #1909 )
...
* Add supported sku json
* fix flakes
* fix flakes
* update
* update
* Address comments
* test model spec change
* flakes nuisance
* update error count
* remove mlclient init
* fix
* fix
* update and test
* update
* fix flakes again
* Update scripts/azureml-assets/azureml/assets/config.py
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
* Update scripts/azureml-assets/azureml/assets/validate_assets.py
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
* Update scripts/azureml-assets/azureml/assets/validate_assets.py
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
* Update scripts/azureml-assets/azureml/assets/validate_assets.py
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
* Update scripts/azureml-assets/azureml/assets/validate_assets.py
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
* Update scripts/azureml-assets/azureml/assets/config.py
Co-authored-by: Louie Larson <elesel@gmail.com>
* Update scripts/azureml-assets/azureml/assets/validate_assets.py
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
* address comments
* remove system registry name ref
* update tests
* load model in try-catch
* update
* Update
* Add validation for enabling shared compute quota
* just check in key
* Lint killing me
* Update test res
* Update test res
* update res
* update res
---------
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
Co-authored-by: Louie Larson <elesel@gmail.com>
2023-12-20 21:28:26 +05:30
38552ebe67
Model spec validation ( #1909 )
...
* Add supported sku json
* fix flakes
* fix flakes
* update
* update
* Address comments
* test model spec change
* flakes nuisance
* update error count
* remove mlclient init
* fix
* fix
* update and test
* update
* fix flakes again
* Update scripts/azureml-assets/azureml/assets/config.py
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
* Update scripts/azureml-assets/azureml/assets/validate_assets.py
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
* Update scripts/azureml-assets/azureml/assets/validate_assets.py
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
* Update scripts/azureml-assets/azureml/assets/validate_assets.py
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
* Update scripts/azureml-assets/azureml/assets/validate_assets.py
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
* Update scripts/azureml-assets/azureml/assets/config.py
Co-authored-by: Louie Larson <elesel@gmail.com>
* Update scripts/azureml-assets/azureml/assets/validate_assets.py
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
* address comments
* remove system registry name ref
* update tests
* load model in try-catch
* update
* Update
* Add validation for enabling shared compute quota
* just check in key
* Lint killing me
* Update test res
* Update test res
* update res
* update res
---------
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
Co-authored-by: Louie Larson <elesel@gmail.com>
2023-12-20 21:28:26 +05:30
32a4c6a2bc
Support conda environments for pytest ( #1964 )
2023-12-15 11:47:34 -05:00
0aa57a6f5f
Support conda environments for pytest ( #1964 )
2023-12-15 11:47:34 -05:00
63a83f0744
Update model validations criteria ( #1871 )
...
* Update model validations criteria
* add
* update
* fix flakes
* fix flakes
* fix test
* fix test
* Update version
* update
* fix
* add test category
* fix flake
* add
* update
* fix flakes
* fix flakes
* update
* fix flakes
2023-12-05 18:59:07 +05:30
76fbcbdddb
Make sure model is validated before release ( #1569 )
...
* Make sure model is validated before release
* fix flakes
* fix tests by making model validation dir as optional
* fix tests
* update tests to scan model validation results
* update tests
* fix flakes
* add docs
2023-10-27 10:05:04 +05:30
f376222f31
Validate build context ( #1344 )
2023-10-02 10:03:04 -04:00
c74585a7a9
Allow "microsoft" to appear in model names ( #1030 )
2023-08-11 09:04:20 -04:00
91947fdfb8
Extract asset dependencies ( #992 )
2023-08-07 14:12:24 -04:00
1196fe6004
Prevent "FROM <CE image>" in Dockerfiles ( #962 )
...
* Prevent "FROM <CE image>" in Dockerfiles
* [testing] changed file referencing CE image
* Update log error message
* Update unit tests for check_dockerfile
* Apply suggestions from code review
Co-authored-by: Louie Larson <elesel@gmail.com>
* Remove check_dockerfile param
* Remove Dockerfile testing change and remove test section from asset.yaml
* Remove check_dockerfile reference
* Update test_validate_assets.py with correct expected result
* Create unit test for Dockerfile with comment
* Update Dockerfile comment and replace CRLF to LF
* Fix errors from scripts-syntax
* Upload files for new test (set git config core.autocrlf to false)
* Update test folder names and corresponding test_validate_assets.py
* Add period for scripts-syntax error
---------
Co-authored-by: Kelly Ly <kellyly@microsoft.com>
Co-authored-by: Louie Larson <elesel@gmail.com>
2023-08-03 09:50:58 -07:00
5aaa1975f9
Handle path param for data assets ( #907 )
2023-07-19 12:02:26 -04:00
1dee8b3ef4
Make output directory optional ( #902 )
2023-07-18 16:45:49 -04:00
5a0cfd8953
Make release dir optional for update_assets ( #821 )
...
* Make release dir optional for update_assets
* Add a test that doesn't require a release directory
2023-07-18 10:37:28 -04:00
5a67f48bbf
Add regex arg to skip name validation ( #847 )
2023-07-06 09:00:52 -04:00
b10bf6a8bf
Make AssetConfig hashable, add DeployConfig.should_create ( #777 )
2023-06-23 11:27:53 -04:00
18476209d5
Add deploy config classes ( #736 )
2023-06-08 14:59:28 -04:00
bda14c3711
Revert "Add deploy config classes and tests"
...
This reverts commit 2e98606451
2023-06-08 13:13:42 -04:00
2e98606451
Add deploy config classes and tests
2023-06-08 13:07:25 -04:00
8e8f4e9d64
Bump requests ( #689 )
...
Bumps [requests](https://github.com/psf/requests ) from 2.27.1 to 2.31.0.
- [Release notes](https://github.com/psf/requests/releases )
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md )
- [Commits](https://github.com/psf/requests/compare/v2.27.1...v2.31.0 )
---
updated-dependencies:
- dependency-name: requests
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-23 10:58:45 -04:00
24607aa087
Create copyright validation test
2023-05-01 13:03:33 -04:00
79eaf6a684
Relax copyright check in Python scripts
2023-05-01 12:41:02 -04:00
2d8cbb2b67
Handle description files ( #522 )
...
* Handle description files
* Convert everything in this repo to ruamel.yaml
* Fix list formatting
2023-04-07 16:24:52 -04:00
8bd3ceac5a
Validate asset names, environment build/publishing ( #425 )
2023-03-09 12:29:30 -05:00
885c7321e5
Enable filtering via regex ( #372 )
2023-02-02 12:54:48 -05:00
70ed77ab3d
Remove environment metadata (use tags instead) ( #366 )
...
looks like safe to bypass
2023-02-01 12:24:06 -05:00
aaaf09970b
Make AssetConfig objects sortable ( #321 )
...
* Make AssetConfig objects sortable
* Use fake image names for tests
* Use fake-image-name base image where possible
2023-01-06 17:20:06 -05:00
ef7f3a7191
Refactor scripts directory ( #306 )
...
* Refactor scripts directory
* Execute test_assets via subprocess
2022-12-28 16:25:12 -05:00
a62e694dee
Add documentation to config.py ( #266 )
...
* Add documentation to config.py and related classes
2022-11-02 13:33:30 -04:00
723e44406e
Fix unreleased asset skipping behavior ( #186 )
2022-09-08 14:10:10 -04:00
62cadfac82
Use external testing sub ( #170 )
...
* Use OIDC for Azure login
* Create daily resources on run
* Switch to external testing sub
2022-08-29 19:37:22 -04:00
Chandra Sekhar Gupta
vizhur
Kelly
rdondera-microsoft
Ali Soylemezoglu
Grace Bramley-Simmons
Rahul Kumar
Ayush Mishra
Nilesh Vijayrania
sarthaks95
Louie Larson
Louie Larson
dependabot[bot]