2c252cd59b
update model version ( #3436 )
2024-09-26 12:18:20 -07:00
2534233193
author renames ( #3374 )
2024-09-26 14:38:15 -04:00
c08d09e7af
Update Model eval components ( #3405 )
...
* Remove hard dependency of transformers
* Fix chat completion data formatting
* Update component versions
* Fix script syntax
---------
Co-authored-by: Ankush Bhatia <ankushbhatia@microsoft.com>
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
2024-09-26 10:26:38 -04:00
dc1d7d83c9
enable playground flag ( #3433 )
...
Co-authored-by: Ali Soylemezoglu <acsoylemezoglu@gmail.com>
2024-09-26 10:15:19 -04:00
f6ed9db5b8
Allow Azure-AI prefix for models ( #3431 )
...
* Allow Azure-AI prefix for models
* update
* flake
* flake brrr
* fix tests
2024-09-26 10:07:26 -04:00
b2f1cef09e
Update PTCA image to address torch vulnerabilities ( #3432 )
2024-09-25 15:36:20 -07:00
c21d38ae28
Grab latest version to the current repo ( #3413 )
...
Co-authored-by: vizhur <vizhur@microsoft.com>
2024-09-25 13:35:14 -07:00
9348a3dd93
Update torch version and dependencies in AutoML NLP CE ( #3394 )
...
* Update torch version and dependencies in AutoML NLP CE to address vulnerabilities
* Removed a duplicate horovod pip install
* Fixed the format to pin to the latest mcr tag and pypi versions
* Revert aiohttp version
---------
Co-authored-by: jeff-shepherd <39775772+jeff-shepherd@users.noreply.github.com>
2024-09-25 11:13:53 -07:00
16a708aed4
remove flag for phi 3.5 moe ( #3430 )
2024-09-25 17:34:06 +00:00
e4b6042a67
batch score for oss ( #3387 )
...
* batch score for oss
* update src
* update file structure
* update
* fix tests
* update tests
* update for e2e test
* fix entry script
* uncomment default API type
* address comments
* return None by default
* fix flakes
* Update assets/batch_score/components/driver/src/batch_score_oss/aoai/scoring/aoai_response_handler.py
Co-authored-by: Sasidhar Kasturi <sasik@microsoft.com>
* Update assets/batch_score/components/driver/src/batch_score_oss/aoai/scoring/aoai_scoring_client.py
Co-authored-by: Sasidhar Kasturi <sasik@microsoft.com>
* Update docs
* fix flake
* e2e .version file does not exists, fix
* keep batch_score intanct. Move changes to batch_score_oss
* revert
* add oss wf
* update wf name
* Increase lock timeout
* fix asset version issue
* fix path
---------
Co-authored-by: Sasidhar Kasturi <sasik@microsoft.com>
2024-09-25 13:31:37 -04:00
d4585beefd
refactor phi 3.5 moe model card to fit catalog template ( #3427 )
...
Co-authored-by: Ali Soylemezoglu <acsoylemezoglu@gmail.com>
2024-09-25 08:46:54 -07:00
6d02473dd5
Add Benchmark tags to models ( #3367 )
...
Co-authored-by: Ankush Bhatia <ankushbhatia@microsoft.com>
2024-09-25 12:06:29 +05:30
a1b1203e59
Add math based evaluators ( #3424 )
...
* add new ui eval flow
* use different flow name
* update
* add test_config.json for the new flow
* fix the ci error
* address spell error
* add math evaluators
* update the description
---------
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
Co-authored-by: vizhur <vizhur@microsoft.com>
2024-09-24 20:23:49 -07:00
34d2e76af2
Update OSS components versions ( #3426 )
2024-09-24 22:56:37 +05:30
5e290e4b61
Upgrade test resource python version to 3.10 ( #3421 )
...
Co-authored-by: lykelly19 <kellyly@microsoft.com>
2024-09-24 15:00:01 +00:00
9b88fc5082
Allow data assets to use azcopy from external storage account & refactor models code ( #3317 )
...
* Allow data assets to use azcopy form external storage account usage & refactor models code
* update
* rename from model_utils to registry_utils
* some scripts-syntax updates
* more scripts-syntax changes
* more cleanup
* Update CHANGELOG and setup.py
* update spacing
* syntax
* move pluralize_asset_type to registry_utils
* spacing
* update import
* rename function
* spacing
* update docstring
* Update scripts/azureml-assets/CHANGELOG.md
Co-authored-by: Louie Larson <elesel@gmail.com>
* Update types and condition check
* update version
* add space
---------
Co-authored-by: lykelly19 <kellyly@microsoft.com>
Co-authored-by: Louie Larson <elesel@gmail.com>
2024-09-24 14:46:18 +00:00
504f207cfd
Update import model component to make use of updated env ( #3418 )
2024-09-24 19:59:25 +05:30
3e7589ef70
upgrade rag component env to fix vulnerable images icm ( #3422 )
...
* upgrade rag env to fix vulnerable images icm
* try
* upgrade
* upgrade ntkl
2024-09-23 20:09:31 -07:00
1984620b69
Release rai_eval_ui_dag_flow v2 to make connection optional for generate answer node ( #3423 )
...
* Update model.yaml
* Update spec.yaml
2024-09-23 16:13:30 -07:00
440a67971b
Enable debug for tensorflow image ( #3419 )
2024-09-23 10:15:01 -07:00
dd5058c048
Update assets validation to use check-changed-files job to be able to require status check ( #3333 )
...
* Update assets validation to run on all assets
* Rename from sample_component to my_sample
* update sample component
* use new check-directory-file-changes job
* update read access
* update forked_pr_input
* add missing quote
---------
Co-authored-by: lykelly19 <kellyly@microsoft.com>
2024-09-23 16:31:04 +00:00
1889c037b3
Update fmi ( #3417 )
2024-09-23 16:27:44 +00:00
12755eacfe
Fix DBCopilot Environment Vulnerabilities ( #3416 )
2024-09-23 11:06:05 +08:00
3def597faa
Update API type based on merged scoring url ( #3369 )
...
* Update API type based on merged scoring url
* address comment
2024-09-21 04:51:13 +00:00
fc1f599361
update vision component ( #3415 )
2024-09-20 18:38:51 -07:00
90193834c4
pin opencv ( #3409 )
2024-09-20 21:06:58 +00:00
1134373522
Add new UI eval flow ( #3411 )
...
* add new ui eval flow
* use different flow name
* update
* add test_config.json for the new flow
* fix the ci error
* address spell error
---------
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
Co-authored-by: vizhur <vizhur@microsoft.com>
2024-09-20 15:36:44 -04:00
c8033d4e6d
Add built-in promptflow evaluators ( #3401 )
...
* Add xpia, eci, and ip evaluators
* Improve descriptions
* Remove hiddenlayersscanned field
* Remove show_artifact and default_display file
* Update descriptions
2024-09-20 19:20:07 +00:00
ef25f1b2ef
Revert "Add new UI eval flow ( #3403 )" ( #3410 )
...
This reverts commit 87fb836f4c
2024-09-20 15:03:31 -04:00
87fb836f4c
Add new UI eval flow ( #3403 )
...
* add new ui eval flow
* use different flow name
* update
* add test_config.json for the new flow
* fix the ci error
2024-09-20 18:57:36 +00:00
b46e77c04d
3506888 update in microsoft-phi-1-5 artifacts ( #3404 )
2024-09-20 23:13:12 +05:30
3e56e43a00
Validation Bug Fix ( #3408 )
...
* validationBug Fix
* Fixed version as per registry
2024-09-20 10:15:32 +00:00
b89e4b2258
Telemetry logs for benchmark result aggregator ( #3303 )
...
* Added telemetry logs for benchmarking component.
* fix the telemetry logging
* updated telemetry logic
* Linter fixes
* Linter Fixes
* Update the telemetry for mmlu
* Fix linter
* Fix for failing test : dataset_downloader_component
* Fix the failing test
* Fix for failing test
* Updates for telemetry
* Updated telemetry logs.
* bumping component version for benchmark aggregator.
* Removed unused imports
* Lint fixes
* Lint fixes
---------
Co-authored-by: Rahul Kumar <74648335+iamrk04@users.noreply.github.com>
2024-09-20 06:02:11 +00:00
526d20e364
Fixed pystan conflict ( #3402 )
2024-09-19 17:09:09 -07:00
011a3b7896
Fix pystan conflict ( #3400 )
2024-09-19 15:09:45 -07:00
3b692272a4
upgrade components ( #3397 )
2024-09-19 09:39:55 -07:00
febcbbc981
Update Dockerfile ( #3398 )
...
Strict pinning cryptography to 43.0.1
2024-09-19 10:30:18 +00:00
6560bc61b4
[Model Evaluation] Update Model Evaluation Components ( #3391 )
...
* Update Model Evaluation Components
* Update env asset id
* Enable inference config
---------
Co-authored-by: Ankush Bhatia <ankushbhatia@microsoft.com>
2024-09-19 10:46:35 +05:30
8fd46c59c7
Fix DBCopilot Vulnerabilities ( #3396 )
...
* Fix DBCopilot Vulnerabilities
* fix
2024-09-19 09:28:55 +08:00
2bcd17572a
Upgraded to PyTorch 2.2.2 and master branch horovod ( #3388 )
2024-09-18 09:34:28 -07:00
7495d4b955
[Vision & Multimodal] addressing vulnerabilities ( #3358 )
...
* addressing vulnerabilities
* update azure-ai-ml
2024-09-18 15:10:06 +05:30
1486fd4d12
Update DBCopilot environment ( #3392 )
...
* Update DBCopilot version
* Update dbcopilot score script
* fix
* fix
* fix
2024-09-18 16:09:48 +08:00
b4d79920f9
update forecasting component version ( #3390 )
2024-09-18 10:40:32 +05:30
64d1adc6f8
Update dbcopilot score script ( #3366 )
...
* Update DBCopilot version
* Update dbcopilot score script
* fix
* fix
2024-09-18 10:09:08 +08:00
01e708f7af
rai-qna-quality-safety-eval flow Version 3 with answer generation functionality with input model_prompt object ( #3386 )
...
* Update model.yaml
* Update spec.yaml
2024-09-17 19:39:19 +00:00
745abf086e
remove nc24 from whisper-large and whisper-large-v3 ( #3385 )
2024-09-17 22:23:47 +05:30
30a6fa21af
update to 0.2.11 version ( #3384 )
2024-09-17 16:42:38 +00:00
94e6abed0a
Assets for SD on COCO ( #3342 )
...
* Assets for SD on COCO.
* Vision evaluation type and two vision tasks.
* Update format of file for SD on MSCOCO.
2024-09-17 09:41:02 -07:00
529ecb8e35
Update scripts-test, assets-test, and environments-ci with new path filtering job ( #3355 )
...
* Update scripts-test PR path filters
* Path filter in separate job
* [testing] add test file
* Update to use all_changed_and_modified_files_count
* [testing] modified change
* update
* remove path filter for testing
* update fetch-depth
* [testing] update workflows
* update echos
* update logging
* another test
* update logic
* update logic 2
* update condition
* update needs
* separate checking changed files job into different file
* update branch usage
* Pass in and use variables
* update naming
* reorder jobs
* fix
* update needs
* update needs/if
* update needs w/ 2 jobs
* update inputs to changed files
* update forked_pr input and cloning action usage
* comment
* update inputs
* comment
* uncomment
* update for test
* update to string type
* Update assets-test
* Update checking changed files output to list of changed files instead of bool
* add test asset and update environments-ci action too
* remove path from environments-ci
* update environments-ci.yaml
* update input
* update input
* remove comment
* Add environment
* remove sha input for testing
* comment
* update inputs
* remove sha input var
* remove env
* some cleanup
* remove test files
* update branch to main
---------
Co-authored-by: Kelly <kellyly@microsoft.com>
2024-09-17 15:54:58 +00:00
c126dca1fa
Update cryptography ( #3380 )
2024-09-17 08:51:57 -07:00
cassieesvelt
vechillal
Ankush Bhatia
Jeff Omhover
vizhur
raviskolli
liangjason87
Ayush Mishra
Billy Hu
aggarwal-k
Kelly
abhishekMS2024
runhli
tongy-msft
jeff-shepherd
QianqianNie
XiangRao
Ruby Zhu
Diondra
utkshukla
vikasagrawal-ms
HarshaVardhanBabu
Nilesh Vijayrania
Rupal jain
Rahul Kumar
kgullapally
rdondera-microsoft