3e7589ef70
upgrade rag component env to fix vulnerable images icm ( #3422 )
...
* upgrade rag env to fix vulnerable images icm
* try
* upgrade
* upgrade ntkl
2024-09-23 20:09:31 -07:00
1984620b69
Release rai_eval_ui_dag_flow v2 to make connection optional for generate answer node ( #3423 )
...
* Update model.yaml
* Update spec.yaml
2024-09-23 16:13:30 -07:00
440a67971b
Enable debug for tensorflow image ( #3419 )
2024-09-23 10:15:01 -07:00
dd5058c048
Update assets validation to use check-changed-files job to be able to require status check ( #3333 )
...
* Update assets validation to run on all assets
* Rename from sample_component to my_sample
* update sample component
* use new check-directory-file-changes job
* update read access
* update forked_pr_input
* add missing quote
---------
Co-authored-by: lykelly19 <kellyly@microsoft.com>
2024-09-23 16:31:04 +00:00
1889c037b3
Update fmi ( #3417 )
2024-09-23 16:27:44 +00:00
12755eacfe
Fix DBCopilot Environment Vulnerabilities ( #3416 )
2024-09-23 11:06:05 +08:00
3def597faa
Update API type based on merged scoring url ( #3369 )
...
* Update API type based on merged scoring url
* address comment
2024-09-21 04:51:13 +00:00
fc1f599361
update vision component ( #3415 )
2024-09-20 18:38:51 -07:00
90193834c4
pin opencv ( #3409 )
2024-09-20 21:06:58 +00:00
1134373522
Add new UI eval flow ( #3411 )
...
* add new ui eval flow
* use different flow name
* update
* add test_config.json for the new flow
* fix the ci error
* address spell error
---------
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
Co-authored-by: vizhur <vizhur@microsoft.com>
2024-09-20 15:36:44 -04:00
c8033d4e6d
Add built-in promptflow evaluators ( #3401 )
...
* Add xpia, eci, and ip evaluators
* Improve descriptions
* Remove hiddenlayersscanned field
* Remove show_artifact and default_display file
* Update descriptions
2024-09-20 19:20:07 +00:00
ef25f1b2ef
Revert "Add new UI eval flow ( #3403 )" ( #3410 )
...
This reverts commit 87fb836f4c
2024-09-20 15:03:31 -04:00
87fb836f4c
Add new UI eval flow ( #3403 )
...
* add new ui eval flow
* use different flow name
* update
* add test_config.json for the new flow
* fix the ci error
2024-09-20 18:57:36 +00:00
b46e77c04d
3506888 update in microsoft-phi-1-5 artifacts ( #3404 )
2024-09-20 23:13:12 +05:30
3e56e43a00
Validation Bug Fix ( #3408 )
...
* validationBug Fix
* Fixed version as per registry
2024-09-20 10:15:32 +00:00
b89e4b2258
Telemetry logs for benchmark result aggregator ( #3303 )
...
* Added telemetry logs for benchmarking component.
* fix the telemetry logging
* updated telemetry logic
* Linter fixes
* Linter Fixes
* Update the telemetry for mmlu
* Fix linter
* Fix for failing test : dataset_downloader_component
* Fix the failing test
* Fix for failing test
* Updates for telemetry
* Updated telemetry logs.
* bumping component version for benchmark aggregator.
* Removed unused imports
* Lint fixes
* Lint fixes
---------
Co-authored-by: Rahul Kumar <74648335+iamrk04@users.noreply.github.com>
2024-09-20 06:02:11 +00:00
7aa4706377
Merge remote-tracking branch 'origin/main'
2024-09-20 11:30:48 +05:30
526d20e364
Fixed pystan conflict ( #3402 )
2024-09-19 17:09:09 -07:00
011a3b7896
Fix pystan conflict ( #3400 )
2024-09-19 15:09:45 -07:00
3b692272a4
upgrade components ( #3397 )
2024-09-19 09:39:55 -07:00
febcbbc981
Update Dockerfile ( #3398 )
...
Strict pinning cryptography to 43.0.1
2024-09-19 10:30:18 +00:00
6560bc61b4
[Model Evaluation] Update Model Evaluation Components ( #3391 )
...
* Update Model Evaluation Components
* Update env asset id
* Enable inference config
---------
Co-authored-by: Ankush Bhatia <ankushbhatia@microsoft.com>
2024-09-19 10:46:35 +05:30
8fd46c59c7
Fix DBCopilot Vulnerabilities ( #3396 )
...
* Fix DBCopilot Vulnerabilities
* fix
2024-09-19 09:28:55 +08:00
2bcd17572a
Upgraded to PyTorch 2.2.2 and master branch horovod ( #3388 )
2024-09-18 09:34:28 -07:00
7495d4b955
[Vision & Multimodal] addressing vulnerabilities ( #3358 )
...
* addressing vulnerabilities
* update azure-ai-ml
2024-09-18 15:10:06 +05:30
1486fd4d12
Update DBCopilot environment ( #3392 )
...
* Update DBCopilot version
* Update dbcopilot score script
* fix
* fix
* fix
2024-09-18 16:09:48 +08:00
b4d79920f9
update forecasting component version ( #3390 )
2024-09-18 10:40:32 +05:30
64d1adc6f8
Update dbcopilot score script ( #3366 )
...
* Update DBCopilot version
* Update dbcopilot score script
* fix
* fix
2024-09-18 10:09:08 +08:00
01e708f7af
rai-qna-quality-safety-eval flow Version 3 with answer generation functionality with input model_prompt object ( #3386 )
...
* Update model.yaml
* Update spec.yaml
2024-09-17 19:39:19 +00:00
745abf086e
remove nc24 from whisper-large and whisper-large-v3 ( #3385 )
2024-09-17 22:23:47 +05:30
30a6fa21af
update to 0.2.11 version ( #3384 )
2024-09-17 16:42:38 +00:00
94e6abed0a
Assets for SD on COCO ( #3342 )
...
* Assets for SD on COCO.
* Vision evaluation type and two vision tasks.
* Update format of file for SD on MSCOCO.
2024-09-17 09:41:02 -07:00
529ecb8e35
Update scripts-test, assets-test, and environments-ci with new path filtering job ( #3355 )
...
* Update scripts-test PR path filters
* Path filter in separate job
* [testing] add test file
* Update to use all_changed_and_modified_files_count
* [testing] modified change
* update
* remove path filter for testing
* update fetch-depth
* [testing] update workflows
* update echos
* update logging
* another test
* update logic
* update logic 2
* update condition
* update needs
* separate checking changed files job into different file
* update branch usage
* Pass in and use variables
* update naming
* reorder jobs
* fix
* update needs
* update needs/if
* update needs w/ 2 jobs
* update inputs to changed files
* update forked_pr input and cloning action usage
* comment
* update inputs
* comment
* uncomment
* update for test
* update to string type
* Update assets-test
* Update checking changed files output to list of changed files instead of bool
* add test asset and update environments-ci action too
* remove path from environments-ci
* update environments-ci.yaml
* update input
* update input
* remove comment
* Add environment
* remove sha input for testing
* comment
* update inputs
* remove sha input var
* remove env
* some cleanup
* remove test files
* update branch to main
---------
Co-authored-by: Kelly <kellyly@microsoft.com>
2024-09-17 15:54:58 +00:00
c126dca1fa
Update cryptography ( #3380 )
2024-09-17 08:51:57 -07:00
ce2fbbf140
Maap components update ( #3381 )
...
Co-authored-by: Anubha Jain <anubhajain@microsoft.com>
2024-09-17 20:21:13 +05:30
6d90b29444
Feature/whisper large nc24remove ( #3383 )
...
* Openai-whisper-large deployment failing fix
* remove nc24 from whisper large
2024-09-17 19:57:28 +05:30
0c4e238908
fix import error for sklearn forecasting model ( #3382 )
2024-09-17 17:29:03 +05:30
99c48b3638
Validation for vision results ( #3377 )
...
* Validation for vision results.
* Changelog and setup updates.
2024-09-16 16:46:18 -07:00
fefc90c4e0
Add asset category for automl components ( #3368 )
2024-09-16 20:43:00 +00:00
519a9092ab
Updating RAI Vision Image with updated opencv-python-headless version ( #3379 )
2024-09-16 14:13:09 -04:00
1255c131b7
Update model evaluation environment to remove dependency on transformers patch version. ( #3378 )
...
* updating model evaluation environment with modelling_llama patch.
* updating model evaluation environment to remove transformers patch.
* removing pinned dependency for pydantic due to conflict with azureml-defaults.
---------
Co-authored-by: Chandra Sekhar Gupta Aravapalli <caravapalli@microsoft.com>
2024-09-16 22:12:08 +05:30
c9a9ca129b
Merge remote-tracking branch 'origin/main'
2024-09-16 13:25:18 +05:30
6f0186cd4b
Update model evaluation env version for Batch resource manager ( #3375 )
...
Co-authored-by: Ankush Bhatia <ankushbhatia@microsoft.com>
2024-09-16 13:24:11 +05:30
888348ac42
component changes for phi 3.5 ( #3372 )
...
* component changes for phi 3.5
* component changes for phi 3.5
* component changes for phi 3.5
* component changes for phi 3.5
---------
Co-authored-by: Anubha Jain <anubhajain@microsoft.com>
2024-09-16 11:20:05 +05:30
b940da8def
Update RAI component to new versions and peg tabular & vision components to latest envs ( #3376 )
2024-09-13 17:40:01 -07:00
5a103d1d8d
Feature/openai whisper large v3 fix ( #3373 )
...
* Openai-whisper-large v3 deployment failing fix
* openai-whisper-large-v3 deployment fail fix
2024-09-13 22:52:45 +05:30
f8b4907aa8
Openai-whisper-large deployment failing fix ( #3370 )
2024-09-13 21:46:34 +05:30
d0cc859d6a
bump forecasting components ( #3371 )
2024-09-13 17:11:55 +05:30
1f8c5b2b75
Add phi3.5 vision evaluation, notes and turn on free playground ( #3365 )
...
* add phi3.5 vision changes
* fix input modalities
---------
Co-authored-by: himanshu chandola <himanshu@himanshus-MacBook-Air.local>
2024-09-12 10:35:37 -07:00
19da8e034b
Fix the postprocessing script of human eval dataset ( #3363 )
...
* Ccozianu/rm bug fix (#2247 )
* add more logs
* fix stdout logs
* Make sure we recover details
* Make sure we recover details (#2238 )
* SystemLog: prefix logging
* Ccozi/temp logging fix (#2246 )
* Make sure we recover details
* SystemLog: prefix logging
* Adding more detailed logging
---------
Co-authored-by: svaruag <gasi@microsoft.com>
* Ccozianu/rm bug fix (#2248 )
* add more logs
* fix stdout logs
* Make sure we recover details
* Make sure we recover details (#2238 )
* SystemLog: prefix logging
* Ccozi/temp logging fix (#2246 )
* Make sure we recover details
* SystemLog: prefix logging
* Adding more detailed logging
* Fixing typo
---------
Co-authored-by: svaruag <gasi@microsoft.com>
* Ccozianu/rm bug fix (#2259 )
* add more logs
* fix stdout logs
* Make sure we recover details
* Make sure we recover details (#2238 )
* SystemLog: prefix logging
* Ccozi/temp logging fix (#2246 )
* Make sure we recover details
* SystemLog: prefix logging
* Adding more detailed logging
* Fixing typo
* fix NPE in logging
* Cleaned up somehwat dependence on status definitions
---------
Co-authored-by: svaruag <gasi@microsoft.com>
* Ccozianu/4office debug (#2273 )
* add more logs
* fix stdout logs
* Make sure we recover details
* Make sure we recover details (#2238 )
* SystemLog: prefix logging
* Ccozi/temp logging fix (#2246 )
* Make sure we recover details
* SystemLog: prefix logging
* Adding more detailed logging
* Fixing typo
* fix NPE in logging
* Cleaned up somehwat dependence on status definitions
* handle folder
* Added finetuned_start_timeout_seconds
---------
Co-authored-by: svaruag <gasi@microsoft.com>
* Ccozianu/4office debug (#2275 )
* add more logs
* fix stdout logs
* Make sure we recover details
* Make sure we recover details (#2238 )
* SystemLog: prefix logging
* Ccozi/temp logging fix (#2246 )
* Make sure we recover details
* SystemLog: prefix logging
* Adding more detailed logging
* Fixing typo
* fix NPE in logging
* Cleaned up somehwat dependence on status definitions
* handle folder
* Added finetuned_start_timeout_seconds
* Fix typo in main invocation
---------
Co-authored-by: svaruag <gasi@microsoft.com>
* Ccozianu/4office debug (#2292 )
* add more logs
* fix stdout logs
* Make sure we recover details
* Make sure we recover details (#2238 )
* SystemLog: prefix logging
* Ccozi/temp logging fix (#2246 )
* Make sure we recover details
* SystemLog: prefix logging
* Adding more detailed logging
* Fixing typo
* fix NPE in logging
* Cleaned up somehwat dependence on status definitions
* handle folder
* Added finetuned_start_timeout_seconds
* Fix typo in main invocation
* Add SystemLog: prefix for scorer
* Fixed type error on timeout
---------
Co-authored-by: svaruag <gasi@microsoft.com>
* Ccozianu/4office debug (#2308 )
* add more logs
* fix stdout logs
* Make sure we recover details
* Make sure we recover details (#2238 )
* SystemLog: prefix logging
* Ccozi/temp logging fix (#2246 )
* Make sure we recover details
* SystemLog: prefix logging
* Adding more detailed logging
* Fixing typo
* fix NPE in logging
* Cleaned up somehwat dependence on status definitions
* handle folder
* Added finetuned_start_timeout_seconds
* Fix typo in main invocation
* Add SystemLog: prefix for scorer
* Fixed type error on timeout
* Go to a different endpoint for connections listkeys call in batch_benchmark_score
---------
Co-authored-by: svaruag <gasi@microsoft.com>
* Ccozianu/4office debug (#2316 )
* add more logs
* fix stdout logs
* Make sure we recover details
* Make sure we recover details (#2238 )
* SystemLog: prefix logging
* Ccozi/temp logging fix (#2246 )
* Make sure we recover details
* SystemLog: prefix logging
* Adding more detailed logging
* Fixing typo
* fix NPE in logging
* Cleaned up somehwat dependence on status definitions
* handle folder
* Added finetuned_start_timeout_seconds
* Fix typo in main invocation
* Add SystemLog: prefix for scorer
* Fixed type error on timeout
* Go to a different endpoint for connections listkeys call in batch_benchmark_score
* Synced all batch-benchmark-inference patch version
---------
Co-authored-by: svaruag <gasi@microsoft.com>
* Ccozianu/4office debug (#2409 )
* add more logs
* fix stdout logs
* Make sure we recover details
* Make sure we recover details (#2238 )
* SystemLog: prefix logging
* Ccozi/temp logging fix (#2246 )
* Make sure we recover details
* SystemLog: prefix logging
* Adding more detailed logging
* Fixing typo
* fix NPE in logging
* Cleaned up somehwat dependence on status definitions
* handle folder
* Added finetuned_start_timeout_seconds
* Fix typo in main invocation
* Add SystemLog: prefix for scorer
* Fixed type error on timeout
* Go to a different endpoint for connections listkeys call in batch_benchmark_score
* Synced all batch-benchmark-inference patch version
* use default cred
* replaced with managed cred
* add more logs
* add compute target
* remove logs, handle errors better
---------
Co-authored-by: svaruag <gasi@microsoft.com>
* Ccozianu/4office debug (#2428 )
* add more logs
* fix stdout logs
* Make sure we recover details
* Make sure we recover details (#2238 )
* SystemLog: prefix logging
* Ccozi/temp logging fix (#2246 )
* Make sure we recover details
* SystemLog: prefix logging
* Adding more detailed logging
* Fixing typo
* fix NPE in logging
* Cleaned up somehwat dependence on status definitions
* handle folder
* Added finetuned_start_timeout_seconds
* Fix typo in main invocation
* Add SystemLog: prefix for scorer
* Fixed type error on timeout
* Go to a different endpoint for connections listkeys call in batch_benchmark_score
* Synced all batch-benchmark-inference patch version
* use default cred
* replaced with managed cred
* add more logs
* add compute target
* remove logs, handle errors better
* Add notebook to list aoai connections
* cleanup notebook test values
---------
Co-authored-by: svaruag <gasi@microsoft.com>
* updating model evaluation environment with modelling_llama patch.
* fix postprocessing script for human eval dataset.
* revert the changes for model evaluation environment.
* resolving merge conflicts.
* resolving merge conflicts.
---------
Co-authored-by: ccozianu <ccozianu@microsoft.com>
Co-authored-by: svaruag <gasi@microsoft.com>
Co-authored-by: Chandra Sekhar Gupta Aravapalli <caravapalli@microsoft.com>
2024-09-12 12:06:42 +05:30
runhli
tongy-msft
jeff-shepherd
Kelly
QianqianNie
XiangRao
Ayush Mishra
Ruby Zhu
Billy Hu
Diondra
vizhur
utkshukla
vikasagrawal-ms
HarshaVardhanBabu
Chandra Sekhar Gupta Aravapalli
Nilesh Vijayrania
Ankush Bhatia
Rupal jain
Rahul Kumar
kgullapally
rdondera-microsoft
Anubha Jain
Advitya Gemawat
Chandra Sekhar Gupta
Himanshu Chandola