Граф коммитов

3451 Коммитов

Автор SHA1 Сообщение Дата
chiragbhatt311 e03287eb68
added params in aoai component (#3322)
* added params

* added params
2024-09-03 11:41:33 +05:30
skanakamedal 7e08c29e06
Adding task_name and user_column_names for data import validations for MaaS (#3311) 2024-08-30 16:44:48 +05:30
Ali Soylemezoglu bb35244b71
fix (#3316)
Co-authored-by: Ali Soylemezoglu <alisoy@microsoft.com>
2024-08-29 15:27:20 -04:00
Ali Soylemezoglu 8ec6ded618
Phi 3.5 exposed on GH Marketplace (#3313)
* fix

* fix

* fix

---------

Co-authored-by: Ali Soylemezoglu <alisoy@microsoft.com>
2024-08-29 14:13:00 -04:00
sanchez-alex 32c6a3a3dd
Math Distillation Task (#3231)
* Initial changes to enable math distillation task

* Convert response to str for finetune job

* Add support for math datasets that expect a letter response

* Update the pipeline spec

* Bug fi

* Fix the cot prompt for math choice task

* Cleanup

* Remove excess tab

* Remove excess line

* Add math task to parser help message

* Re-add changes after merge conflict

* Add cot reasoning missing from last pr

* Make the response a string

* Fix bug

* Update versions

* Code quality

* Remove math_mcq

* Remove all math_mcq

* Add comma

* Add min record for math task

* Remove comment

---------

Co-authored-by: HarshaVardhanBabu <hnamburi@microsoft.com>
2024-08-28 13:30:51 -07:00
Sharvin J d1bd75e647
Resolve versions in dependencies of oss_distillation_pipeline (#3309) 2024-08-28 17:24:26 +05:30
visahan-24 805f91dd9e
fix for failing gate (#3308) 2024-08-28 17:03:58 +05:30
Sharvin J dee3e4ac9e
Bump version of finetuning component in distillation pipeline (#3306)
* Bump version of finetuning component in distillation pipeline

* Fix pipeline version to 0.0.6
2024-08-28 13:57:51 +05:30
XiangRao e119395a9e
Fix DBCopilot environment Vulnerabilities (#3304) 2024-08-28 10:15:34 +08:00
visahan-24 1c6dba9805
Changes for Text Summarisation (#3288)
* Changes for Text Summarisation

* For failing gate fix

* Text Summarization changes

* Code health fixes

* Summarization changes

* Making cod and cot optional
2024-08-28 07:08:37 +05:30
jeff-shepherd 74bed2b7f1
Added ai-ml-automl environment (#3292)
* Added ai-ml-automl registry environment to replace the AzureML-AutoML environment
2024-08-27 14:10:22 -07:00
ShobithNandakumar acd069f2cd
remove optional field to force validation output (#3302) 2024-08-27 15:07:59 +05:30
Yeshwanth N a09b728203
[Enhancement]: Multi-node-support for MaaS (#3279)
* [Enhancement] : Multi-node-support for MaaS

* corrected change related to model sel. number of train epochs

* cleanup unused variable

* formatting updates

* correct string formats

* string corrections

* spaces and indent cleanup

* line char constraints fixed

* removed trailing white spaces

* added doc strings

* format for line constraint

* correct doc string

* doc string fix

* ENH : Portalocker on wait barrier

* ENH : Processname optimized

* ENH : Changes as per review comments

* ENH : Fail if input value is not a number
2024-08-27 09:04:49 +00:00
Anubha Jain 839235c223
Component changes 4.44.0 for MaaS (#3252)
* Component changes 4.44.0 for MaaS

* update env version

* env version upgrade

---------

Co-authored-by: Anubha Jain <anubhajain@microsoft.com>
2024-08-27 12:04:45 +05:30
Anubha Jain f506fe0e28
MaaP Component changes - transformers 4.44.0 (#3250)
* Component changes 4.44.0

* Component changes 4.44.0

* Component changes 4.44.0

* Refactoring

* Refactoring

* Refactoring

* Refactoring

* Refactoring

* Code fix

* Refactoring

* Refactoring

* Refactoring

* update env version

* removing validations file modifcations

* env version upgrade

---------

Co-authored-by: Anubha Jain <anubhajain@microsoft.com>
2024-08-27 11:49:10 +05:30
Andrew Schonhoffer 93cc251714
author "mistralai"=>"Mistral" (#3300) 2024-08-26 17:03:26 -04:00
Ayush Mishra 7bdf9784bb
Fix model-mgmt vuln wrt aiohttp pkg (#3298) 2024-08-26 22:42:04 +05:30
XiangRao 07e93b42dd
Fix DBCopilot environment Vulnerabilities (#3277)
* Fix DBCopilot environment Vulnerabilities

* fix

* fix

* fix

* FIX

* fix

* fix

* fix

* fix
2024-08-26 14:29:13 +08:00
ShobithNandakumar 7c566f9458
feat: introduce validation component for distillation pipeline (#3284) 2024-08-26 10:16:30 +05:30
jeff-shepherd 326b05d104
Trigger new build for automl-gpu (#3297) 2024-08-23 16:02:27 -07:00
Ali Soylemezoglu b124933d57
fix (#3293)
Co-authored-by: Ali Soylemezoglu <alisoy@microsoft.com>
2024-08-23 12:18:05 -04:00
Kelly 29ce355f37
Update CODEOWNERS (#3296)
* Update CODEOWNERS

* update line

---------

Co-authored-by: Kelly <kellyly@microsoft.com>
2024-08-23 12:13:46 -04:00
ghyadav e851159668
Adding rouge package to the env (#3295) 2024-08-23 16:49:35 +05:30
Chandra Sekhar Gupta b1c6718c71
Fix aiohttp vulnerability in model evaluation environment (#3294)
* updating model evaluation environment with modelling_llama patch.

* fixing vulnerabilities in model evaluation environment.

* adding verbose flags in conda env create.

* adding only one verbose flag.

* updating the dependencies to resolve vulnerabilities.

* updating the dependencies to resolve vulnerabilities.

* fixing aiohttp vulnerability in azureml-metrics package.

---------

Co-authored-by: Chandra Sekhar Gupta Aravapalli <caravapalli@microsoft.com>
2024-08-23 14:41:27 +05:30
vikasagrawal-ms 59415ca1a6
Fixed Distillation Component Compute (#3290) 2024-08-22 22:40:42 +05:30
Kelly b076ce1fec
Update storage & container paths for count-cars and detect-defects (#3272)
* Update storage & container paths for count-cars and detect-defects

* Bump version

---------

Co-authored-by: Kelly <kellyly@microsoft.com>
2024-08-22 11:30:25 -04:00
Anubha Jain ae510a0de7
inhibit copying base model dependencies for summ, and translation (#3285)
* inhibit copying base model dependencies for summ, and translation

* comments fix

---------

Co-authored-by: Anubha Jain <anubhajain@microsoft.com>
2024-08-22 14:00:51 +05:30
Ali Soylemezoglu 73db714cd7
fix (#3287)
Co-authored-by: Ali Soylemezoglu <alisoy@microsoft.com>
2024-08-21 13:46:59 -04:00
aggarwal-k 6fc30dc7d4
Upgrading aiohttp version for vulnerability fix (#3286) 2024-08-21 18:23:09 +05:30
QianqianNie e0060353f4
Add phi3.5 models (#3281) 2024-08-20 13:06:35 -07:00
QianqianNie 5a3f905d9c
update owners for model folder (#3282) 2024-08-20 12:50:02 -07:00
HarshaVardhanBabu 598dbefa0b
Refactor the function to remove redundant code. (#3245)
* Refactor the function to remove redundant code.

* Refactored the code and removed logging user data

* Fix linting issues

* Minor bug fix when input data is  not matching with data gen task type

* Fix linting issues

* Updated documentation strings.

* chore: introduce minor telemetry to distillation component (#3268)

* chore: introduce minor telemetry

* conditionally log network calls

* revert improper use of lambda

* add more context to the logger in decorator

* consume azureml telemetry loggers

* nit: EOF line

* Fix linting issues

* Fix documentation strings

---------

Co-authored-by: ShobithNandakumar <53436371+ShobithNandakumar@users.noreply.github.com>
2024-08-20 10:00:46 +00:00
Anubha Jain be338ec53a
NLP env vulnerabilities fix (#3271)
Co-authored-by: Anubha Jain <anubhajain@microsoft.com>
2024-08-20 14:05:50 +05:30
Richard Li a0567e3f21
only get feature_importance if select feature by top n. (#3235)
* only get feature_importance if select feature by top n.

* remove extra import

---------

Co-authored-by: Richard Li <richli@microsoft.com>
2024-08-19 13:42:40 -07:00
Shu Peng 7d138634cb
Explicitly install the dependencies (#3274)
* install dependencies explicitly

* bump up assets version

* bump up version

* Fix the comments

---------

Co-authored-by: XiangRao <131976564+ricardrao@users.noreply.github.com>
2024-08-19 10:43:37 -07:00
Rupal jain cf49f14080
automl-dnn-vision-gpu update (#3269) 2024-08-19 17:47:18 +05:30
QianqianNie 1f537bda38
Update foundation model image (#3275) 2024-08-17 12:16:41 -07:00
Ali Soylemezoglu a602ada5fa
fix (#3270)
Co-authored-by: Ali Soylemezoglu <alisoy@microsoft.com>
2024-08-16 20:13:51 -04:00
qusongms 13262bcd98
update promptflow name of qna-quality-safety-eval. (#3273) 2024-08-16 15:26:44 -07:00
Shu Peng 55c949eccd
Upgrade to azureml-rag 0.2.36 (#3262)
* upgrade to azureml-rag 0.2.36

* Pump up versions
2024-08-14 12:38:14 -07:00
Ayush Mishra f6128a151d
Fix and update import components (#3264)
* Fix and update import components

* pip install

* switch to python39 and reinstall horovod

* Update Dockerfile
2024-08-14 16:03:20 +05:30
Anubha Jain 40b7d7c43d
Update scikit-learn and setuptools for env vulnerbility fix (#3267)
* Update scikit-learn and setuptools for env vulnerbility fix

* Removing acpt changes

---------

Co-authored-by: Anubha Jain <anubhajain@microsoft.com>
2024-08-14 15:18:39 +05:30
Ayush Mishra 7520800fd7
skip printing text response (#3266)
* skip printing text response

* update
2024-08-14 12:29:38 +05:30
Ayush Mishra 578110fbdf
Update datagen component version (#3265)
* Update datagen component version

* Update spec.yaml
2024-08-14 10:33:32 +05:30
SamGos93 57c6c7072a
Benchmark Assets for new models (#3261)
* GPT 4o, llama 3.1 and GPT 0125 assets

* Removing old gpt 4o assets
2024-08-14 10:08:27 +05:30
Ayush Mishra ffa592987e
remove data logs (#3263) 2024-08-14 09:30:23 +05:30
QianqianNie c8331c2f7a
Update vllm version of fmi (#3257)
* Update vllm version

* update to 0.2.7
2024-08-13 20:09:58 -07:00
clomeli-ms 2f8296df37
removed promptflow_creation_job from component pipelines (#3243)
Merged main, can merge now.
2024-08-13 18:08:12 -07:00
David Wu 3bfdf0fe53
Users/daviwu/ai studio curated env (#3224)
* AI Studio curated env

* Update name from ai-studio-development to ai-studio-dev

* Rename folder from ai-studio-development to ai-studio-dev

* Resolve dependency conflicts

* Update category to AI Studio
2024-08-13 13:33:56 -07:00
Ayush Mishra 1f75c4b083
Fix model-mgmt vulns (#3229)
* Fix model-mgmt vulns

* use py38

* update pytorch in Docker instead

* pyarrow fixes

* EOL

* fix unittests failing due to huggingfaceapi changes

* update

* update pyarrow version
2024-08-13 20:25:07 +05:30