Граф коммитов

3424 Коммитов

Автор SHA1 Сообщение Дата
apeddauppari 3fcebcb019
AOAI eval fixesOnline Evaluation Schedule AOAI Evaluators Support (#3568)
* AOAI eval fixes

* Fix for evaluator issues and logger

* Bug fixes

* Remove debug logs

* check-style fix and logger changes

* Added logger to check query results

---------

Co-authored-by: Ankush Bhatia <ankushbhatia@microsoft.com>
2024-11-07 23:04:44 +05:30
Yeshwanth N 8efee95899
[BugFix]: Phi-3.5-mini-instruct fails to fine tune with lora (#3577) 2024-11-07 11:55:53 +00:00
Aishwary Gupta 7f842dbf7e
Upgrade ubuntu base image to 22.04 (#3574) 2024-11-07 16:45:41 +05:30
XiangRao 82ec219d64
Upgrate DBCopilot component version (#3572) 2024-11-07 02:52:14 +00:00
Jeff Omhover 049a0afdc8
Add multimodal tag to phi-3.5-vision (#3543)
* Add multimodal tag to phi-3.5-vision

* Update spec.yaml

---------

Co-authored-by: Ali Soylemezoglu <acsoylemezoglu@gmail.com>
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
2024-11-06 16:51:58 -08:00
Aditi Singh 834e1262c8
added MLModel files (#3564) 2024-11-07 01:56:37 +05:30
Chandra Sekhar Gupta 30ccdefeb8
Update model asset ids to prod registries for evaluationresult quality assets of phi models (#3571)
* updating model evaluation environment with modelling_llama patch.

* reverting the changes for transformers patch.

* updating quality assets for phi models.

---------

Co-authored-by: Chandra Sekhar Gupta Aravapalli <caravapalli@microsoft.com>
2024-11-06 21:46:45 +05:30
Chandra Sekhar Gupta d3091b6b2b
Add quality benchmark tag for phi-35-MoE-instruct model (#3573)
* updating model evaluation environment with modelling_llama patch.

* reverting the changes for transformers patch.

* add quality benchmark tag for phi-35-moe-instruct model.

---------

Co-authored-by: Chandra Sekhar Gupta Aravapalli <caravapalli@microsoft.com>
2024-11-06 21:21:22 +05:30
Yeshwanth N 2442cb2caf
[VulnerabilityFix]: Uprage onnx to 1.77.0 in acft-mmtracking-video-gpu,acpt-automl-image-framework-selector-gpu,acft-multimodal-gpu (#3570) 2024-11-06 14:02:04 +05:30
Jayesh Tanna 3ae6492140
migrating component environment (#3505)
* migrating component env to assets

* adding category

* changing category

* resolving pr comments

* making comp images public

* upgrading to ubuntu22 for component version
2024-11-06 10:00:44 +05:30
abhishekMS2024 c7e3e6820d
Added support for model_framework for import_model component (#3566) 2024-11-06 09:09:49 +05:30
abhishekMS2024 a47fb18726
Update the model_flavor to OSS (#3560) 2024-11-06 09:02:04 +05:30
Diondra bd9a588a04
Remove preview tags from GA built-in evaluators (#3569)
* Remove preview tags from GA evaluators

* Fix formatting error with empty tags
2024-11-05 18:06:09 -05:00
Rahul Kumar 5fffc9244c
Add new environment aoai-evaluation (#3531)
* add new environment aoai-evaluation

* remove azureml-metrics from dependencies

* pin packages

* reorder logic for batch score result

* fix code style issue
2024-11-05 15:40:02 +00:00
Rahul Kumar 4c2a6914bc
upgrade forecasting components (#3563) 2024-11-05 10:51:15 +05:30
Chandra Sekhar Gupta 3defa2e329
fixing quality assets and adding latest model details in tag. (#3558)
* updating model evaluation environment with modelling_llama patch.

* reverting the changes for transformers patch.

* fixing quality assets and adding latest model details in tag.

* fixing the issues with latest model asset details in tags.

---------

Co-authored-by: Chandra Sekhar Gupta Aravapalli <caravapalli@microsoft.com>
2024-11-05 06:39:33 +05:30
Kelly d958a5cd0b
Revert "Code changes for moving to Batch Scoring for Teacher Model (#3507)" (#3561)
This reverts commit 04eff530e2.
2024-11-04 08:43:59 -08:00
rdondera-microsoft 13b756960b
Fix input column names for OD/IS components (#3557)
* Fix input column names for vision finetuning validation.

* Update input column names for classification, for consistency purposes.
2024-11-04 07:58:51 -08:00
visahan-24 04eff530e2
Code changes for moving to Batch Scoring for Teacher Model (#3507)
* Code changes for moving to Batch Scoring for Teacher Model

* Addition of copy right header

* Lengthy line formating fix

* Fix for unterminated f string

* Remove unwanted imports

* File formatting fixes

* File formatting fixes

* Fix for noqa

* Doc String for copy file contents function

* Fix for closing the connection in post processing

* Making changes for fixing pipeline changes

* Version changes

* Merge conflict fixes

* Environmental version fixes
2024-11-04 18:41:37 +05:30
Chandra Sekhar Gupta 4f983518a6
Fix the issue with supporting new evaluationresult asset types (#3544)
* updating model evaluation environment with modelling_llama patch.

* add cost, quality, performance tags for evaluationresult.

* reverting the changes for transformers patch.

* updating the changelog and bump up the version.

* fix the issue with supporting new evaluationresult assets.

* updated the change log file.

* updating the test cases.

* updating the test cases.

* fixing unit tests.

* fixing change log file.

---------

Co-authored-by: Chandra Sekhar Gupta Aravapalli <caravapalli@microsoft.com>
2024-11-04 08:34:59 +05:30
sarthaks95 81f80b9b91
Update model versions - phi-3-medium-4k-instruct, phi-3-medium-128k-instruct, phi-3-small-8k-instruct, phi-3-mini-4k-instruct, phi-3-mini-128k-instruct (#3545)
Co-authored-by: Sarthak Singhal <sarsinghal@microsoft.com>
2024-11-02 18:22:57 +05:30
Diondra 74d61d677e
Update groundedness pro asset description (#3556) 2024-11-01 14:41:00 -04:00
apeddauppari 4d545071e8
Add AppInsights ServiceName Implementation (#3555)
* Add service name implementation

* indentation fix

* fstring indentation fix

* Evaluator Built in image bump to v6

* indentation fix - no additional line

---------

Co-authored-by: Shruti Iyer <iyershruti@microsoft.com>
2024-11-01 22:29:37 +05:30
Srujan Saggam 953eb97cb3
add ft tags (#3550) 2024-10-31 21:46:33 -07:00
cassieesvelt e2c060db76
fix llava bug (#3546) 2024-10-31 15:52:29 -07:00
Diondra 0a7a9cc74f
Update ui flow to v5 (#3552) 2024-10-31 18:48:13 -04:00
Diondra 997708c83e
Update evaluators and add Retrieval + GroundednessPro (#3551)
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
2024-10-31 18:42:17 -04:00
rdondera-microsoft 02e5760249
Rollback OD and IS pipeline components. (#3548) 2024-10-31 15:02:59 -07:00
Kelly 4c1911a33b fix version in changelog 2024-10-31 14:44:47 -07:00
Kelly 59dfdad881
Validate build logs for deprecated dependencies only if logs directory exists (#3549)
Co-authored-by: Kelly <kellyly@microsoft.com>
2024-10-31 14:35:20 -07:00
XiangRao abbc9b0a26
Fix DBCopilot Vulnerabilities (#3542) 2024-10-31 10:59:03 +08:00
utkshukla 815d7e39ea
Fmi verison 58 release (#3539) 2024-10-31 01:37:59 +05:30
Shruti Iyer 4db12d6022
Evaluator Built in image bump to v5 (#3533)
Co-authored-by: Shruti Iyer <iyershruti@microsoft.com>
2024-10-30 18:05:48 +00:00
Tarun-Chevula efe48cb7c1
Updated Ubuntu 22.04 & Python 3.12 (#3526)
* Added mlflow39

* Add # pydocstyle: ignore D100, D101, D102, D103 to ignore docstring

* Revert "Add # pydocstyle: ignore D100, D101, D102, D103 to ignore docstring"

This reverts commit 3f2e0b21de.

* Added docstrings and removed specific value in requirements

* Update

* Update

* Update

* Update

* Update

* Renamed Dockerfile-mlflow to Dockerfile

* Renamed Dockerfile and updated environment.yaml

* Added image with latest tag in Dockerfile

* Update

* Test changes

* Added value for RESOURCES_DIR

* Update

* Update

* Revert "Update"

This reverts commit 41aa5dd3a5.

* Reverted the changes

* Updated Dockerfile and conda_dependencies.yaml

* Updated Ubuntu 22.04 & Python 3.12

* Added mlflow py312 environment

* Update

---------

Co-authored-by: Arun <arunsu@microsoft.com>
2024-10-30 17:46:04 +00:00
Chandra Sekhar Gupta cadb6a774d
Add evaluationresult tags for cost, quality index and perf assets (#3541)
* updating model evaluation environment with modelling_llama patch.

* add cost, quality, performance tags for evaluationresult.

* reverting the changes for transformers patch.

* updating the changelog and bump up the version.

---------

Co-authored-by: Chandra Sekhar Gupta Aravapalli <caravapalli@microsoft.com>
2024-10-30 23:02:12 +05:30
jeff-shepherd 1e9726ad5e
Added tensorflow-2.16-cuda12 (#3537)
* Added tensorflow-2.16-cuda12
2024-10-30 17:16:09 +00:00
Kelly a4e7e54a85
Validate build logs for deprecated dependencies (Python 3.8) (#3536)
* Validate build logs for deprecated dependencies (Python 3.8)

* add test envs

* fix syntax

* change env to test and syntax

* use -l not -i

* Bump version and remove test env files

---------

Co-authored-by: Kelly <kellyly@microsoft.com>
2024-10-30 08:49:46 -07:00
skanakamedal 08ec063b58
Bumping component version (#3540) 2024-10-30 19:31:16 +05:30
skanakamedal 8088709523
Deepspeed vulnerability fix for acft-hf-nlp-gpu (#3538)
* Deepspeed vulnerability fix with patch to transformers

* Adding comment
2024-10-30 08:47:45 +00:00
QianqianNie 2e39c08ac3
Update vllm to work for phi3 vision (#3522) 2024-10-30 02:11:31 +00:00
savitamittal1 e8ff8af6fa
Updated tests for incompatibility of datasets package (#3493)
* update transformer version

* updated

* pined to specific version

* updated

* removed deprecated method

* metric import from evaluate
2024-10-29 08:49:27 -07:00
Yeshwanth N 382d95a37e
[Enhancement]: Distil pipeline update with tag for identification (#3490)
* [Enhancement]: Distil pipeline update with tag for identification

* [Enhancement]: Update internal components with new image and enums for cot and cod inputs
2024-10-29 13:58:20 +05:30
rdondera-microsoft 34263c57e2
Use new environment for object detection components (#3516)
* Fix issues with mmdetection docker image.

* Update mmd environment and clarify input column names for components.

* Fix corner case for detection dataset creation.

* Revert to using image_url for image classification tasks.

* Update individual components with newer environments.

* Update pipeline components with new environments.

* Update individual components with patched environments.

* Update finetune_common_validation version in mmt pipeline.
2024-10-28 21:36:44 -07:00
jeff-shepherd 1dfe3553bd
Updated CUDA in tensorflow environment (#3527)
* Updated CUDA for tensorflow
2024-10-28 19:22:35 +00:00
Shruti Iyer f2a50edf58
Evaluator Built in: Fix logger config (#3528)
Co-authored-by: Shruti Iyer <iyershruti@microsoft.com>
2024-10-28 14:22:13 -04:00
rdondera-microsoft 029998ecb9
Force docker rebuild. (#3529) 2024-10-28 08:47:43 -07:00
aggarwal-k caefd76b79
Update model version (#3530) 2024-10-28 12:38:04 +05:30
Yeshwanth N 7a13268b1b
[Update]: Component updates for latest bugfixes (#3504)
* [Update]: Component updates for latest bugfixes

* [Update]: Added version bumps for singularity pipelines

* [Update]: Update acft image to version 76

* [Update]: Update version for data import maas components

* [Update]: Component updates for latest bugfixes

* [Update]: Added version bumps for singularity pipelines

* [Update]: Update acft image to version 76

* [Update]: Update version for data import maas components

* [Update]: Update data import in mass pipelines
2024-10-28 06:32:39 +00:00
Anubha Jain 9e42d94677
enabling finetuning on phi-3.5 variants (#3328)
* enabling finetuning on phi-3.5-mini-128k

* Updating new container folder

* Updating spec

* enable moe for FT

* blob folder update

* removing maas publish

* Updating sku for moe

* Adding max_seq_len

---------

Co-authored-by: Anubha Jain <anubhajain@microsoft.com>
2024-10-28 11:01:49 +05:30
Yeshwanth N 1af3d8b4f8
[VulnerabilityFix]: Update deepspeed for environment image vulnerability fix (#3525) 2024-10-25 11:15:15 +05:30