* Add mlflow unit test
* Pass model folder to test
* Fix flake errors
* Fix test conda env
* Update test
* Update input args
* Print logs
* Update print
* fix space
* fix doc string
* Code changes for moving to Batch Scoring for Teacher Model
* Addition of copy right header
* Lengthy line formating fix
* Fix for unterminated f string
* Remove unwanted imports
* File formatting fixes
* File formatting fixes
* Fix for noqa
* Doc String for copy file contents function
* Fix for closing the connection in post processing
* Making changes for fixing pipeline changes
* Version changes
* Merge conflict fixes
* Environmental version fixes
* Adding new line
---------
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
* Workflow for model eval unit tests.
* Make conda verbose.
* Force CPU installation for torch related packages.
* Add pytest as dependent package.
* Install pytest-xdist.
* Modify conda dependencies in workflow configuration.
* Escape slashes in sed command.
* Properly append two lines to conda env file.
* Cosmetics.
* updating model evaluation environment with modelling_llama patch.
* reverting the changes for transformers patch.
* fixing quality assets and adding latest model details in tag.
* fixing the issues with latest model asset details in tags.
* updating changelog and bumping up azureml-assets version.
---------
Co-authored-by: Chandra Sekhar Gupta Aravapalli <caravapalli@microsoft.com>
* Add multimodal tag to phi-3.5-vision
* Update spec.yaml
---------
Co-authored-by: Ali Soylemezoglu <acsoylemezoglu@gmail.com>
Co-authored-by: Kelly <40868256+lykelly19@users.noreply.github.com>
* updating model evaluation environment with modelling_llama patch.
* reverting the changes for transformers patch.
* add quality benchmark tag for phi-35-moe-instruct model.
---------
Co-authored-by: Chandra Sekhar Gupta Aravapalli <caravapalli@microsoft.com>
* migrating component env to assets
* adding category
* changing category
* resolving pr comments
* making comp images public
* upgrading to ubuntu22 for component version
* updating model evaluation environment with modelling_llama patch.
* reverting the changes for transformers patch.
* fixing quality assets and adding latest model details in tag.
* fixing the issues with latest model asset details in tags.
---------
Co-authored-by: Chandra Sekhar Gupta Aravapalli <caravapalli@microsoft.com>
* Code changes for moving to Batch Scoring for Teacher Model
* Addition of copy right header
* Lengthy line formating fix
* Fix for unterminated f string
* Remove unwanted imports
* File formatting fixes
* File formatting fixes
* Fix for noqa
* Doc String for copy file contents function
* Fix for closing the connection in post processing
* Making changes for fixing pipeline changes
* Version changes
* Merge conflict fixes
* Environmental version fixes
* updating model evaluation environment with modelling_llama patch.
* add cost, quality, performance tags for evaluationresult.
* reverting the changes for transformers patch.
* updating the changelog and bump up the version.
* fix the issue with supporting new evaluationresult assets.
* updated the change log file.
* updating the test cases.
* updating the test cases.
* fixing unit tests.
* fixing change log file.
---------
Co-authored-by: Chandra Sekhar Gupta Aravapalli <caravapalli@microsoft.com>
* Add service name implementation
* indentation fix
* fstring indentation fix
* Evaluator Built in image bump to v6
* indentation fix - no additional line
---------
Co-authored-by: Shruti Iyer <iyershruti@microsoft.com>
Ethan Winters
utkshukla
Sai Kothinti
abhishekMS2024
Arun
Kelly
saoh
changliu2
Shu Peng
Janhavi Mahajan
visahan-24
Yeshwanth N
cassieesvelt
rdondera-microsoft
Chandra Sekhar Gupta
sarthaks95
Rahul Kumar
Diondra
apeddauppari
Aishwary Gupta
XiangRao
Jeff Omhover
Aditi Singh
Jayesh Tanna