a05c493056
Update sdk/python/setup.sh to target fresh built azure-ai-ml wheel.
2024-08-16 02:11:24 +00:00
07a31fcc01
Upgrade pytorch 1.13 to 2.2 ( #3350 )
2024-08-15 15:50:44 -07:00
cc8649bb86
Added the notebook for the conversation distillation task ( #3347 )
2024-08-14 10:10:32 +05:30
cabd0a5846
updated minimal image version ( #3346 )
2024-08-13 11:56:07 -07:00
a46bb8ef9b
Distillation qanda ( #3335 )
...
* Q and A Distillation Example
* Create distillation_qanda - Copy.ipynb
Distillation Q and A changes
* Changes for distillation Q&A
* Changes for black validation and utils for download dataset
2024-08-13 23:08:29 +05:30
ce99aa8908
fix(ci): Add workaround to circumvent azure-cli's lack of support for ID token refresh ( #3328 )
...
* fix: Eagerly request token scopes
* chore: Regenerate workflows to pick up token caching change
2024-08-12 14:48:51 -04:00
a80fd77abf
Fix fridge dataset URL in RAI notebooks to point to new blob storage location as cvbp was removed ( #3336 )
2024-08-09 00:58:57 -04:00
4ab5cb2e50
updated minimal image version for the cli examples ( #3338 )
2024-08-08 12:21:24 -07:00
c2359b89ff
updated touchserve start command ( #3342 )
2024-08-08 12:17:20 -07:00
1a086dac41
Adding a test for distillation notebook ( #3331 )
...
* Adding a test for distillation notebook
* Commenting out a part of the checks
* Corrections
* Corrections
* Minor fixes
* Push the fixes
* Changes to force re-run of tests
* Uncommenting code in the tets file
* Adding -ve tests
* Fixes
---------
Co-authored-by: Chakrapani Ravi Kiran S <ravichak@microsoft.com>
2024-08-06 10:07:51 +05:30
6e32c21eb4
Update responsibleaidashboard-text-classification-blbooksgenre.ipynb ( #3280 )
...
* Update responsibleaidashboard-text-classification-blbooksgenre.ipynb
* Update responsibleaidashboard-text-classification-blbooksgenre.ipynb
* Update responsibleaidashboard-text-classification-blbooksgenre.ipynb
* Update responsibleaidashboard-text-classification-blbooksgenre.ipynb
* Update responsibleaidashboard-text-classification-blbooksgenre.ipynb
2024-08-05 13:13:43 -07:00
4e6e7f6a16
Update CODEOWNERS ( #3334 )
...
Docs maintenance task
2024-08-05 11:53:05 -05:00
92101a9728
remove unhealthy compute and aks ( #3329 )
...
* remove unhealthy compute and aks
* remove unhealthy compute and aks
---------
Co-authored-by: Ubuntu <zetia@DevBox-zetia.1jltvvkrfgyuhl3llhmbyldkog.bx.internal.cloudapp.net>
2024-08-05 10:06:12 +08:00
7aafd2760b
add n_best_runs param detail ( #3326 )
2024-08-01 18:41:18 +05:30
a0e49f8e4e
Vision Datasets location Update ( #3289 )
...
* adding continue_on_step_failure False and force_rerun True for vision pipelines
* adding continue_on_step_failure False and force_rerun True for vision pipelines
* adding continue_on_step_failure False and force_rerun True for vision pipelines
* update datasets location
* Replace remaining references to multiclass classification data.
* Replace remaining references to multilabel classification data.
* Replace remaining references to object detection data.
* Replace remaining references to instance segmentation data.
* Patch .zip url.
* Install numpy version compatible with scikit-image==0.19.3.
* Use different names for data sources to prevent job failures due to same name being used at the same time.
---------
Co-authored-by: Radu-Mihai Dondera <rdondera@microsoft.com>
2024-07-31 21:11:38 +05:30
eb698e91b6
Updated image data source ( #3278 )
...
Co-authored-by: Rupal jain <rupaljain@microsoft.com>
2024-07-30 21:57:25 -07:00
ec01090070
Updated image data source ( #3277 )
...
Co-authored-by: Rupal jain <rupaljain@microsoft.com>
2024-07-30 15:56:34 -07:00
0de88c91c0
Llama distillation notebook fixes ( #3322 )
...
* Adding missing datasets package
* Doc explaining TEACHER_MODEL_ENDPOINT_NAME and TEACHER_MODEL_NAME
* mlclient.models.get requires version or label
* data directory must be created prior to saving datasets
* Only one sample is saved in train and valid JSONL files
- was using `w` mode which replaces the file with each dataset JSON row, leaving only one sample at the end
- replaced `w` write mode with `a` append mode so that all JSON lines are saved to train and valid files
* Experiment name cannot contain `.`
- Llama 3.1 models have `.` in their names, thus failing the experiment name constraint of not having a `.`
* Printing studio progress URL
* Llama 3.1 marketplace subscription prerequisites
2024-07-29 22:43:36 +05:30
2e86135da8
Zetia/fix K8s onlinedeployment vulnerability issue ( #3312 )
...
* upgrade azureml-defaults to fix pyarrow vulnerability
* upgrade azureml-defaults to fix pyarrow vulnerability
* upgrade base image
---------
Co-authored-by: Ubuntu <zetia@DevBox-zetia.1jltvvkrfgyuhl3llhmbyldkog.bx.internal.cloudapp.net>
2024-07-29 09:33:53 +08:00
b7dc63b182
meta-llama-3.1 client samples ( #3304 )
...
* meta-llama-3.1 client samples
* black formatting
* Update langchain.ipynb
---------
Co-authored-by: shail2208 <59747407+shail2208@users.noreply.github.com>
2024-07-25 10:56:13 -07:00
0f676621ca
Cohere-rerank-samples ( #3305 )
...
* Create cohere-webrequests.ipynb
* Create rerank-cohere-client.ipynb
* Rename cohere-webrequests.ipynb to rerank-webrequests.ipynb
* Create rerank-3-langchain.ipynb
* Update rerank-webrequests.ipynb
* Update rerank-webrequests.ipynb
* Update rerank-webrequests.ipynb
* Update rerank-webrequests.ipynb
* reformatted
2024-07-25 08:20:23 -07:00
0d02248521
Mistral sample update ( #3308 )
...
* Update langchain.ipynb
* Update langchain.ipynb
* Update litellm.ipynb
* Update mistralai.ipynb
* Update openaisdk.ipynb
* update the prereuisites to refelct current information
* Update langchain.ipynb
* Update litellm.ipynb
* Update mistralai.ipynb
* Update openaisdk.ipynb
* Update webrequests.ipynb
2024-07-24 09:10:00 -07:00
7060507567
Upgrade to sklean-1.5 ( #3303 )
2024-07-23 14:04:20 -07:00
cf060c0b72
Add feature store sample running on synapse notebook ( #3302 )
...
* Add feature store sample running on synapse notebook
* clean up
* reformat
2024-07-23 09:57:55 -07:00
08542cec5e
Distillation and Synthetic data gen notebook ( #3307 )
...
* Distillation and Synthetic data gen notebook
* Black
2024-07-23 08:40:52 -07:00
ef4f57a7fa
update OneHotEncoder arg sparse to sparse_output ( #3298 )
2024-07-22 13:21:47 -04:00
c939dec7f2
Upgrade to sklearn-1.5 from sklearn-1.1 ( #3301 )
2024-07-19 13:53:57 -07:00
70f0ddd0cf
Upgraded to sklearn-1.5 ( #3300 )
2024-07-19 11:44:25 -07:00
0fe5cf5b3d
Updated to sklearn-1.5 ( #3297 )
...
* Updated to sklearn-1.5
* Removed deprecated 'normalize' parameter
2024-07-19 10:27:34 -07:00
f52c4985bf
Upgrade to sklearn-1.5 ( #3293 )
2024-07-18 11:24:18 -07:00
ae0a7517e9
Updated curated environment to sklearn-1.5 ( #3292 )
...
* Updated curated environment to sklearn-1.5
2024-07-18 11:24:01 -07:00
68f69766ab
Update image version to latest in RAI notebooks ( #3279 )
...
* Update responsibleaidashboard-diabetes-decision-making.ipynb
* Update responsibleaidashboard-diabetes-regression-model-debugging.ipynb
* Update responsibleaidashboard-ed-student-attrition-clf.ipynb
* Update responsibleaidashboard-finance-loan-classification.ipynb
* Update responsibleaidashboard-healthcare-covid-classification.ipynb
* Update responsibleaidashboard-housing-classification-model-debugging.ipynb
* Update responsibleaidashboard-housing-decision-making.ipynb
* Update responsibleaidashboard-programmer-regression-model-debugging.ipynb
* Update responsibleaidashboard-multilabel-text-classification-covid-events.ipynb
* Update responsibleaidashboard-text-classification-DBPedia.ipynb
* Update responsibleaidashboard-text-classification-blbooksgenre.ipynb
* Update responsibleaidashboard-text-question-answering-squad.ipynb
* Update responsibleaidashboard-text-classification-financial-news.ipynb
* Update responsibleaidashboard-automl-image-classification-fridge.ipynb
* Update responsibleaidashboard-automl-object-detection-fridge-private-data.ipynb
* Update responsibleaidashboard-image-classification-fridge.ipynb
* Update responsibleaidashboard-image-flower-classification.ipynb
* Update responsibleaidashboard-image-multilabel-classification-fridge.ipynb
* Update responsibleaidashboard-object-detection-MSCOCO.ipynb
* Update cli-responsibleaidashboard-housing-classification.yml
* Update train_housing.yml
* Update cli-responsibleaidashboard-programmer-regression.yml
* Update train_programmers.yml
2024-07-11 16:16:38 -07:00
c939235f02
[ParallelRunStep] Fix PRS example numpy version issue. ( #3274 )
...
* fix pipeline parallel mnist issue
* remove tf
---------
Co-authored-by: Xiaole Wen <xiwe@microsoft.com>
2024-07-10 14:44:59 +05:30
6188c0269d
adding NPS extension to avoid forcing network policy ( #3270 )
...
* adding NPS extension to avoid forcing network policy
* formatting fix
* fixing formatting
* formatting
* formating fix
2024-07-09 20:53:12 +05:30
56b4ad073d
[bugfix] Upgrade curated environment tf from 2.11 to 2.16 ( #3268 )
...
* use tf-2.16
* fix: use shape.as_list() as GPT suggestions
2024-07-08 15:13:02 +08:00
b2f58696de
Zetia/ensure k8s compute ( #3265 )
...
* add ensure_amlarc_compute function
* ensure k8s compute
* ensure k8s compute
---------
Co-authored-by: Ubuntu <zetia@DevBox-zetia.1jltvvkrfgyuhl3llhmbyldkog.bx.internal.cloudapp.net>
2024-07-06 16:51:02 +08:00
af8f6f364a
Fix typo in parameter name ( #3266 )
2024-07-04 17:46:14 +05:30
d4c90eead3
fix: parallel related samples failed in inference ( #3261 )
2024-07-01 18:44:52 +08:00
13fb4f29ab
Temporarily disable featurestore sample test ( #3259 )
2024-06-26 11:07:53 -07:00
6081e562bf
AI21 Jamba Instruct fixes ( #3254 )
...
* ai21 labs jamba instruct samples
* fix code quality issues
* update files
---------
Co-authored-by: Shail Shah <shaisha@microsoft.com>
2024-06-21 08:07:21 -07:00
332153bf7c
Renamed the filenames to a shorter form. ( #3255 )
...
* Renamed the filenames to a shorter form.
* Renamed the filenames to a shorter form.
2024-06-21 20:05:13 +05:30
f80bb1c1d1
AutoML Vision and NLP SDK pipeline fix ( #3250 )
...
* adding continue_on_step_failure False and force_rerun True for vision pipelines
* adding continue_on_step_failure False and force_rerun True for vision pipelines
* adding continue_on_step_failure False and force_rerun True for vision pipelines
* update env for model registration custom component
2024-06-20 09:41:00 +05:30
9be775a2f5
chore: Use OIDC to authenticate to Azure in Github Actions ( #3253 )
...
* chore: Use federated credential in readme.py
* chore: Update cli workflows to use federated credentials
* chore: Update tutorial workflows to use federated credentials
* chore: Update sdk workflows to use federated credentials
* chore: Normalize line-ending for sdk-foundation-models-azure_openai-oai-v1-openai_completions_finetune.yml
* chore: Use federated credentials in sdk-foundation-models-azure_openai-oai-v1-openai_completions_finetune.yml
* chore: Update remaining workflows to use federated credentials
2024-06-19 16:55:28 -04:00
51297a7d56
Extra params support for stable diffusion model ( #3017 )
...
* Notebooks update for extra parameters and inpainting task
* online inpainting sdk
* safe inpainting online
* merge with main
* deleting file from wrong location
* code formatting
* update mlflow version
* repait scoring script
* dev
* conda update
* remove code
* reformat
* reformat
* format
---------
Co-authored-by: Rupal Jain <rupaljain@microsoft.com>
Co-authored-by: grajguru <grajguru@microsoft.com>
2024-06-19 09:53:20 +05:30
07d87f095d
Added more recommendations ( #3244 )
2024-06-17 11:20:32 -07:00
b34a0c67e3
change endpoint suffix number of a job ( #3238 )
2024-06-13 14:16:24 +08:00
5e82d100e1
Update deploy-moe-keyvault.sh ( #3227 )
2024-06-12 10:38:33 +08:00
fb8b92c341
fix long name ( #3224 )
2024-06-11 14:53:54 +05:30
54902a8b36
updating doc codeowners for week of June 10, 2024 ( #3228 )
...
* updating doc codeowners for week of June 10, 2024
* updating doc codeowners for week of June 10, 2024
2024-06-10 13:00:01 -04:00
6027ae5b6e
Add additional includes example ( #2341 )
...
* update
* use sdk readme in master
* revert to master
* reformat
2024-06-05 10:34:27 +08:00
azure-sdk
jeff-shepherd
HarshaVardhanBabu
Satwik Kumar
visahan-24
kdestin
Ilya Matiach
scravikiran
tongy-msft
Sheri Gilley
Zeliang Tian
Rahul Kumar
Rupal jain
Cedric Vidal
Thasmika Gokal
shubhirajMsft
Kriti
Fred Li
Sasidhar Kasturi
qusongms
xiaolewen
Amit Chauhan
Zhengfei Wang
aggarwal-k
Xingzhi Zhang
Nivedita Mishra
Gaurav Rajguru
savitamittal1
siyuZL
Rachel Yong
MadhuM02
Larry Franks
Cloga Chen