932fc55eeb
Update sdk/python/setup.sh to target fresh built azure-ai-ml wheel.
2024-10-07 13:46:26 +00:00
54eceee5ac
Fix blbooksgenre notebook failures ( #3404 )
2024-10-04 13:50:06 -04:00
5e5fc2c8ff
Distillation MS Learn Doc ( #3375 )
...
* Initial draft of distillation mslearn readme
* Small change
* Fix link
* Update paths
* Update link to qa_math notebook
* Fix paths
* Fix paths again
* Dummy rename
* Lowercase folders
* Remove tmp file
2024-09-30 13:19:52 -07:00
3939a012ef
Update cohere command sample ( #3393 )
...
* Update embedding sample
* Command - Update webrequests.ipynb
* Command - Update openaisdk.ipynb
* Command - Update langchain.ipynb
* Command - Update cohere-cmdR.ipynb
* Command - Update litellm.ipynb
* Formatted filed
* Remove embedding sample
* Update command_tools-langchain.ipynb
* Update command_tools-langchain.ipynb
2024-09-27 09:37:47 -07:00
cf7d2d49fa
Update RAI image and text component versions to 0.0.19 ( #3394 )
...
* update component versions
* update env and model name suffix
* update version string for new env
* fixups
2024-09-26 16:49:44 -07:00
948daae53c
Update mlflow-model-local-inference-test.ipynb ( #3391 )
...
* update mlflow-model-local-inference-test.ipynb
* fix linting
2024-09-20 19:03:24 +05:30
73242bf521
Add NVIDIA model samples ( #2836 )
...
* Add placeholder samples
* Added powershell for cli
* deployment notebook added
* updated notebook
* Evaluation
* yaml file updated
* yaml file updated
* Fix
* PTuning notebook
* Rename
* Format
---------
Co-authored-by: vikasagrawal-ms <vikasagrawal@microsoft.com>
Co-authored-by: HrishikeshGeedMS <hgeed@microsoft.com>
Co-authored-by: Aditi Singh <47007177+Addi-11@users.noreply.github.com>
2024-09-19 14:21:14 +05:30
76e6b2cabc
update actions/upload-artifact@v2 to actions/upload-artifact@v3 becau… ( #3378 )
...
* update actions/upload-artifact@v2 to actions/upload-artifact@v4 because v2 has been deprecated
* update actions/upload-artifact to v3 to buy us more time
* revert generative-ai docx
2024-09-12 13:11:30 -04:00
b01a262eeb
Add information on deploying distillation output model ( #3354 )
...
* Add information on deploying distillation output model
* Reformat with black
* Fix versioning info
* Add FT model name output method to deploy
* Formatting fixes
* format with black
* add teacher model deployment
* uncomment dependencies for the auto-runner
---------
Co-authored-by: Sharvin Jondhale <shjondhale@microsoft.com>
2024-09-11 23:01:06 +05:30
eb0183bec4
Math distillation notebook ( #3341 )
...
* Initial math distillation notebook
* Add colon
* Add math distillation notebooks
* Code quality
* Rename notebook
* Remove duplicate
* Add a comment
* Comment
* Update link
* Remove unnecessary comments
* Dummy change
* Redo the cell
* Remove metadata
2024-09-06 10:26:19 -07:00
611e310545
Update env names to new name - responsibleai-tabular, responsibleai-text, responsibleai-vision ( #3369 )
...
* update
* update
2024-09-04 12:56:31 -04:00
a606320535
Add MaaS FT chat-completion notebook ( #3360 )
...
* added ft notebook
* added files
* format
* format ipynb
* Update CODEOWNERS
* code owners
* format
* address comments
* address comments
* Update CODEOWNERS
* format
2024-09-03 17:20:19 -07:00
5702c4ffd4
jamba 1.5 client samples ( #3358 )
...
* meta-llama-3.1 client samples
* black formatting
* Update langchain.ipynb
* jamba 1.5 client sample release
---------
Co-authored-by: shail2208 <59747407+shail2208@users.noreply.github.com>
2024-08-30 17:18:42 +05:30
cb0bf2d053
remove env var for pf run mode ( #3359 )
2024-08-30 15:06:26 +05:30
0e8aaffe0a
Prevent notebook execution failure by avoiding mlclient private field… ( #3327 )
...
* Prevent notebook execution failure by avoiding mlclient private field access warning
* Take changes from Kevin's PR for blocking workflows
* update notebooks
* update flakes
* revert failing notebooks
* Revert "revert failing notebooks"
This reverts commit 14f3163ef7
2024-08-21 21:55:58 +05:30
cb3b0343fc
chore: Switch to sha256 from md5 to remedy CodeQL warning ( #3356 )
...
This use of md5 doesn't appear to be a cryptographically sensitive
context, but the easiest remediation for the CodeQL warning is to
switch to an approved hash function.
2024-08-20 10:58:36 -07:00
4ac0485898
Fix blbooksgenre notebook failures due to error on deployment ( #3353 )
2024-08-19 15:10:10 -04:00
f2efd5a40d
fix dependency ( #3352 )
2024-08-19 15:27:36 +08:00
07a31fcc01
Upgrade pytorch 1.13 to 2.2 ( #3350 )
2024-08-15 15:50:44 -07:00
cc8649bb86
Added the notebook for the conversation distillation task ( #3347 )
2024-08-14 10:10:32 +05:30
cabd0a5846
updated minimal image version ( #3346 )
2024-08-13 11:56:07 -07:00
a46bb8ef9b
Distillation qanda ( #3335 )
...
* Q and A Distillation Example
* Create distillation_qanda - Copy.ipynb
Distillation Q and A changes
* Changes for distillation Q&A
* Changes for black validation and utils for download dataset
2024-08-13 23:08:29 +05:30
ce99aa8908
fix(ci): Add workaround to circumvent azure-cli's lack of support for ID token refresh ( #3328 )
...
* fix: Eagerly request token scopes
* chore: Regenerate workflows to pick up token caching change
2024-08-12 14:48:51 -04:00
a80fd77abf
Fix fridge dataset URL in RAI notebooks to point to new blob storage location as cvbp was removed ( #3336 )
2024-08-09 00:58:57 -04:00
1a086dac41
Adding a test for distillation notebook ( #3331 )
...
* Adding a test for distillation notebook
* Commenting out a part of the checks
* Corrections
* Corrections
* Minor fixes
* Push the fixes
* Changes to force re-run of tests
* Uncommenting code in the tets file
* Adding -ve tests
* Fixes
---------
Co-authored-by: Chakrapani Ravi Kiran S <ravichak@microsoft.com>
2024-08-06 10:07:51 +05:30
6e32c21eb4
Update responsibleaidashboard-text-classification-blbooksgenre.ipynb ( #3280 )
...
* Update responsibleaidashboard-text-classification-blbooksgenre.ipynb
* Update responsibleaidashboard-text-classification-blbooksgenre.ipynb
* Update responsibleaidashboard-text-classification-blbooksgenre.ipynb
* Update responsibleaidashboard-text-classification-blbooksgenre.ipynb
* Update responsibleaidashboard-text-classification-blbooksgenre.ipynb
2024-08-05 13:13:43 -07:00
7aafd2760b
add n_best_runs param detail ( #3326 )
2024-08-01 18:41:18 +05:30
a0e49f8e4e
Vision Datasets location Update ( #3289 )
...
* adding continue_on_step_failure False and force_rerun True for vision pipelines
* adding continue_on_step_failure False and force_rerun True for vision pipelines
* adding continue_on_step_failure False and force_rerun True for vision pipelines
* update datasets location
* Replace remaining references to multiclass classification data.
* Replace remaining references to multilabel classification data.
* Replace remaining references to object detection data.
* Replace remaining references to instance segmentation data.
* Patch .zip url.
* Install numpy version compatible with scikit-image==0.19.3.
* Use different names for data sources to prevent job failures due to same name being used at the same time.
---------
Co-authored-by: Radu-Mihai Dondera <rdondera@microsoft.com>
2024-07-31 21:11:38 +05:30
eb698e91b6
Updated image data source ( #3278 )
...
Co-authored-by: Rupal jain <rupaljain@microsoft.com>
2024-07-30 21:57:25 -07:00
ec01090070
Updated image data source ( #3277 )
...
Co-authored-by: Rupal jain <rupaljain@microsoft.com>
2024-07-30 15:56:34 -07:00
0de88c91c0
Llama distillation notebook fixes ( #3322 )
...
* Adding missing datasets package
* Doc explaining TEACHER_MODEL_ENDPOINT_NAME and TEACHER_MODEL_NAME
* mlclient.models.get requires version or label
* data directory must be created prior to saving datasets
* Only one sample is saved in train and valid JSONL files
- was using `w` mode which replaces the file with each dataset JSON row, leaving only one sample at the end
- replaced `w` write mode with `a` append mode so that all JSON lines are saved to train and valid files
* Experiment name cannot contain `.`
- Llama 3.1 models have `.` in their names, thus failing the experiment name constraint of not having a `.`
* Printing studio progress URL
* Llama 3.1 marketplace subscription prerequisites
2024-07-29 22:43:36 +05:30
b7dc63b182
meta-llama-3.1 client samples ( #3304 )
...
* meta-llama-3.1 client samples
* black formatting
* Update langchain.ipynb
---------
Co-authored-by: shail2208 <59747407+shail2208@users.noreply.github.com>
2024-07-25 10:56:13 -07:00
0f676621ca
Cohere-rerank-samples ( #3305 )
...
* Create cohere-webrequests.ipynb
* Create rerank-cohere-client.ipynb
* Rename cohere-webrequests.ipynb to rerank-webrequests.ipynb
* Create rerank-3-langchain.ipynb
* Update rerank-webrequests.ipynb
* Update rerank-webrequests.ipynb
* Update rerank-webrequests.ipynb
* Update rerank-webrequests.ipynb
* reformatted
2024-07-25 08:20:23 -07:00
0d02248521
Mistral sample update ( #3308 )
...
* Update langchain.ipynb
* Update langchain.ipynb
* Update litellm.ipynb
* Update mistralai.ipynb
* Update openaisdk.ipynb
* update the prereuisites to refelct current information
* Update langchain.ipynb
* Update litellm.ipynb
* Update mistralai.ipynb
* Update openaisdk.ipynb
* Update webrequests.ipynb
2024-07-24 09:10:00 -07:00
7060507567
Upgrade to sklean-1.5 ( #3303 )
2024-07-23 14:04:20 -07:00
cf060c0b72
Add feature store sample running on synapse notebook ( #3302 )
...
* Add feature store sample running on synapse notebook
* clean up
* reformat
2024-07-23 09:57:55 -07:00
08542cec5e
Distillation and Synthetic data gen notebook ( #3307 )
...
* Distillation and Synthetic data gen notebook
* Black
2024-07-23 08:40:52 -07:00
ef4f57a7fa
update OneHotEncoder arg sparse to sparse_output ( #3298 )
2024-07-22 13:21:47 -04:00
c939dec7f2
Upgrade to sklearn-1.5 from sklearn-1.1 ( #3301 )
2024-07-19 13:53:57 -07:00
70f0ddd0cf
Upgraded to sklearn-1.5 ( #3300 )
2024-07-19 11:44:25 -07:00
f52c4985bf
Upgrade to sklearn-1.5 ( #3293 )
2024-07-18 11:24:18 -07:00
68f69766ab
Update image version to latest in RAI notebooks ( #3279 )
...
* Update responsibleaidashboard-diabetes-decision-making.ipynb
* Update responsibleaidashboard-diabetes-regression-model-debugging.ipynb
* Update responsibleaidashboard-ed-student-attrition-clf.ipynb
* Update responsibleaidashboard-finance-loan-classification.ipynb
* Update responsibleaidashboard-healthcare-covid-classification.ipynb
* Update responsibleaidashboard-housing-classification-model-debugging.ipynb
* Update responsibleaidashboard-housing-decision-making.ipynb
* Update responsibleaidashboard-programmer-regression-model-debugging.ipynb
* Update responsibleaidashboard-multilabel-text-classification-covid-events.ipynb
* Update responsibleaidashboard-text-classification-DBPedia.ipynb
* Update responsibleaidashboard-text-classification-blbooksgenre.ipynb
* Update responsibleaidashboard-text-question-answering-squad.ipynb
* Update responsibleaidashboard-text-classification-financial-news.ipynb
* Update responsibleaidashboard-automl-image-classification-fridge.ipynb
* Update responsibleaidashboard-automl-object-detection-fridge-private-data.ipynb
* Update responsibleaidashboard-image-classification-fridge.ipynb
* Update responsibleaidashboard-image-flower-classification.ipynb
* Update responsibleaidashboard-image-multilabel-classification-fridge.ipynb
* Update responsibleaidashboard-object-detection-MSCOCO.ipynb
* Update cli-responsibleaidashboard-housing-classification.yml
* Update train_housing.yml
* Update cli-responsibleaidashboard-programmer-regression.yml
* Update train_programmers.yml
2024-07-11 16:16:38 -07:00
c939235f02
[ParallelRunStep] Fix PRS example numpy version issue. ( #3274 )
...
* fix pipeline parallel mnist issue
* remove tf
---------
Co-authored-by: Xiaole Wen <xiwe@microsoft.com>
2024-07-10 14:44:59 +05:30
6188c0269d
adding NPS extension to avoid forcing network policy ( #3270 )
...
* adding NPS extension to avoid forcing network policy
* formatting fix
* fixing formatting
* formatting
* formating fix
2024-07-09 20:53:12 +05:30
af8f6f364a
Fix typo in parameter name ( #3266 )
2024-07-04 17:46:14 +05:30
d4c90eead3
fix: parallel related samples failed in inference ( #3261 )
2024-07-01 18:44:52 +08:00
6081e562bf
AI21 Jamba Instruct fixes ( #3254 )
...
* ai21 labs jamba instruct samples
* fix code quality issues
* update files
---------
Co-authored-by: Shail Shah <shaisha@microsoft.com>
2024-06-21 08:07:21 -07:00
332153bf7c
Renamed the filenames to a shorter form. ( #3255 )
...
* Renamed the filenames to a shorter form.
* Renamed the filenames to a shorter form.
2024-06-21 20:05:13 +05:30
f80bb1c1d1
AutoML Vision and NLP SDK pipeline fix ( #3250 )
...
* adding continue_on_step_failure False and force_rerun True for vision pipelines
* adding continue_on_step_failure False and force_rerun True for vision pipelines
* adding continue_on_step_failure False and force_rerun True for vision pipelines
* update env for model registration custom component
2024-06-20 09:41:00 +05:30
9be775a2f5
chore: Use OIDC to authenticate to Azure in Github Actions ( #3253 )
...
* chore: Use federated credential in readme.py
* chore: Update cli workflows to use federated credentials
* chore: Update tutorial workflows to use federated credentials
* chore: Update sdk workflows to use federated credentials
* chore: Normalize line-ending for sdk-foundation-models-azure_openai-oai-v1-openai_completions_finetune.yml
* chore: Use federated credentials in sdk-foundation-models-azure_openai-oai-v1-openai_completions_finetune.yml
* chore: Update remaining workflows to use federated credentials
2024-06-19 16:55:28 -04:00
azure-sdk
Ilya Matiach
sanchez-alex
shubhirajMsft
James Chao
Rahul Kumar
Sasidhar Kasturi
hakotesova
Sharvin J
Vinutha Karanth
Srujan Saggam
Thasmika Gokal
Blanca Li
Ayush Mishra
kdestin
Han Wang
jeff-shepherd
HarshaVardhanBabu
Satwik Kumar
visahan-24
scravikiran
tongy-msft
Rupal jain
Cedric Vidal
Kriti
Fred Li
qusongms
xiaolewen
Amit Chauhan
aggarwal-k
Xingzhi Zhang
Nivedita Mishra