0b3e8e221b
testing with 3 nodes and removing the ws details
2024-06-13 21:09:09 +05:30
49d1419bbd
adding the llama3 notebook on nc compute
2024-06-13 19:05:05 +05:30
b34a0c67e3
change endpoint suffix number of a job ( #3238 )
2024-06-13 14:16:24 +08:00
5e82d100e1
Update deploy-moe-keyvault.sh ( #3227 )
2024-06-12 10:38:33 +08:00
fb8b92c341
fix long name ( #3224 )
2024-06-11 14:53:54 +05:30
54902a8b36
updating doc codeowners for week of June 10, 2024 ( #3228 )
...
* updating doc codeowners for week of June 10, 2024
* updating doc codeowners for week of June 10, 2024
2024-06-10 13:00:01 -04:00
6027ae5b6e
Add additional includes example ( #2341 )
...
* update
* use sdk readme in master
* revert to master
* reformat
2024-06-05 10:34:27 +08:00
c8bc451f53
Update CODEOWNERS ( #3220 )
2024-05-31 15:20:20 -05:00
3cfb5501c0
provision managed network for workspace before creating deployment ( #3203 )
2024-05-30 23:10:46 -07:00
299ea72980
Sdg rename notebooks ( #3210 )
...
* renaming notebooks for docs
* rename notebook in NOT_TESTED_NOTEBOOKS
* add workflows
* fix names in featurestore jobs
* remove workflows
* remove from readme as well
* rename notebooks
* black
* put back automation tests
* change .ipynb to .py
* more .ipynb -> .py
* change names in setup-resources.sh
* remove test notebook 7 for now
2024-05-30 14:13:20 -05:00
ade8c97f75
Adding Llama-3 to text-generation notebooks ( #3219 )
2024-05-30 17:16:27 +05:30
75568dca0e
fix: try not to specify the version ( #3214 )
2024-05-28 08:44:21 -04:00
18e902fd28
[Vision & Multimodal] Introducing Dreambooth Finetuning Examples ( #3167 )
...
* Dreambooth text to image finetuning notebook examples (#3148 )
* db finetuning notebook examples
* notebbok draft
* notebbok draft
* notebbok draft
* sanity
* rename example file; updates
* SD DB FT Update
---------
Co-authored-by: grajguru <grajguru@microsoft.com>
Co-authored-by: Rupal Jain <rupaljain@microsoft.com>
* rename diffusers_text_to_image_dreambooth_finetuning_pipeline to diffusers_text_to_image_dreambooth_pipeline (#3153 )
* CLI and notebook examples for text to image diffusion models (#3154 )
* CLI and notebook example for dreambooth finetuning
* notebook update pipeline
* notebook
---------
Co-authored-by: gaurav <rajguru@microsoft.com>
Co-authored-by: grajguru <grajguru@microsoft.com>
* updates
* update name
* black format
---------
Co-authored-by: Gaurav Rajguru <rajgurugaurav77@gmail.com>
Co-authored-by: grajguru <grajguru@microsoft.com>
Co-authored-by: gaurav <rajguru@microsoft.com>
2024-05-24 15:52:48 +05:30
57eb7caee6
Update responsibleaidashboard-text-classification-blbooksgenre.ipynb ( #3211 )
...
* Update responsibleaidashboard-text-classification-blbooksgenre.ipynb
* Update responsibleaidashboard-text-classification-blbooksgenre.ipynb
* Update responsibleaidashboard-text-classification-blbooksgenre.ipynb
2024-05-22 12:32:40 -07:00
7f824f000a
Update webrequests.ipynb ( #3208 )
...
* Update webrequests.ipynb
* Update litellm.ipynb
* Update openaisdk.ipynb
2024-05-21 09:54:06 -07:00
815232546d
MaaP/MaaS ( #3202 )
...
* init
* black
* system
2024-05-21 14:43:16 +00:00
e1564539f1
SDK, CLI examples for phi-3-mini ( #3195 )
...
* Add sdk example for phi-3-min-v
* Added CLI as well
* Update SKU and model name
* Update deploy.yml
* Update sample_chat_completions_score.json
* Update sample_chat_completions_score.json
* Update online-endpoint-chat-completions-inference.ipynb
* updates to examples
* updates to examples
* updates to examples
* reviews
* apply black formatting on the notebook
* clean up imports
* add sdk sample for aoai style inference
---------
Co-authored-by: Rupal jain <rupaljain@microsoft.com>
Co-authored-by: svaruag <gasi@microsoft.com>
2024-05-21 20:11:19 +05:30
0833e2784a
Add JAIS MaaS Sample ( #3187 )
...
* Create webrequests.ipynb
* Create litellm.ipynb
* Create openaisdk.ipynb
* Update webrequests.ipynb
* Update webrequests.ipynb
Test with Llama change
* Update webrequests.ipynb
* Update webrequests.ipynb
* Update webrequests.ipynb
2024-05-21 19:39:00 +05:30
38bcd7181f
[Vision & Multimodal] Example Updates ( #3179 )
...
* adding continue_on_step_failure False and force_rerun True for vision pipelines
* adding continue_on_step_failure False and force_rerun True for vision pipelines
* adding continue_on_step_failure False and force_rerun True for vision pipelines
* Model version updates
* Model version updates
2024-05-21 08:55:52 +05:30
ccc9f8dba6
feat: add tigemen docs ( #3196 )
...
* feat: add timegen nbs
* feat: add codeowner
* feat: add prerequisites to all tutorials
* feat: ci errors
* fix: rm outputs
---------
Co-authored-by: Kriti <53083330+fkriti@users.noreply.github.com>
2024-05-20 14:21:14 -07:00
9a48258ce5
New file to run the parallel processing code in VS locally. ( #3165 )
...
* Add files via upload
* Add files via upload
* Update d_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update e_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update local_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update crack_and_chunk_with_doc_intel_parallel_component.ipynb
* Update crack_and_chunk_with_doc_intel_parallel_component.ipynb
* Update d_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update e_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update f_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update local_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Add files via upload
update MLIndex retrieval
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
reformatted by black
* Update d_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update e_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update f_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update local_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
2024-05-20 10:43:41 -07:00
5f95c8ad20
Adding disclaimer ( #3204 )
2024-05-20 20:41:54 +05:30
55e41235b6
adding validation for inference compute allow list ( #3194 )
2024-05-19 11:54:06 -07:00
8742943d1a
update langchain code and notebook ( #3201 )
2024-05-16 15:56:16 -07:00
dd4238ee3c
Update CODEOWNERS ( #3200 )
...
manual update to fix long name
2024-05-16 12:58:22 -05:00
263ae9e70f
Update DBCopilot notebook ( #3184 )
...
* Update DBCopilot notebook
* fix
* fix
2024-05-16 13:44:54 -04:00
607923d372
Updated 1_langchain_basic_deploy.ipynb markdown section to add content related to build. This example will be used to refer to annoucemnt for support of deploying lanchain app on manged online endpoint. Micky Lu and team will update the example with add quick start image ( #3197 )
2024-05-16 10:28:19 -05:00
da728ed2f2
Update CODEOWNERS ( #3191 )
...
* Update CODEOWNERS
* Update CODEOWNERS
2024-05-15 16:47:19 -05:00
8a5c1c0540
resolving conflicts between training args and optimization args ( #3193 )
...
* resolving conflicts between training args and optimization args
* Changing the log text
* black formatting
* adding the pipeline name to the notebook
2024-05-15 09:55:52 -07:00
df0bfcc87b
removing the pipeline validation which fails due to missing path ( #3192 )
2024-05-15 17:09:15 +05:30
9fb5486047
add section for disabling profile ( #3182 )
...
* add section for disabling profile
* fix typo
2024-05-14 09:55:50 -07:00
93bb9a8d8d
fix when the job fails and doesn't kick the node ( #3186 )
...
* fix when the job fails and doesn't kick the node
* reformat
2024-05-13 13:28:16 -07:00
ec99008885
bump RAI text and vision component versions to 0.0.16 ( #3185 )
2024-05-13 14:43:28 -04:00
a538b0d73e
update image to fix vuln ( #3183 )
2024-05-13 10:25:37 -07:00
03f91685e4
Update image for failing CLI samples ( #3178 )
2024-05-10 11:03:34 -07:00
a745467075
checking for computes in 'finetune_compute_allow_list' instead of 'compute_allow_list' ( #3180 )
2024-05-10 18:23:57 +05:30
2ac3a19d4f
Fixing cli-jobs SDK/CLI Samples are FailingFix more environments - 2 ( #3174 )
...
Co-authored-by: Gerard <GerardJWoods@live.com>
2024-05-08 11:19:27 -07:00
6b00e79603
Fixing cli-jobs SDK/CLI Samples are FailingFix more environments ( #3169 )
...
* Fix more environments
* Fix this issue
---------
Co-authored-by: Gerard <GerardJWoods@live.com>
2024-05-07 16:57:08 -07:00
00f79f6da0
Upgrade pytorch curated environment ( #3168 )
...
* Upgrade pytorch in samples because the PyTorch 2.0 and 2.1 curated environments are being retired
2024-05-07 11:46:44 -07:00
fa2caa094f
fix readme with nhc descriptions ( #3162 )
2024-05-06 15:16:57 -07:00
4065472ba7
update image versions for rai cli notebooks ( #3163 )
2024-05-06 17:29:58 -04:00
f925f079a6
update RAI image version to latest for mlflow-deployment-with-explanations example notebook ( #3160 )
2024-05-06 17:26:11 -04:00
07be474468
Fix old Command Job Environment References ( #3157 )
...
* Update sdk/python/setup.sh to target fresh built azure-ai-ml wheel.
* Update Bad environments
* miss on the environment for tensorflow
* Remove other change
---------
Co-authored-by: azure-sdk <azuresdk@microsoft.com>
Co-authored-by: Gerard <GerardJWoods@live.com>
2024-05-06 10:40:10 -07:00
f5b4e34a95
[pipeline] Update pipeline samples to use environment with Python 3.8 ( #3161 )
...
* fix: use CE with py38 for 1J sample
* fix: use py38 in conda envs
* revert densenet
* revert missing
2024-05-06 13:08:04 -04:00
eeee281e71
Create README.md for managed folder of online endpoint ( #2642 )
2024-05-03 18:22:20 -07:00
214cda4a29
Kritifaujdar/mistral ( #3133 )
...
* Update langchain.ipynb
* Update litellm.ipynb
* Update mistralai.ipynb
* Update openaisdk.ipynb
* Update webrequests.ipynb
2024-05-03 12:20:44 -07:00
9a68c3c0fc
Fix imports for deleting compute cluster ( #3158 )
...
* add cells to delete compute clusters
* remove extraneous import
2024-05-03 13:49:32 -05:00
8be672642f
Helenzusa1 parallel ( #3140 )
...
* Create d
* Delete sdk/python/generative-ai/rag/notebooks/custom_crack_and_chunk_parallel/d
* Create c
* Add files via upload
* Delete sdk/python/generative-ai/rag/notebooks/crack_and_chunk_parallel/c
* Delete sdk/python/generative-ai/rag/notebooks/crack_and_chunk_parallel/crack_and_chunk_with_doc_intel_parallel_component.ipynb
* Delete sdk/python/generative-ai/rag/notebooks/crack_and_chunk_parallel/d_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Delete sdk/python/generative-ai/rag/notebooks/crack_and_chunk_parallel/e_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Delete sdk/python/generative-ai/rag/notebooks/crack_and_chunk_parallel/f_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Create c
* Add files via upload
* Delete sdk/python/generative-ai/rag/notebooks/custom_crack_and_chunk_parallel/c
* Create c
* Add files via upload
* Delete sdk/python/generative-ai/rag/notebooks/custom_crack_and_chunk_parallel/crack_and_chunk_with_doc_intel/c
* Update crack_and_chunk_parallel.py
* Update d_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update e_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update f_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update crack_and_chunk_with_doc_intel_parallel_component.ipynb
* Update crack_and_chunk_with_doc_intel_parallel_component.ipynb
* Update d_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update e_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update f_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update d_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update e_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update f_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update d_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update e_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update f_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update crack_and_chunk_with_doc_intel_parallel_component.ipynb
* Update d_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update d_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update e_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update f_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update e_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update f_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Create Dockerfile
* Update Dockerfile
* Update crack_and_chunk_with_doc_intel_parallel_component.ipynb
* Update f_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update crack_and_chunk_with_doc_intel_parallel_component.ipynb
* Create f
* Add files via upload
* Delete sdk/python/generative-ai/rag/notebooks/custom_crack_and_chunk_parallel/pdfs/f
* Update d_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update e_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update f_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update d_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update e_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update f_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update crack_and_chunk_with_doc_intel_parallel_component.ipynb
* Update crack_and_chunk_with_doc_intel_parallel_component.ipynb
* Update d_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update e_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update f_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Update crack_and_chunk_parallel.py
* Add files via upload
* Add files via upload
* Update crack_and_chunk_with_doc_intel_parallel_component.ipynb
* Update crack_and_chunk_with_doc_intel_parallel_component.ipynb
* Update crack_and_chunk_with_doc_intel_parallel_component.ipynb
* Update crack_and_chunk_with_doc_intel_parallel_component.ipynb
* Update crack_and_chunk_with_doc_intel_parallel_component.ipynb
* Update crack_and_chunk_with_doc_intel_parallel_component.ipynb
* Update d_parallel_crack_pdfs_with_azure_document_intelligence.ipynb
* Add files via upload
remove some comment lines.
2024-05-02 18:24:45 -07:00
9adb3b7951
add cells to delete compute clusters ( #3155 )
2024-05-02 16:53:33 -05:00
a3a1c5946f
Add nhc command job ( #3016 )
...
* add nhc checks
* fix process_count_per_instance
* Add job description
* update readme
* Add wrapper script
* update readme with changes
* remove testing files
* remove uneeded env file
* add node kick command
* reformat
* add node id print
* add fallocate command
* update fallocate
* update readme and reformat
* add 3T
* use new mcr image
* Add kick_bad_node flag
* format code
* add entry to Training readme
* add setup script
2024-04-30 09:13:40 -07:00
Pavan Manoj Jonnalagadda
siyuZL
Rachel Yong
MadhuM02
Larry Franks
Cloga Chen
Samantha Salgado
SeokJin Han
Sheri Gilley
skanakamedal
Xingzhi Zhang
Rupal jain
tongy-msft
hazemelh
Facundo Santiago
shubhamiit
azul
Helen Zeng
Aman Gupta
Chuyuan Qu
XiangRao
Anupam
cassieesvelt
Ilya Matiach
hakotesova
Gerard@msft
jeff-shepherd
James Chao
Zhengfei Wang
Kriti