* chore: Use federated credential in readme.py
* chore: Update cli workflows to use federated credentials
* chore: Update tutorial workflows to use federated credentials
* chore: Update sdk workflows to use federated credentials
* chore: Normalize line-ending for sdk-foundation-models-azure_openai-oai-v1-openai_completions_finetune.yml
* chore: Use federated credentials in sdk-foundation-models-azure_openai-oai-v1-openai_completions_finetune.yml
* chore: Update remaining workflows to use federated credentials
* Update the number of outbound rules expected
* Add automation test for vnet scenario
* Update name suffix
* Update name suffix
* Add keyvault outbound rule
* Add comment
* Update assertion
* Added RAI Vision Flower Classification Scenario
* Update Code for overwriting same version od data if exists
* Code Updated
* updated rai flower classification notebook for data asset version, included libraries
* enable create new ws for oai
* set env var
* export env var
* setting location
* setting location
* removed acr access
* removed all unnecessary verifications
* changed dataset format
* Added RAI Tabular Education Scenario Updated the Config ini
* Update the Compute in rai education scenario notebook
* Updated AZ Login Code for rai fianance notebook
* Incresed the Timeout in rai education scenario notebook
* Update code for workspace login for RAI education notebook
* Increased the timeout for RAI Generation
* doc: flow in pipeline for cli
* doc: flow in pipeline sdk experience
* doc: remind to grant permission to compute cluster
* Update README.md
* Update README.md
* Update flow_in_pipeline.ipynb
* update readme for cli sample
* move bs4 inside tool function to reduce dependency for compile
* doc: add information for office usage
* doc: update component spec glob
* feat: add requirements
* azure-ai-ml is released
* fix: smoke
* fix: resolve comments
* ci: add ci for flow in pipeline
* doc: update readme
* fix: smoke
* create connection with wrong settings
* fix: smoke
* fix: highlight schema requirement
* feat: use a sample without connection
* fix: include flow.tools.json
* fix: update text
* fix: remove connection creation
* fix: update input setting
* fix: remove connection reference in python tool
* fix: flow run setting
* fix: further clean connection reference
* feat: use the same pipeline in cli and sdk
* fix: black
* fix: make 2 example align
* Add code quality checks for python/jupyter
* refactor: Remove .github/workflows/smoke.yml
Superceded by .github/workflows/code-quality-python.yml
* refactor: Remove smoke.yml badge from README files
* chore: Trigger .github/workflows/code-quality.yml on pushes to main
* oaiv2 sdk example
* modified workflows and notebooks
* removed all cell outputs
* removed old files
* changed cron param
* reverted cron param
* black format
* Added cli examples for new finetune pipeline component (#2711)
* Added cli examples for new finetune pipeline component
* Added screenshots for cli examples
* added and renamed cli workflows
* directory fixes
* Vvatsalya/fix cli oai v2 workflow (#2717)
* setting location as ncus
* set in setup-cli step
* new init and setup script for oai v2
* correcting syntax for init sh
* fix init oai v2 script
* fix
* fix 1
* fix 2
* change training dataset name in cli oai v2 example
* sdk workflow region change
* use oai as suffix in ws name
* added oai v1 and v2 in readme for cli and sdk
* adding install reqs for sdk
---------
Co-authored-by: Vishal Vatsalya <98515131+vvatsalya@users.noreply.github.com>
Co-authored-by: Vishal Vatsalya <vvatsalya@microsoft.com>
Co-authored-by: Ayush Mishra <61145377+novaturient95@users.noreply.github.com>
* Add automation test for featurestore cli notebooks
* Sample updates for AML Spark managed VNet GA. (#2656)
* Sample updates for AML Spark managed VNet GA.
* Updated notebook title. Triggering build to test.
* Updated workspace name to include timestamp. Triggering build to test.
* Shortened VNet workspace name to meet validation.
* README.md clean-up and fixes for AML Spark samples.
* README.md clean-up and fixes for AML Spark samples.
* chore: Remove 'Send IcM on Failure' step from tutorial workflows (#2670)
* chore: Remove 'Send IcM on Failure' step that hasn't been in use for a while
* chore: Run tutorials/readme.py
* chore: Remove unused local 'generate-icm' action
* update cron schedules to avoid endpoint deletion from automated resource cleanup (#2672)
* change starting hour for workflow
* update cron for text mc mlflow
* use python 3.8.* (#2678)
* use python 3.8.18
* Update cleanup.yml
* update usepython v4
* Update workstation_env.yml (#2680)
* Examples for online inference for LLaVA (#2671)
* Rough version of ITT notebook.
* Working version of the notebook.
* Minor improvements.
* Rough version of the CLI demo.
* Reformat with black.
* Remove mode parameter in call to prepare_data.py.
* Make code cells easier to read.
* Minor readability improvement.
* Format with black.
* Minor fixes and reformatting.
* Reformat with black.
* Update workstation_env.yml (#2681)
delete extraneous space
* update vision FT examples corresponding to recent component update (#2650)
* updating changes with ME component
* updating MMOD as well
* update MMOD cli
* separate section for model evaluation component
* remove ds ort true for classification
* black check
* Remove v1 references (#2675)
* Remove v1 samples from v2 repo
* Remove v1 from table of contents
* Remove v1 test files
* Remove v1 test files
* Remove v1 folder from README
* Remove v1 folder
* Remove v1 tests
* Delete v1 files
* Restore custom-container directory
* Restore custom-container/triton directory
---------
Co-authored-by: Yogi Pandey <20666257+ynpandey@users.noreply.github.com>
Co-authored-by: kdestin <101366538+kdestin@users.noreply.github.com>
Co-authored-by: Rehaan Bhimani <rbhimani@microsoft.com>
Co-authored-by: Ada <61294872+adrosa@users.noreply.github.com>
Co-authored-by: Sheri Gilley <sgilley@microsoft.com>
Co-authored-by: rdondera-microsoft <98922913+rdondera-microsoft@users.noreply.github.com>
Co-authored-by: shubhamiit <41925087+shubhamiit@users.noreply.github.com>
Co-authored-by: Diondra <16376603+diondrapeck@users.noreply.github.com>
* chore: Remove 'Send IcM on Failure' step that hasn't been in use for a while
* chore: Run tutorials/readme.py
* chore: Remove unused local 'generate-icm' action
* Enable automation test for featurestore samples
* Update setup resources
* Fix typo and reformat the notebook
* Add python package to cluster
* Add import package
* Run script sequentially
* Put script run in the same process
* Update to python output command
* Replace output command in all notebooks during test
* Update mounted path
* Update the relative path
* Restructure the file hierarchy
* Regenerate feature store notebook workflow
* Update relateive path
* List folder in current path
* Update relative folder path
* Update storage account name and user object id
* Get signed in user id
* Update user object id
* Update user id
* Enable notebook 1 first
Add two LLM example notebooks detailing how to deploy Langchain and Semantic Kernel apps to AzureML Online Endpoints.
---------
Co-authored-by: Vanessa Arndorfer <vaarndor@microsoft.com>
* Migrate existing notebooks to the azureml-examples repo from azureml-foundation-models (#2432)
Co-authored-by: grajguru <grajguru@microsoft.com>
* vision batch deployment cli and sdk notebook (#2433)
* vision batch deployment cli and sdk notebook
* black formatting
* Comments
* comments
* updated to take latest version in FT notebooks
---------
Co-authored-by: grajguru <grajguru@microsoft.com>
* port docs folder to azureml-examples from foundational repo (#2440)
* port docs folder to azureml-examples from foundational repo
* repair relative path
---------
Co-authored-by: grajguru <grajguru@microsoft.com>
* Image notebook/cli param update (#2435)
* notebook/cli param update
* notebook param update
* cli param update
* notebooks updated to foundational model
* vision batch deployment cli and sdk notebook (#2433)
* vision batch deployment cli and sdk notebook
* black formatting
* Comments
* comments
* updated to take latest version in FT notebooks
---------
Co-authored-by: grajguru <grajguru@microsoft.com>
* notebook/cli param update
* notebook param update
* notebook/cli param update
* notebook param update
* cli param update
* notebooks updated to foundational model
* notebook/cli param update
* notebook param update
* notebooks updated to foundational model
* notebook/cli param update
* notebook param update
* notebook/cli param update
* notebooks updated to foundational model
* cli update
* doc update
* addressing comments
---------
Co-authored-by: Gaurav Rajguru <rajgurugaurav77@gmail.com>
Co-authored-by: grajguru <grajguru@microsoft.com>
* MMD OD/IS sdk, cli examples; Update HuggingFace Classification examples (#2477)
* MMD OD/IS sdk, cli examples; Update HuggingFace Classification examples
* update examples
* instance segmentation infer notebooks
* typo
* update mmd docs
* CLI inference examples for OD and IS
* example updates; resolving review comments
* update compute name; dataets version
* update compute name
* update remove image_min_size and image_max_size from OD and IS
* Using yolof_r50_c5_8x8_1x_coco in OD example notebook
* update reistry for inference
---------
Co-authored-by: grajguru <grajguru@microsoft.com>
* updates for sdk/cli inference examples (#2525)
* updates for sdk/cli inference examples
* deploying from azureml-staging erroring out
* Solved bugs in finetuning vision yamls. (#2528)
Co-authored-by: grajguru <grajguru@microsoft.com>
* Rjaincc/vision foundation model (#2529)
* updates for sdk/cli inference examples
* deploying from azureml-staging erroring out
* updates to sdk, cli examples
* Create MLConfig from passed argument (#2532)
* Create MLConfig from passed argument
* use default cred
---------
Co-authored-by: grajguru <grajguru@microsoft.com>
* Updating col names for batch scoring (#2533)
* updates for sdk/cli inference examples
* deploying from azureml-staging erroring out
* updates to sdk, cli examples
* updating score col names while fetching batch scoring output
* Reverting updating col names for classification batch scoring (#2534)
* updates for sdk/cli inference examples
* deploying from azureml-staging erroring out
* updates to sdk, cli examples
* updating score col names while fetching batch scoring output
* updating score col names while fetching batch scoring output for classification
* Nvijayrania/fix steam job issue (#2530)
* updates for sdk/cli inference examples
* deploying from azureml-staging erroring out
* Solved bugs in finetuning vision yamls.
* updates to sdk, cli examples
* Removing datasets and fixing az ml job stream issue
* Fix the capitalization
* Added space at the end
* Added a linux formatted shell script
* Added Linux styled shell scripts
* Added linux style CRLF
---------
Co-authored-by: Rupal Jain <rupaljain@microsoft.com>
Co-authored-by: grajguru <grajguru@microsoft.com>
* Doc related changes (#2536)
* updates for sdk/cli inference examples
* deploying from azureml-staging erroring out
* updates to sdk, cli examples
* updating score col names while fetching batch scoring output
* updating score col names while fetching batch scoring output for classification
* fixing bash issues
* fix broken links in mmdetection-fridgeobjects-object-detection.ipynb (#2535)
fixed broken links to [Model Import Component] & [Finetune Component] in Section 5.2 in OD vision notebook
* [Vision sdk] ObjectDetection Notebook: update url, remove redundant params (#2538)
* update base_url to have forward slashes
* Remove redundant custom_pipeline_component_args from od notebook
* Revert "Remove redundant custom_pipeline_component_args from od notebook"
This reverts commit 8ba4de3aa0.
* remove extra custom_pipeline_component_args variable
* Vidani/update deployment settings (#2541)
* Update the livenedd probe, request_timeout_ms for online deployment of vision foundational models
* Update the livenedd probe, request_timeout_ms for online deployment of vision foundational models for cli
* corrected request_timeout_ms param's value
* Update request_timeout_ms and liveness probe's values in inference for vision foundation models (#2544)
* Improving visualization in FT notebooks images (#2554)
* Improving visualization in FT notebooks images
* not needed
* Update sdk/python/foundation-models/system/finetune/image-instance-segmentation/mmdetection-fridgeobjects-instance-segmentation.ipynb
Co-authored-by: Rupal jain <rupaljain@microsoft.com>
* Update sdk/python/foundation-models/system/finetune/image-instance-segmentation/mmdetection-fridgeobjects-instance-segmentation.ipynb
Co-authored-by: Rupal jain <rupaljain@microsoft.com>
* Update sdk/python/foundation-models/system/finetune/image-classification/multilabel-classification/hftransformers-fridgeobjects-multilabel-classification.ipynb
Co-authored-by: Rupal jain <rupaljain@microsoft.com>
---------
Co-authored-by: shubham soni <sonishubham@microsoft.com>
Co-authored-by: Rupal jain <rupaljain@microsoft.com>
* Adding the retry logic for csv (#2567)
* Adding the retry logic for csv
* Name correction for CLI notebooks
* Moved streaming out of try-catch
* Removing metadata
* revert model name change
* removing cat statement
* Adding image tasks evaluation examples (#2566)
* adding image classification evaluation examples
* updates for ME image task examples
* OD/IS eval sdk example updates
* comments addressed
---------
Co-authored-by: Rupal Jain <rupaljain@microsoft.com>
* Convert IS data using voc convertor (#2572)
Co-authored-by: grajguru <grajguru@microsoft.com>
* ME OD example data conversion fix (#2574)
* ME OD example data conversion fix
* lib installations
* [Image Foundation Models] Update HF model import notebook (#2545)
* updates for sdk/cli inference examples
* deploying from azureml-staging erroring out
* updates to sdk, cli examples
* updating score col names while fetching batch scoring output
* updating score col names while fetching batch scoring output for classification
* fixing bash issues
* revert merge to main
* reverting kernel spec changes
* update sdk/cli examples for image od/is
* Update registry from azureml-staging/azureml-preview to azureml (#2575)
* Update registry from azureml-staging/azureml-preview to azureml
* remove tenant id; update model version number
* renaming yml to yaml; correcting version numbers
* Main to vision foundation model (#2579)
* Automation test for spark CLI samples (#2377)
* Enable test for submit_spark_standalone_jobs
* Generate workflow yaml
* update spark job files for automation test
* Add workflow for serverless spark with user identity job
* Add scripts to upload input data
* Update workflow to refer the script
* Update source file path
* Update workflow with correct file path
* Update working directory
* Update workflow
* Update the path
* Update the script to upload data
* Update the overwrite mode
* Update destination blob name
* Use blob upload batch
* Add spark pipeline tests
* Update spark component extension
* Add script to attache uai
* Update property name in workflow
* Update script parameters
* Update assign uai script
* Format the script
* Update setup identities script
* Update path to infra bootstraping
* Enable automation test for attached spark job
* Update resource path
* Update setup attached resource script
* Update script of setup resources
* Update setup attached resource script2
* Add logic to assign identity role
* Format the empty check
* Check if identity is empty
* Update to get compute properties
* update readme
* Reformat the script
* Update schema location and revert sdk notebook changes
* Attach pool first
* Rename resources and merge main
* Update format in yml
* Add role assigment to uid
* Enable sdk spark batch samples automation test (#2394)
* Initial update to enable sdk spark samples automation test
* Add script to setup spark resources
* Update the script path
* replace attached pool name with value
* Assign sai permission to spark pool
* Update component name
* Add two additional spark notebooks to cover with automation test
* Update spark version and use managedidentityconfiguration
* Format the samples
* Update uai compute name and remove vnet notebook test temporarily
* Update condition check
* Condition format
* Assign uai synapse role
* Update compute name to be valid
* Add readme changes
* Substituate variables
* Rename the synapse workspace
* Substitue synapse ws name in notebook
* Create unique file syanpse per rg
* replace synapse pool name
* bump RAI text and vision component versions to 0.0.8 (#2437)
* Pmanoj/read model specific defaults (#2442)
* reading the model specific defaults from model card
* updating the metric defaults for the tasks
* updating the defaults from bool -> string
* fixing formatting issues
* add llama acs notebook (#2430)
* copy acs notebook
* add docker
* add ncd score.py
* remove monitoring
* add acs
* add safety
* update score to support chunk
* update input and fix score.py
* move asc client to init
* clear output
* support chat bot
* make notebook compatible to chat model
* remove unused
* use 7b as default
* format
* update per comments
* pin model version, use studio to check env status
* add uai creation
* update folder structure
* handle -chat input
* format json
* rename nb
* fix input
* remove junk
* Add compute name and instance type param in sdk and cli (#2446)
* added compute_name in cli
* add serverless code cell
* removed extra cell & add MD
* changed device type to auto
* adding truncation for summarization data
* chged device type to auto
* remove custom environment (#2445)
* Clean up (#2449)
* Clean up
* Delete llama-safe-online-deployment.ipynb
* Delete prepare_uai.ipynb
* Update deploy-and-run.sh (#2443)
* Update deploy-and-run.sh (#2413)
* Update deploy-and-run.sh
* Update deploy-and-run.sh
* Update sdk-deploy-and-test.ipynb (#2412)
* add incremental embedding with table notebook (#2428)
* add incremental embedding with table notebook
* fix comments
---------
Co-authored-by: Lucas Pickup <tot0@users.noreply.github.com>
* Update RAG notebooks to use generate_embedding component. (#2450)
* Update RAG notebooks to use generate_embedding component.
* Rebase and fixup formatting.
* Missed testgen notebook
---------
Co-authored-by: Lucas Pickup <lupickup@microsoft.com>
* Add online_enabled flag (#2405)
* Add online_enabled falg
* Add support for network isolation scenario
* Modifying file
* minor update
* update the descriptions
* reformat
---------
Co-authored-by: Shail Paragbhai Shah <shaisha@microsoft.com>
Co-authored-by: Qianjun Xu <qiax@microsoft.com>
Co-authored-by: rsethur <rsethur@gmail.com>
Co-authored-by: Sethu Raman <rsethur@users.noreply.github.com>
* Changed to Standard_NC6s_v3 because Standard_NC6 is deprecated. (#2456)
* Changed to Standard_NC6s_v3 because Standard_NC6 is deprecated
* Updated SDK Version to 1.52.0 in automl_env files
* Updated credentials for V1 notebooks
* Fix typo (#2459)
* [Notebook] Add dbcopilot notebook (#2427)
* [Notebook] Add dbcopilot notebook
* fix
* fix format
* fix format
---------
Co-authored-by: Xia Xiao <xiaxiao@microsoft.com>
* Add Hugging Face inference text-classification streaming example notebook (#2458)
* Added Hugging Face inference text-classification streaming example
* Update sdk/python/foundation-models/huggingface/inference/text-generation-streaming/text-generation-streaming-online-endpoint.ipynb
Co-authored-by: Manoj Bableshwar <manoj.bableshwar@outlook.com>
---------
Co-authored-by: Manoj Bableshwar <manoj.bableshwar@outlook.com>
* Fixed missing comma (#2461)
* Automation test for spark job with managed vnet and interactive session notebook (#2436)
* Automation test for spark job with managed vnet
* Update to keyword arguments in provision vnet
* Add test for data wrangling interactive notebook
* Add permanent delete to worksapce cleanup
* Rename the vnet workspace
* Support interactive session test
* rename run session file notebook
* Update to use ipython
* Add py file for notebook session
* Update relative path to py file
* Update continaer value
* Update expiry time
* upload wrangling data to gen2 storage
* Remove gen2 using service principal
* Remove session mount script
* Move test file into folder and updae variables
* Update to new workflow
* Update blob storage name
* Add test files (#2464)
* Add test files
* checkin all
* checkin all
* checkin all
* Switched to new GPU SKU because NC6 is deprecated (#2462)
* Switched to new GPU SKU because NC6 is deprecated
* Updated credentials for remaining V1 notebooks
* Updated gpu-cluster in bootstrap.sh
* compute update and viz error fix (#2454)
* compute update and viz error fix
* v1 notebooks compute update
* format updates
* format updates
* format updates
* compute name update
* cluster name update
* cluster update
* use nc6_v2 instead of nc6 (#2469)
Co-authored-by: Hannah Westra (SHE/HER) <hawestra@microsoft.com>
* Update Standard_NC6 compute for v2 notebooks. (#2465)
* Change NC6 to NC6s_v3
* Update endpoint compute
* modified the register output path (#2474)
Co-authored-by: bhavanatumma <bhavanatumma@microsoft.com>
* chore(pr_template): Add a checklist item for file deletion (#2466)
* Changed gpu-K80-2 to gpu-V100-2 because NC is deprecated (#2472)
* Changed gpu-K80-2 to gpu-V100-2 because NC is deprecated
* Added python-sdk-tutorial prefix to V1 automl actions
* Update quickstart.ipynb (#2457)
* Update quickstart.ipynb
* Update quickstart.ipynb
* Update quickstart.ipynb
* Update quickstart.ipynb
* Update quickstart.ipynb
* Update train-model.ipynb
* Update train-model.ipynb
* Update train-model.ipynb
* Update train-model.ipynb
* Update quickstart.ipynb
* Update train-model.ipynb
* Update pipeline.ipynb
* Update pipeline.ipynb
* Update pipeline.ipynb
* Update quickstart.ipynb
* Update train-model.ipynb
* Update quickstart.ipynb
* Update pipeline.ipynb
* Update train-model.ipynb
* Update train-model.ipynb
* Update quickstart.ipynb
* Update train-model.ipynb
* Update quickstart.ipynb
* Update train-model.ipynb
* Update e2e-object-classification-distributed-pytorch.ipynb
* Update e2e-object-classification-distributed-pytorch.ipynb
* Update e2e-object-classification-distributed-pytorch.ipynb
* Update e2e-object-classification-distributed-pytorch.ipynb
* Update e2e-object-classification-distributed-pytorch.ipynb
* Update e2e-object-classification-distributed-pytorch.ipynb
* Update e2e-object-classification-distributed-pytorch.ipynb
* Update e2e-object-classification-distributed-pytorch.ipynb
* Update e2e-object-classification-distributed-pytorch.ipynb
* Update e2e-object-classification-distributed-pytorch.ipynb
* Update e2e-object-classification-distributed-pytorch.ipynb
* Update e2e-object-classification-distributed-pytorch.ipynb
* Update e2e-object-classification-distributed-pytorch.ipynb
* Update e2e-object-classification-distributed-pytorch.ipynb
* Update e2e-object-classification-distributed-pytorch.ipynb
* Update pipeline.ipynb
* Update sklearn-diabetes.ipynb
* Update sklearn-diabetes.ipynb
* Update sklearn-diabetes.ipynb
* Update iris-scikit-learn.ipynb
* Update iris-scikit-learn.ipynb
* Update sklearn-diabetes.ipynb
* Update sklearn-mnist.ipynb
* Update debug-and-monitor.ipynb
* Update distributed-cifar10.ipynb
* Update distributed-cifar10.ipynb
* Update distributed-cifar10.ipynb
* Update distributed-cifar10.ipynb
* Update distributed-cifar10.ipynb
* Update objectdetectionAzureML.ipynb
* Update distributed-cifar10.ipynb
* Update pytorch-iris.ipynb
* Update tensorflow-mnist.ipynb
* Update tensorflow-mnist.ipynb
* Update tensorflow-mnist.ipynb
* Update debug-and-monitor.ipynb
* Update objectdetectionAzureML.ipynb
* Update distributed-cifar10.ipynb
* Update pytorch-iris.ipynb
* Update sklearn-diabetes.ipynb
* Update iris-scikit-learn.ipynb
* Update sklearn-mnist.ipynb
* Update tensorflow-mnist.ipynb
* Update distributed-cifar10.ipynb
* Update objectdetectionAzureML.ipynb
* Update tensorflow-mnist.ipynb
* Update tensorflow-mnist.ipynb
* Update e2e-object-classification-distributed-pytorch.ipynb
* Update distributed-cifar10.ipynb
* Update objectdetectionAzureML.ipynb
* Update tensorflow-mnist.ipynb
* Update automl-forecasting-recipe-univariate-run.ipynb
* Update automl-forecasting-recipe-univariate-run.ipynb
* Update automl-forecasting-recipe-univariate-run.ipynb
* Update automl-forecasting-recipe-univariate-run.ipynb
* Update automl-forecasting-recipe-univariate-run.ipynb
* Update automl-forecasting-recipe-univariate-run.ipynb
* Update automl-forecasting-recipe-univariate-run.ipynb
* Update automl-forecasting-recipe-univariate-run.ipynb
* Update automl-forecasting-recipe-univariate-run.ipynb
* Update automl-forecasting-recipe-univariate-run.ipynb
* Update tensorflow-mnist.ipynb
* Update e2e-object-classification-distributed-pytorch.ipynb
* Update auto-ml-forecasting-bike-share.ipynb
* Update auto-ml-forecasting-github-dau.ipynb
* Update auto-ml-forecasting-github-dau.ipynb
* Update automl-classification-task-bankmarketing-serverless.ipynb
* Update automl-forecasting-orange-juice-sales-mlflow.ipynb
* Update azureml-getting-started-studio.ipynb
* Update automl-regression-task-hardware-performance.ipynb
* Update automl-regression-task-hardware-performance.ipynb
* Update automl-nlp-text-ner-task.ipynb
* Update automl-nlp-text-ner-task.ipynb
* Update automl-nlp-text-ner-task.ipynb
* Update automl-nlp-text-ner-task.ipynb
* Update automl-nlp-multiclass-sentiment-mlflow.ipynb
* Update automl-nlp-multiclass-sentiment-mlflow.ipynb
* Update automl-nlp-multiclass-sentiment-mlflow.ipynb
* Update automl-nlp-multiclass-sentiment-mlflow.ipynb
* Update automl-nlp-multiclass-sentiment.ipynb
* Update automl-nlp-multilabel-paper-cat.ipynb
* Update automl-forecasting-task-energy-demand-advanced.ipynb
* Update automl-nlp-multiclass-sentiment-mlflow.ipynb
* Update automl-nlp-multilabel-paper-cat.ipynb
* Update automl-nlp-text-ner-task.ipynb
* Update automl-nlp-multiclass-sentiment-mlflow.ipynb
* Update automl-nlp-multiclass-sentiment.ipynb
* Update automl-nlp-multilabel-paper-cat.ipynb
* Update automl-nlp-text-ner-task.ipynb
* Updated asr inference sample score, online and batch endpoint notebooks (#2441)
* Updated asr inference sample score, online and batch endpoint notebooks
* Updated openai whisper model from 8 to 10 in the batch deployment notebook
* Add UAI to llama deployment (#2473)
* add uai
* fix typo
* fix typo
* reformat
* Update feature store example (#2480)
* update sdk version
* add sdk version update
* update retrieval component version
* Add component-based demand forecasting notebooks (#2470)
* added notebooks
* linter
* added exceptions, readme and workflow files
* changed registries from dev to preview and prod
* fixed compute creation step
* deleted redundant file. Added try-exccept to avoid the http connection timeout issues
* changed gpu compute type due to availability in the test region
* added forece rerun setting to pipeline definition
* removed forced re-run setting since in the test environment is it triggered by default.
* removed repeated experiement name from the HTS nb
* added pipeline description to mm and hts nb
* removing single model nb and associated files
* Removed local data files from the mm nb. Will use data from the public datastore.
* modified mm nb to download data from public blob and save as parquet
* linter
* changed parameter names to be consistent with components' input names in HTS nb
* changed parameter names to be consistent with components' input names in MM nb
* removed code that enables private features
* fixed section reference hyperlinks and removed unused impots from helper scripts
* pre-formatted section headers; minor code reformat
* added experiment and timout restictions to the MM and HTS nb
* added check to make sure all job child runs are posted before downloading forecast results
* workround for the PipelinJob bug which is stuck in the preparing state
* fix llama for empty request/response
* Excluded yolov5/tutorial (#2487)
* update code to fix pipeline test by updating the outbound rule (#2488)
* fix: Update cli/setup.sh to ensure that release candidates are actually installed during sample validation (#2492)
* fix: Update instructructions in cli/setup.sh for validating a release candidate
* [skip ci] Remove dead code
* Add preview label to HTS and MM notebooks and update data sources (#2490)
* Addedd preview label to HTS and MM notebooks, removed data folder from the HTS nb, changed data URIs in the MM nb.
* fixed section reference links
* dropped pre-formatting
* Batch inference sample scripts for foundation models (#2367)
* fill-mask, qna, summarization
* Add all tasks
* black formatting
* Make delete compute step optional
* Fix wording
---------
Co-authored-by: Sumadhva Sridhar <109793745+susridhar@users.noreply.github.com>
* [RAG] Move from text-davinci-003 to gpt-3.5 turbo (#2493)
* mdc/monitoring cli samples (#2479)
* add data collector cli samples
* add custom monitoring signal samples
* add relvant supporting files and additional samples
* remove data from this PR, update custom samples
* remove model from this PR
* update email:
* chore: Run black on monitoring cli samples (#2499)
* chore: Update cron schedule for automated-cleanup-resources (#2498)
Will go at about 1am PST
* fix: updating deployments schemas (#2497)
* replace the public data source to a public Azure blob one (#2500)
* replace the public data source to a public Azure blob one, to solve mount/download issue
* update pipeline registered data asset name to resolve conflict
* update e2e flow with same data asset register meta
* update file name to csv, which is the actual exist one
* update code and environment
* bump custom env version
---------
Co-authored-by: Anthony Hu <anthu@microsoft.com>
* Sdg pipeline (#2496)
* revise pipeline & data notebooks
* wording
* fix error when data version exists
* reformat
* fix cli files to pass smoke test
* many models and HTS cli (#2505)
* Update LlaMa notebooks to use HF TGI container (#2475)
* first draft
* llama hf tgi (#2476)
* Update notebook
* update
* update response format, input format, use env vars
* default sharding to true
* update scoring changes and notebook
* udpate
* update scoring script to use AACS (#2481)
* update scoring script to use AACS
* Add mlflow
* update
* fixes to scoring script
* remove /n
* update scoring script to have system prompt
---------
Co-authored-by: Gaurav Singh <gasi@microsoft.com>
* black + minor fixes
* update default
* add gen params validation (#2489)
* add top_p in text-gen examples
* score.py changes
* update
* fix
* update scoring to include new aacs key
* add checking for empty string
---------
Co-authored-by: Gaurav Singh <gasi@microsoft.com>
Co-authored-by: Ayush Mishra <61145377+novaturient95@users.noreply.github.com>
Co-authored-by: Ayush Mishra <ayushmishra@microsoft.com>
Co-authored-by: Ke Xu <xuke@microsoft.com>
Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com>
* switch from building inf env to using train env (#2508)
* fix iris download error by adding iris_data.csv (#2502)
* fix iris download error by adding iris_data.csv
* fix precompilation issue
* added valid sink argument
* fix BoundsError
* fix bounds error
* fix distributed tf notebook (#2509)
* update mscoco RAI object detection notebook to increase num masks and reduce images in dataset (#2514)
* register model under outputs/mlflow-model (#2407)
* register model under outputs/mlflow-model
* update SDK register.py
* [LLM] RAG Examples - Remove link to old registry (#2519)
Co-authored-by: Gerard <GerardJWoods@live.com>
* Update client registry to public for AutoML forecasting components (#2522)
* update client registry to public
* update registries for cli components
* add falcon model safe deployment notebook (#2512)
* add falcon model notebook
* update md cell
* rename
* rename registry
* Add distributed TCN (v2) notebook (#2516)
* distributed tcn notebook
* Added cluster name to notebooks_config.ini. Increased experiment timeout to 1 hour
* modified readme.py to add mlflow to requirements without explicitly calling import mlflow
* re-ran readmy.py to reflect changes in the workflwo file
* removed best run line from artifacts download
* added logging of the best child run ID to file an ICM for the service team.
* changed to public client registry
* print format
* add tracking URI for mlflow
* replaced mlflowclient due to deprecation
* added disclaimer and increase experiment limit to 60 min
* added sleep import
* update code to fix pipeline test by updating the outbound rule (#2542)
* Update resources name (#2521)
* Update keyvault name
* Update attached compute name
* Fix if condition
* Update compute name
* Update joblib import so that new scikit-learn versions can be used (#2546)
* Update Llamav2 to default to hf-tgi (#2548)
* default to hf_tgi
* remove docker env
* remove hf env vars
---------
Co-authored-by: svaruag <gasi@microsoft.com>
* pin compute metrics component to 0.0.10. The later versions of this component break the pipelines due to the latest changes by the component owners (#2549)
* Update V2 sample joblib import so that new scikit-learn can be used (#2547)
* Update V2 sample joblib import so that new scikit-learn can be used
* Removed stderr check for orange juice sales because of download messages and blank lines
* Add default score file for non hftgi (#2552)
* add default score file for non hftgi
* rev
* black
* add excount
---------
Co-authored-by: svaruag <gasi@microsoft.com>
Co-authored-by: Srujan Saggam <41802116+srsaggam@users.noreply.github.com>
* Add warning message with links to the v1 forecasting notebooks (#2553)
* added warning message with links to v1 forecasting notebooks
* fixed default kernels; fixed link rendering; add warning to the output check
* link rendering
* added comma to the output check
* changed the compute type due to quota issues. This notebook has been failing since 7/18/23 because of this.
* changed many models v1 compute name
* added warning to the notebook check
* Add random numbers at the end of endpoint name in workflows (#2558)
* Add random numbers at the end of endpoint name
* Fix bootstrapping directory
* Improve getting environment in helper script. (#2560)
* Fix environment
* Fix regression-explanation-featurization
* Fix loading of environments
* Fix linting
* pin version of scikit-learn (#2540)
Co-authored-by: Aishani Bhalla <aibhalla@microsoft.com>
Co-authored-by: Vivian Li <vivianli@microsoft.com>
* New embedding step should use instance_count==1 (#2562)
* New embedding step should use instance_count==1
* Revert registry change.
---------
Co-authored-by: Lucas Pickup <lupickup@microsoft.com>
* Pin version of scikit-learn for inference-schema sample (#2564)
Co-authored-by: Aishani Bhalla <aibhalla@microsoft.com>
* Ignore Downloading artifact messages to stderr (#2568)
* Fix multilabel notebook to work with the new scikit-learn (#2563)
* Fix notebook
* Fix notbook gate
* Fix notebook runs
* Fix workspaces
* Fix multiclass/multilabel runs.
* Remove v1 samples from repository (#2559)
* Remove v1 samples from v2 repo
* Remove v1 from table of contents
* Remove v1 test files
* Remove v1 test files
* Remove v1 workflows
* [RAG] Remove local testing raise exception (#2561)
* [RAG] Match document_path_replacement_regex with AzureML-Assets Components
* Remove regex changes
---------
Co-authored-by: Gerard <GerardJWoods@live.com>
* [LLM] RAG Examples - Remove link to old registry (#2569)
Co-authored-by: Gerard <GerardJWoods@live.com>
* Revert "Remove v1 samples from repository" (#2577)
* Revert "Remove v1 samples from repository (#2559)"
This reverts commit 81175f62f5.
* Increase size limit to allow revert
* Add/update for managed online endpoint examples for vnet (#2570)
* Create deploy-managed-online-endpoint-workspacevnet.sh
* Rename deploy-moe-vnet-mlflow.sh to deploy-moe-vnet-mlflow-legacy.sh
* Rename deploy-moe-vnet.sh to deploy-moe-vnet-legacy.sh
* rename legacy vnet folder
* rerun readme.py to reflect folder changes
* Revert "rerun readme.py to reflect folder changes"
This reverts commit cf9eedbd00.
* Revert "rename legacy vnet folder"
This reverts commit 6ede0bfab9.
* clarify legacy without changing folder name
* add code for possible combinations
* fix: Reset PR size limit to 2MB (#2578)
---------
Co-authored-by: Fred Li <51424245+fredms@users.noreply.github.com>
Co-authored-by: Ilya Matiach <ilmat@microsoft.com>
Co-authored-by: pmanoj <pavanmanojj@microsoft.com>
Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com>
Co-authored-by: Aditi Singh <114134940+s-aditi@users.noreply.github.com>
Co-authored-by: Man <43016276+Man-MSFT@users.noreply.github.com>
Co-authored-by: Facundo Santiago <fasantia@microsoft.com>
Co-authored-by: Sachin Paryani <sachin.paryani@gmail.com>
Co-authored-by: Lucas Pickup <tot0@users.noreply.github.com>
Co-authored-by: Lucas Pickup <lupickup@microsoft.com>
Co-authored-by: shail2208 <59747407+shail2208@users.noreply.github.com>
Co-authored-by: Shail Paragbhai Shah <shaisha@microsoft.com>
Co-authored-by: Qianjun Xu <qiax@microsoft.com>
Co-authored-by: rsethur <rsethur@gmail.com>
Co-authored-by: Sethu Raman <rsethur@users.noreply.github.com>
Co-authored-by: jeff-shepherd <39775772+jeff-shepherd@users.noreply.github.com>
Co-authored-by: arun-rajora <108084827+arun-rajora@users.noreply.github.com>
Co-authored-by: xia-xiao <87464698+xia-xiao@users.noreply.github.com>
Co-authored-by: Xia Xiao <xiaxiao@microsoft.com>
Co-authored-by: erjms <90470932+erjms@users.noreply.github.com>
Co-authored-by: Manoj Bableshwar <manoj.bableshwar@outlook.com>
Co-authored-by: Ramu Vadthyavath <vadthyavathramu@gmail.com>
Co-authored-by: Hannah Westra (SHE/HER) <hawestra@microsoft.com>
Co-authored-by: Bhavana <bhavana.tumma@gmail.com>
Co-authored-by: bhavanatumma <bhavanatumma@microsoft.com>
Co-authored-by: kdestin <101366538+kdestin@users.noreply.github.com>
Co-authored-by: vijetajo <40418529+vijetajo@users.noreply.github.com>
Co-authored-by: tanmaybansal104 <137794577+tanmaybansal104@users.noreply.github.com>
Co-authored-by: qjxu <74025864+qjxu@users.noreply.github.com>
Co-authored-by: vbejan-msft <65432549+vlbejan@users.noreply.github.com>
Co-authored-by: shreeyaharma <129339198+shreeyaharma@users.noreply.github.com>
Co-authored-by: Sumadhva Sridhar <109793745+sumadhva30@users.noreply.github.com>
Co-authored-by: Sumadhva Sridhar <109793745+susridhar@users.noreply.github.com>
Co-authored-by: Gerard Woods <99283778+gjwoods@users.noreply.github.com>
Co-authored-by: Alexander Hughes <108831604+ahughes-msft@users.noreply.github.com>
Co-authored-by: eniac871 <supereniac@live.com>
Co-authored-by: Anthony Hu <anthu@microsoft.com>
Co-authored-by: Sheri Gilley <sgilley@microsoft.com>
Co-authored-by: Gaurav Singh <svaruag@outlook.com>
Co-authored-by: Gaurav Singh <gasi@microsoft.com>
Co-authored-by: Ayush Mishra <61145377+novaturient95@users.noreply.github.com>
Co-authored-by: Ayush Mishra <ayushmishra@microsoft.com>
Co-authored-by: Ke Xu <xuke@microsoft.com>
Co-authored-by: Rahul Kumar <74648335+iamrk04@users.noreply.github.com>
Co-authored-by: Gerard <GerardJWoods@live.com>
Co-authored-by: Srujan Saggam <41802116+srsaggam@users.noreply.github.com>
Co-authored-by: Vivian Li <vivianli@microsoft.com>
Co-authored-by: nick863 <30440255+nick863@users.noreply.github.com>
Co-authored-by: Aishani Bhalla <aishani.bhalla0709@gmail.com>
Co-authored-by: Aishani Bhalla <aibhalla@microsoft.com>
Co-authored-by: Diondra <16376603+diondrapeck@users.noreply.github.com>
Co-authored-by: SeokJin Han <4353157+dem108@users.noreply.github.com>
* remove non-image docs; update image docs
* reformat code to black
* update checkin size to 4MB
* reformat code to black
* add import workflow for image classification model
* docs update
* docs update
* update image classification github workflow
* update MMD doc links
* update docs
* update limit for PR merge
---------
Co-authored-by: Gaurav Rajguru <rajgurugaurav77@gmail.com>
Co-authored-by: grajguru <grajguru@microsoft.com>
Co-authored-by: MadhuM02 <107707128+MadhuM02@users.noreply.github.com>
Co-authored-by: nvijayrania <107195344+nvijayrania@users.noreply.github.com>
Co-authored-by: Vivek Dani <110168656+vivek-dani@users.noreply.github.com>
Co-authored-by: shubhamiit <41925087+shubhamiit@users.noreply.github.com>
Co-authored-by: shubham soni <sonishubham@microsoft.com>
Co-authored-by: Fred Li <51424245+fredms@users.noreply.github.com>
Co-authored-by: Ilya Matiach <ilmat@microsoft.com>
Co-authored-by: pmanoj <pavanmanojj@microsoft.com>
Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com>
Co-authored-by: Aditi Singh <114134940+s-aditi@users.noreply.github.com>
Co-authored-by: Man <43016276+Man-MSFT@users.noreply.github.com>
Co-authored-by: Facundo Santiago <fasantia@microsoft.com>
Co-authored-by: Sachin Paryani <sachin.paryani@gmail.com>
Co-authored-by: Lucas Pickup <tot0@users.noreply.github.com>
Co-authored-by: Lucas Pickup <lupickup@microsoft.com>
Co-authored-by: shail2208 <59747407+shail2208@users.noreply.github.com>
Co-authored-by: Shail Paragbhai Shah <shaisha@microsoft.com>
Co-authored-by: Qianjun Xu <qiax@microsoft.com>
Co-authored-by: rsethur <rsethur@gmail.com>
Co-authored-by: Sethu Raman <rsethur@users.noreply.github.com>
Co-authored-by: jeff-shepherd <39775772+jeff-shepherd@users.noreply.github.com>
Co-authored-by: arun-rajora <108084827+arun-rajora@users.noreply.github.com>
Co-authored-by: xia-xiao <87464698+xia-xiao@users.noreply.github.com>
Co-authored-by: Xia Xiao <xiaxiao@microsoft.com>
Co-authored-by: erjms <90470932+erjms@users.noreply.github.com>
Co-authored-by: Manoj Bableshwar <manoj.bableshwar@outlook.com>
Co-authored-by: Ramu Vadthyavath <vadthyavathramu@gmail.com>
Co-authored-by: Hannah Westra (SHE/HER) <hawestra@microsoft.com>
Co-authored-by: Bhavana <bhavana.tumma@gmail.com>
Co-authored-by: bhavanatumma <bhavanatumma@microsoft.com>
Co-authored-by: kdestin <101366538+kdestin@users.noreply.github.com>
Co-authored-by: vijetajo <40418529+vijetajo@users.noreply.github.com>
Co-authored-by: tanmaybansal104 <137794577+tanmaybansal104@users.noreply.github.com>
Co-authored-by: qjxu <74025864+qjxu@users.noreply.github.com>
Co-authored-by: vbejan-msft <65432549+vlbejan@users.noreply.github.com>
Co-authored-by: shreeyaharma <129339198+shreeyaharma@users.noreply.github.com>
Co-authored-by: Sumadhva Sridhar <109793745+sumadhva30@users.noreply.github.com>
Co-authored-by: Sumadhva Sridhar <109793745+susridhar@users.noreply.github.com>
Co-authored-by: Gerard Woods <99283778+gjwoods@users.noreply.github.com>
Co-authored-by: Alexander Hughes <108831604+ahughes-msft@users.noreply.github.com>
Co-authored-by: eniac871 <supereniac@live.com>
Co-authored-by: Anthony Hu <anthu@microsoft.com>
Co-authored-by: Sheri Gilley <sgilley@microsoft.com>
Co-authored-by: Gaurav Singh <svaruag@outlook.com>
Co-authored-by: Gaurav Singh <gasi@microsoft.com>
Co-authored-by: Ayush Mishra <61145377+novaturient95@users.noreply.github.com>
Co-authored-by: Ayush Mishra <ayushmishra@microsoft.com>
Co-authored-by: Ke Xu <xuke@microsoft.com>
Co-authored-by: Rahul Kumar <74648335+iamrk04@users.noreply.github.com>
Co-authored-by: Gerard <GerardJWoods@live.com>
Co-authored-by: Srujan Saggam <41802116+srsaggam@users.noreply.github.com>
Co-authored-by: Vivian Li <vivianli@microsoft.com>
Co-authored-by: nick863 <30440255+nick863@users.noreply.github.com>
Co-authored-by: Aishani Bhalla <aishani.bhalla0709@gmail.com>
Co-authored-by: Aishani Bhalla <aibhalla@microsoft.com>
Co-authored-by: Diondra <16376603+diondrapeck@users.noreply.github.com>
Co-authored-by: SeokJin Han <4353157+dem108@users.noreply.github.com>
Fred Li
Nivedita Mishra
kdestin
siyuZL
MadhuM02
Diondra
jeff-shepherd
rkamat25
Nilesh Vijayrania
Aswin Nagarajan
Xingzhi Zhang
Yuan Zhuang
shreeyaharma
Riti Sharma
Grace Brigham
Ada
Rehaan Bhimani
Ilya Matiach
Mathieu St-Louis
Rupal jain
Vanessa Arndorfer