azureml-examples/cli
Sasidhar Kasturi 73242bf521
Add NVIDIA model samples (#2836)
* Add placeholder samples

* Added powershell for cli

* deployment notebook added

* updated notebook

* Evaluation

* yaml file updated

* yaml file updated

* Fix

* PTuning notebook

* Rename

* Format

---------

Co-authored-by: vikasagrawal-ms <vikasagrawal@microsoft.com>
Co-authored-by: HrishikeshGeedMS <hgeed@microsoft.com>
Co-authored-by: Aditi Singh <47007177+Addi-11@users.noreply.github.com>
2024-09-19 14:21:14 +05:30
..
assets
endpoints
foundation-models
generative-ai/promptflow
jobs
monitoring
resources
responsible-ai
schedules
CONTRIBUTING.md
README.md
batch-score-rest.sh
batch-score.sh
deploy-custom-container-minimal-multimodel.sh
deploy-custom-container-minimal-single-model.sh
deploy-custom-container-mlflow-multideployment-scikit.sh
deploy-custom-container-r-multimodel-plumber.sh
deploy-custom-container-tfserving-half-plus-two-integrated.sh
deploy-custom-container-tfserving-half-plus-two.sh
deploy-custom-container-torchserve-densenet.sh
deploy-custom-container-triton-single-model.sh
deploy-local-endpoint.sh
deploy-managed-online-endpoint-access-resource-sai.sh
deploy-managed-online-endpoint-access-resource-uai.sh
deploy-managed-online-endpoint-ncd.sh
deploy-managed-online-endpoint-workspacevnet.sh
deploy-managed-online-endpoint.sh
deploy-mlcompute-create_with-system-identity.sh
deploy-mlcompute-update-to-system-identity.sh
deploy-mlcompute-update-to-user-identity.sh
deploy-moe-autoscale.sh
deploy-moe-binary-payloads.sh
deploy-moe-inference-schema.sh
deploy-moe-keyvault.sh
deploy-moe-minimal-single-model-registered.sh
deploy-moe-openapi.sh
deploy-moe-vnet-legacy.sh
deploy-moe-vnet-mlflow-legacy.sh
deploy-rest.sh
deploy-safe-rollout-kubernetes-online-endpoints.sh
deploy-safe-rollout-online-endpoints.sh
deploy-triton-managed-online-endpoint.sh
misc.sh
mlflow-uri.sh
prefix.md
readme.py
run-job-pipeline-all.py
run-job-pipeline-all.sh
run-job.sh
run-pipeline-job-with-registry-components.sh
run-pipeline-jobs.sh
setup.sh
setup_oai_v2.sh
suffix.md
train-rest.sh
train.sh
upload-data-to-blob.sh

README.md

page_type languages products description
sample
azurecli
azure-machine-learning
Top-level directory for official Azure Machine Learning CLI sample code.

Azure Machine Learning CLI (v2) examples

cleanup code style: black license: MIT

Welcome to the Azure Machine Learning examples repository!

Prerequisites

  1. An Azure subscription. If you don't have an Azure subscription, create a free account before you begin.
  2. A terminal. Install and set up the CLI (v2) before you begin.

Getting started

  1. Install and set up the CLI (v2)
az extension remove --name ml

az extension add --name ml --yes

Examples

Scripts

path status
batch-score-rest.sh batch-score-rest
batch-score.sh batch-score
deploy-custom-container-minimal-multimodel.sh deploy-custom-container-minimal-multimodel
deploy-custom-container-minimal-single-model.sh deploy-custom-container-minimal-single-model
deploy-custom-container-mlflow-multideployment-scikit.sh deploy-custom-container-mlflow-multideployment-scikit
deploy-custom-container-r-multimodel-plumber.sh deploy-custom-container-r-multimodel-plumber
deploy-custom-container-tfserving-half-plus-two-integrated.sh deploy-custom-container-tfserving-half-plus-two-integrated
deploy-custom-container-tfserving-half-plus-two.sh deploy-custom-container-tfserving-half-plus-two
deploy-custom-container-torchserve-densenet.sh deploy-custom-container-torchserve-densenet
deploy-custom-container-triton-single-model.sh deploy-custom-container-triton-single-model
deploy-local-endpoint.sh deploy-local-endpoint
deploy-managed-online-endpoint-access-resource-sai.sh deploy-managed-online-endpoint-access-resource-sai
deploy-managed-online-endpoint-access-resource-uai.sh deploy-managed-online-endpoint-access-resource-uai
deploy-managed-online-endpoint-ncd.sh deploy-managed-online-endpoint-ncd
deploy-managed-online-endpoint.sh deploy-managed-online-endpoint
deploy-mlcompute-create_with-system-identity.sh deploy-mlcompute-create_with-system-identity
deploy-mlcompute-update-to-system-identity.sh deploy-mlcompute-update-to-system-identity
deploy-mlcompute-update-to-user-identity.sh deploy-mlcompute-update-to-user-identity
deploy-moe-autoscale.sh deploy-moe-autoscale
deploy-moe-binary-payloads.sh deploy-moe-binary-payloads
deploy-moe-inference-schema.sh deploy-moe-inference-schema
deploy-moe-keyvault.sh deploy-moe-keyvault
deploy-moe-minimal-single-model-registered.sh deploy-moe-minimal-single-model-registered
deploy-moe-openapi.sh deploy-moe-openapi
deploy-moe-vnet-mlflow.sh deploy-moe-vnet-mlflow
deploy-moe-vnet.sh deploy-moe-vnet
deploy-rest.sh deploy-rest
deploy-safe-rollout-kubernetes-online-endpoints.sh deploy-safe-rollout-kubernetes-online-endpoints
deploy-safe-rollout-online-endpoints.sh deploy-safe-rollout-online-endpoints
deploy-triton-managed-online-endpoint.sh deploy-triton-managed-online-endpoint
misc.sh misc
mlflow-uri.sh mlflow-uri
train-rest.sh train-rest
train.sh train

Jobs (jobs)

path status description
jobs/basics/hello-automl/hello-automl-job-basic.yml jobs/basics/hello-automl/hello-automl-job-basic A Classification job using bank marketing
jobs/deepspeed/deepspeed-autotuning/job.yml jobs/deepspeed/deepspeed-autotuning/job no description
jobs/deepspeed/deepspeed-training/job.yml jobs/deepspeed/deepspeed-training/job no description
jobs/nebulaml/PyTorch_CNN_MNIST/job.yml jobs/nebulaml/PyTorch_CNN_MNIST/job no description
jobs/nebulaml/bert-pretrain-deepspeed/job.yml jobs/nebulaml/bert-pretrain-deepspeed/job no description
jobs/nebulaml/cifar10_deepspeed/job.yml jobs/nebulaml/cifar10_deepspeed/job no description
jobs/pipelines-with-components/nyc_taxi_data_regression/single-job-pipeline.yml jobs/pipelines-with-components/nyc_taxi_data_regression/single-job-pipeline Single job pipeline to train regression model based on nyc taxi dataset
jobs/single-step/dask/nyctaxi/job.yml jobs/single-step/dask/nyctaxi/job This sample shows how to run a distributed DASK job on AzureML. The 24GB NYC Taxi dataset is read in CSV format by a 4 node DASK cluster, processed and then written as job output in parquet format.
jobs/single-step/gpu_perf/gpu_perf_job.yml jobs/single-step/gpu_perf/gpu_perf_job Runs NCCL-tests on gpu nodes.
jobs/single-step/julia/iris/job.yml jobs/single-step/julia/iris/job Train a Flux model on the Iris dataset using the Julia programming language.
jobs/single-step/lightgbm/iris/job-sweep.yml jobs/single-step/lightgbm/iris/job-sweep Run a hyperparameter sweep job for LightGBM on Iris dataset.
jobs/single-step/lightgbm/iris/job.yml jobs/single-step/lightgbm/iris/job Train a LightGBM model on the Iris dataset.
jobs/single-step/pytorch/cifar-distributed/job.yml jobs/single-step/pytorch/cifar-distributed/job Train a basic convolutional neural network (CNN) with PyTorch on the CIFAR-10 dataset, distributed via PyTorch.
jobs/single-step/pytorch/iris/job.yml jobs/single-step/pytorch/iris/job Train a neural network with PyTorch on the Iris dataset.
jobs/single-step/pytorch/word-language-model/job.yml jobs/single-step/pytorch/word-language-model/job Train a multi-layer RNN (Elman, GRU, or LSTM) on a language modeling task with PyTorch.
jobs/single-step/r/accidents/job.yml jobs/single-step/r/accidents/job Train a GLM using R on the accidents dataset.
jobs/single-step/r/iris/job.yml jobs/single-step/r/iris/job Train an R model on the Iris dataset.
jobs/single-step/scikit-learn/diabetes/job.yml jobs/single-step/scikit-learn/diabetes/job Train a scikit-learn LinearRegression model on the Diabetes dataset.
jobs/single-step/scikit-learn/iris-notebook/job.yml jobs/single-step/scikit-learn/iris-notebook/job Train a scikit-learn SVM on the Iris dataset using a custom Docker container build with a notebook via papermill.
jobs/single-step/scikit-learn/iris/job-docker-context.yml jobs/single-step/scikit-learn/iris/job-docker-context Train a scikit-learn SVM on the Iris dataset using a custom Docker container build.
jobs/single-step/scikit-learn/iris/job-sweep.yml jobs/single-step/scikit-learn/iris/job-sweep Sweep hyperparemeters for training a scikit-learn SVM on the Iris dataset.
jobs/single-step/scikit-learn/iris/job.yml jobs/single-step/scikit-learn/iris/job Train a scikit-learn SVM on the Iris dataset.
jobs/single-step/tensorflow/mnist-distributed-horovod/job.yml jobs/single-step/tensorflow/mnist-distributed-horovod/job Train a basic neural network with TensorFlow on the MNIST dataset, distributed via Horovod.
jobs/single-step/tensorflow/mnist-distributed/job.yml jobs/single-step/tensorflow/mnist-distributed/job Train a basic neural network with TensorFlow on the MNIST dataset, distributed via TensorFlow.
jobs/single-step/tensorflow/mnist/job.yml jobs/single-step/tensorflow/mnist/job Train a basic neural network with TensorFlow on the MNIST dataset.
jobs/basics/hello-code.yml jobs/basics/hello-code no description
jobs/basics/hello-data-uri-folder.yml jobs/basics/hello-data-uri-folder no description
jobs/basics/hello-dataset.yml jobs/basics/hello-dataset no description
jobs/basics/hello-git.yml jobs/basics/hello-git no description
jobs/basics/hello-interactive.yml jobs/basics/hello-interactive no description
jobs/basics/hello-iris-datastore-file.yml jobs/basics/hello-iris-datastore-file no description
jobs/basics/hello-iris-datastore-folder.yml jobs/basics/hello-iris-datastore-folder no description
jobs/basics/hello-iris-file.yml jobs/basics/hello-iris-file no description
jobs/basics/hello-iris-folder.yml jobs/basics/hello-iris-folder no description
jobs/basics/hello-iris-literal.yml jobs/basics/hello-iris-literal no description
jobs/basics/hello-mlflow.yml jobs/basics/hello-mlflow no description
jobs/basics/hello-model-as-input.yml jobs/basics/hello-model-as-input no description
jobs/basics/hello-model-as-output.yml jobs/basics/hello-model-as-output no description
jobs/basics/hello-notebook.yml jobs/basics/hello-notebook no description
jobs/basics/hello-pipeline-abc.yml jobs/basics/hello-pipeline-abc no description
jobs/basics/hello-pipeline-customize-output-file.yml jobs/basics/hello-pipeline-customize-output-file no description
jobs/basics/hello-pipeline-customize-output-folder.yml jobs/basics/hello-pipeline-customize-output-folder no description
jobs/basics/hello-pipeline-default-artifacts.yml jobs/basics/hello-pipeline-default-artifacts no description
jobs/basics/hello-pipeline-io.yml jobs/basics/hello-pipeline-io no description
jobs/basics/hello-pipeline-settings.yml jobs/basics/hello-pipeline-settings no description
jobs/basics/hello-pipeline.yml jobs/basics/hello-pipeline no description
jobs/basics/hello-sweep.yml jobs/basics/hello-sweep Hello sweep job example.
jobs/basics/hello-world-env-var.yml jobs/basics/hello-world-env-var no description
jobs/basics/hello-world-input.yml jobs/basics/hello-world-input no description
jobs/basics/hello-world-org.yml jobs/basics/hello-world-org
jobs/basics/hello-world-output-data.yml jobs/basics/hello-world-output-data no description
jobs/basics/hello-world-output.yml jobs/basics/hello-world-output no description
jobs/basics/hello-world.yml jobs/basics/hello-world no description
jobs/pipelines/automl/cli-automl-classification-task-bankmarketing-pipeline/pipeline.yml jobs/pipelines/automl/cli-automl-classification-task-bankmarketing-pipeline/pipeline Pipeline using AutoML classification task
jobs/pipelines/automl/cli-automl-forecasting-demand-with-pipeline-components/cli-automl-forecasting-demand-hierarchical-timeseries/hts_evaluation_pipeline.yml jobs/pipelines/automl/cli-automl-forecasting-demand-with-pipeline-components/cli-automl-forecasting-demand-hierarchical-timeseries/hts_evaluation_pipeline HTS evaluation pipeline using AutoML
jobs/pipelines/automl/cli-automl-forecasting-demand-with-pipeline-components/cli-automl-forecasting-demand-many-models/many_models_evaluation_pipeline.yml jobs/pipelines/automl/cli-automl-forecasting-demand-with-pipeline-components/cli-automl-forecasting-demand-many-models/many_models_evaluation_pipeline Many models evaluation pipeline using AutoML
jobs/pipelines/automl/cli-automl-regression-housepricing-pipeline/pipeline.yml jobs/pipelines/automl/cli-automl-regression-housepricing-pipeline/pipeline Pipeline using AutoML regression task
jobs/pipelines/automl/cli-automl-text-classification-multilabel-paper-categorization-pipeline/pipeline.yml jobs/pipelines/automl/cli-automl-text-classification-multilabel-paper-categorization-pipeline/pipeline Pipeline using AutoML Text Classification Multilabel task
jobs/pipelines/automl/cli-automl-text-classification-newsgroup-pipeline/pipeline.yml jobs/pipelines/automl/cli-automl-text-classification-newsgroup-pipeline/pipeline Pipeline using AutoML Text Classification task
jobs/pipelines/automl/cli-automl-text-ner-conll-pipeline/pipeline.yml jobs/pipelines/automl/cli-automl-text-ner-conll-pipeline/pipeline Pipeline using AutoML Text Ner task
jobs/pipelines/automl/forecasting-energy-demand-pipeline/pipeline.yml jobs/pipelines/automl/forecasting-energy-demand-pipeline/pipeline Pipeline using AutoML Forecasting task
jobs/pipelines/automl/image-instance-segmentation-task-fridge-items-pipeline/pipeline.yml jobs/pipelines/automl/image-instance-segmentation-task-fridge-items-pipeline/pipeline Pipeline using AutoML Image Instance Segmentation task
jobs/pipelines/automl/image-multiclass-classification-fridge-items-pipeline/pipeline.yml jobs/pipelines/automl/image-multiclass-classification-fridge-items-pipeline/pipeline Pipeline using AutoML Image Multiclass Classification task
jobs/pipelines/automl/image-multilabel-classification-fridge-items-pipeline/pipeline.yml jobs/pipelines/automl/image-multilabel-classification-fridge-items-pipeline/pipeline Pipeline using AutoML Image Multilabel Classification task
jobs/pipelines/automl/image-object-detection-task-fridge-items-pipeline/pipeline.yml jobs/pipelines/automl/image-object-detection-task-fridge-items-pipeline/pipeline Pipeline using AutoML Image Object Detection task
jobs/pipelines/cifar-10/pipeline.yml jobs/pipelines/cifar-10/pipeline Pipeline using distributed job to train model based on cifar-10 dataset
jobs/pipelines/iris-batch-prediction-using-parallel/pipeline.yml jobs/pipelines/iris-batch-prediction-using-parallel/pipeline The hello world pipeline job with inline parallel job
jobs/pipelines/mnist-batch-identification-using-parallel/pipeline.yml jobs/pipelines/mnist-batch-identification-using-parallel/pipeline The hello world pipeline job with inline parallel job
jobs/pipelines/nyc-taxi/pipeline.yml jobs/pipelines/nyc-taxi/pipeline Train model with nyc taxi data
jobs/pipelines/tensorflow-image-segmentation/pipeline.yml jobs/pipelines/tensorflow-image-segmentation/pipeline no description
jobs/automl-standalone-jobs/cli-automl-classification-task-bankmarketing/cli-automl-classification-task-bankmarketing.yml jobs/automl-standalone-jobs/cli-automl-classification-task-bankmarketing/cli-automl-classification-task-bankmarketing A Classification job using bank marketing
jobs/automl-standalone-jobs/cli-automl-forecasting-bike-share/cli-automl-forecasting-task-bike-share.yml jobs/automl-standalone-jobs/cli-automl-forecasting-bike-share/cli-automl-forecasting-task-bike-share A Time-Series Forecasting job using bike share dataset
jobs/automl-standalone-jobs/cli-automl-forecasting-orange-juice-sales/cli-automl-forecasting-orange-juice-sales.yml jobs/automl-standalone-jobs/cli-automl-forecasting-orange-juice-sales/cli-automl-forecasting-orange-juice-sales A Time-Series Forecasting job using orange juice sales dataset
jobs/automl-standalone-jobs/cli-automl-forecasting-task-energy-demand/cli-automl-forecasting-task-energy-demand.yml jobs/automl-standalone-jobs/cli-automl-forecasting-task-energy-demand/cli-automl-forecasting-task-energy-demand A Time-Series Forecasting job using energy demand dataset
jobs/automl-standalone-jobs/cli-automl-forecasting-task-github-dau/cli-automl-forecasting-task-github-dau.yml jobs/automl-standalone-jobs/cli-automl-forecasting-task-github-dau/cli-automl-forecasting-task-github-dau A Time-Series Forecasting job using Github DAU dataset that trains only the TCNForecaster model.
jobs/automl-standalone-jobs/cli-automl-image-classification-multiclass-task-fridge-items/cli-automl-img-cls-mc-task-fridge-items-automode.yml jobs/automl-standalone-jobs/cli-automl-image-classification-multiclass-task-fridge-items/cli-automl-img-cls-mc-task-fridge-items-automode A multi-class Image classification job using fridge items dataset
jobs/automl-standalone-jobs/cli-automl-image-classification-multiclass-task-fridge-items/cli-automl-img-cls-mc-task-fridge-items.yml jobs/automl-standalone-jobs/cli-automl-image-classification-multiclass-task-fridge-items/cli-automl-img-cls-mc-task-fridge-items A multi-class Image classification job using fridge items dataset
jobs/automl-standalone-jobs/cli-automl-image-classification-multilabel-task-fridge-items/cli-automl-img-cls-ml-task-fridge-items-automode.yml jobs/automl-standalone-jobs/cli-automl-image-classification-multilabel-task-fridge-items/cli-automl-img-cls-ml-task-fridge-items-automode A multi-label Image classification job using fridge items dataset
jobs/automl-standalone-jobs/cli-automl-image-classification-multilabel-task-fridge-items/cli-automl-img-cls-ml-task-fridge-items.yml jobs/automl-standalone-jobs/cli-automl-image-classification-multilabel-task-fridge-items/cli-automl-img-cls-ml-task-fridge-items A multi-label Image classification job using fridge items dataset
jobs/automl-standalone-jobs/cli-automl-image-instance-segmentation-task-fridge-items/cli-automl-img-ins-seg-task-fridge-items-automode.yml jobs/automl-standalone-jobs/cli-automl-image-instance-segmentation-task-fridge-items/cli-automl-img-ins-seg-task-fridge-items-automode An Image Instance segmentation job using fridge items dataset
jobs/automl-standalone-jobs/cli-automl-image-instance-segmentation-task-fridge-items/cli-automl-img-ins-seg-task-fridge-items.yml jobs/automl-standalone-jobs/cli-automl-image-instance-segmentation-task-fridge-items/cli-automl-img-ins-seg-task-fridge-items An Image Instance segmentation job using fridge items dataset
jobs/automl-standalone-jobs/cli-automl-image-object-detection-task-fridge-items/cli-automl-img-od-task-fridge-items-automode.yml jobs/automl-standalone-jobs/cli-automl-image-object-detection-task-fridge-items/cli-automl-img-od-task-fridge-items-automode An Image Object Detection job using fridge items dataset
jobs/automl-standalone-jobs/cli-automl-image-object-detection-task-fridge-items/cli-automl-img-od-task-fridge-items.yml jobs/automl-standalone-jobs/cli-automl-image-object-detection-task-fridge-items/cli-automl-img-od-task-fridge-items An Image Object Detection job using fridge items dataset
jobs/automl-standalone-jobs/cli-automl-regression-task-hardware-perf/cli-automl-regression-task-hardware-perf.yml jobs/automl-standalone-jobs/cli-automl-regression-task-hardware-perf/cli-automl-regression-task-hardware-perf A regression job using hardware performance dataset
jobs/automl-standalone-jobs/cli-automl-text-classification-multilabel-paper-cat/cli-automl-text-classification-multilabel-paper-cat.yml jobs/automl-standalone-jobs/cli-automl-text-classification-multilabel-paper-cat/cli-automl-text-classification-multilabel-paper-cat A text classification multilabel job using paper categorization data
jobs/automl-standalone-jobs/cli-automl-text-classification-newsgroup/cli-automl-text-classification-newsgroup.yml jobs/automl-standalone-jobs/cli-automl-text-classification-newsgroup/cli-automl-text-classification-newsgroup A text classification job using newsgroup dataset
jobs/automl-standalone-jobs/cli-automl-text-ner-conll-distributed-sweeping/cli-automl-text-ner-conll2003-distributed-sweeping.yml jobs/automl-standalone-jobs/cli-automl-text-ner-conll-distributed-sweeping/cli-automl-text-ner-conll2003-distributed-sweeping A text named entity recognition job using CoNLL 2003 data
jobs/automl-standalone-jobs/cli-automl-text-ner-conll/cli-automl-text-ner-conll2003.yml jobs/automl-standalone-jobs/cli-automl-text-ner-conll/cli-automl-text-ner-conll2003 A text named entity recognition job using CoNLL 2003 data
jobs/pipelines-with-components/basics/1a_e2e_local_components/pipeline.yml jobs/pipelines-with-components/basics/1a_e2e_local_components/pipeline Dummy train-score-eval pipeline with local components
jobs/pipelines-with-components/basics/1b_e2e_registered_components/pipeline.yml jobs/pipelines-with-components/basics/1b_e2e_registered_components/pipeline E2E dummy train-score-eval pipeline with registered components
jobs/pipelines-with-components/basics/2a_basic_component/pipeline.yml jobs/pipelines-with-components/basics/2a_basic_component/pipeline Hello World component example
jobs/pipelines-with-components/basics/2b_component_with_input_output/pipeline.yml jobs/pipelines-with-components/basics/2b_component_with_input_output/pipeline Component with inputs and outputs
jobs/pipelines-with-components/basics/3a_basic_pipeline/pipeline.yml jobs/pipelines-with-components/basics/3a_basic_pipeline/pipeline Basic Pipeline Job with 3 Hello World components
jobs/pipelines-with-components/basics/3b_pipeline_with_data/pipeline.yml jobs/pipelines-with-components/basics/3b_pipeline_with_data/pipeline Pipeline with 3 component jobs with data dependencies
jobs/pipelines-with-components/basics/4a_local_data_input/pipeline.yml jobs/pipelines-with-components/basics/4a_local_data_input/pipeline Example of using data in a local folder as pipeline input
jobs/pipelines-with-components/basics/4b_datastore_datapath_uri/pipeline.yml jobs/pipelines-with-components/basics/4b_datastore_datapath_uri/pipeline Example of using data folder from a Workspace Datastore as pipeline input
jobs/pipelines-with-components/basics/4c_web_url_input/pipeline.yml jobs/pipelines-with-components/basics/4c_web_url_input/pipeline Example of using a file hosted at a web URL as pipeline input
jobs/pipelines-with-components/basics/4d_data_input/pipeline.yml jobs/pipelines-with-components/basics/4d_data_input/pipeline Example of using data from a data as pipeline input
jobs/pipelines-with-components/basics/5a_env_public_docker_image/pipeline.yml jobs/pipelines-with-components/basics/5a_env_public_docker_image/pipeline Pipeline job with component using public docker image as environment
jobs/pipelines-with-components/basics/5b_env_registered/pipeline.yml jobs/pipelines-with-components/basics/5b_env_registered/pipeline Pipeline job with component using a registered AzureML environment
jobs/pipelines-with-components/basics/5c_env_conda_file/pipeline.yml jobs/pipelines-with-components/basics/5c_env_conda_file/pipeline Pipeline job with component using environment defined by a conda file
jobs/pipelines-with-components/basics/6a_tf_hello_world/pipeline.yml jobs/pipelines-with-components/basics/6a_tf_hello_world/pipeline Prints the environment variable ($TF_CONFIG) useful for scripts running in a Tensorflow training environment
jobs/pipelines-with-components/basics/6b_pytorch_hello_world/pipeline.yml jobs/pipelines-with-components/basics/6b_pytorch_hello_world/pipeline Prints the environment variables useful for scripts running in a PyTorch training environment
jobs/pipelines-with-components/basics/6c_r_iris/pipeline.yml jobs/pipelines-with-components/basics/6c_r_iris/pipeline Train an R model on the Iris dataset.
jobs/pipelines-with-components/image_classification_with_densenet/pipeline.yml jobs/pipelines-with-components/image_classification_with_densenet/pipeline Train densenet for image classification
jobs/pipelines-with-components/nyc_taxi_data_regression/pipeline.yml jobs/pipelines-with-components/nyc_taxi_data_regression/pipeline Train regression model based on nyc taxi dataset
jobs/pipelines-with-components/nyc_taxi_data_regression/single-job-pipeline.yml jobs/pipelines-with-components/nyc_taxi_data_regression/single-job-pipeline Single job pipeline to train regression model based on nyc taxi dataset
jobs/pipelines-with-components/pipeline_job_with_flow_as_component/pipeline.yml jobs/pipelines-with-components/pipeline_job_with_flow_as_component/pipeline The hello world pipeline job with flow as component
jobs/pipelines-with-components/pipeline_with_hyperparameter_sweep/pipeline.yml jobs/pipelines-with-components/pipeline_with_hyperparameter_sweep/pipeline Tune hyperparameters using TF component
jobs/pipelines-with-components/pipeline_with_pipeline_component/nyc_taxi_data_regression_with_pipeline_component/data_pipeline/data_pipeline.yml jobs/pipelines-with-components/pipeline_with_pipeline_component/nyc_taxi_data_regression_with_pipeline_component/data_pipeline/data_pipeline pipeline component with data prep and transformation
jobs/pipelines-with-components/pipeline_with_pipeline_component/nyc_taxi_data_regression_with_pipeline_component/pipeline.yml jobs/pipelines-with-components/pipeline_with_pipeline_component/nyc_taxi_data_regression_with_pipeline_component/pipeline Train regression model based on nyc taxi dataset
jobs/pipelines-with-components/pipeline_with_pipeline_component/nyc_taxi_data_regression_with_pipeline_component/train_pipeline/train_pipeline.yml jobs/pipelines-with-components/pipeline_with_pipeline_component/nyc_taxi_data_regression_with_pipeline_component/train_pipeline/train_pipeline pipeline component with train, predict and score component
jobs/pipelines-with-components/pipeline_with_pipeline_component/pipeline_with_train_eval_pipeline_component/components/train_pipeline_component.yml jobs/pipelines-with-components/pipeline_with_pipeline_component/pipeline_with_train_eval_pipeline_component/components/train_pipeline_component Dummy train-score-eval pipeline component with local components
jobs/pipelines-with-components/pipeline_with_pipeline_component/pipeline_with_train_eval_pipeline_component/pipeline.yml jobs/pipelines-with-components/pipeline_with_pipeline_component/pipeline_with_train_eval_pipeline_component/pipeline Select best model trained with different learning rate
jobs/automl-standalone-jobs/cli-automl-classification-task-bankmarketing/cli-automl-classification-task-bankmarketing.yml jobs/automl-standalone-jobs/cli-automl-classification-task-bankmarketing/cli-automl-classification-task-bankmarketing A Classification job using bank marketing
jobs/automl-standalone-jobs/cli-automl-forecasting-bike-share/cli-automl-forecasting-task-bike-share.yml jobs/automl-standalone-jobs/cli-automl-forecasting-bike-share/cli-automl-forecasting-task-bike-share A Time-Series Forecasting job using bike share dataset
jobs/automl-standalone-jobs/cli-automl-forecasting-orange-juice-sales/cli-automl-forecasting-orange-juice-sales.yml jobs/automl-standalone-jobs/cli-automl-forecasting-orange-juice-sales/cli-automl-forecasting-orange-juice-sales A Time-Series Forecasting job using orange juice sales dataset
jobs/automl-standalone-jobs/cli-automl-forecasting-task-energy-demand/cli-automl-forecasting-task-energy-demand.yml jobs/automl-standalone-jobs/cli-automl-forecasting-task-energy-demand/cli-automl-forecasting-task-energy-demand A Time-Series Forecasting job using energy demand dataset
jobs/automl-standalone-jobs/cli-automl-forecasting-task-github-dau/cli-automl-forecasting-task-github-dau.yml jobs/automl-standalone-jobs/cli-automl-forecasting-task-github-dau/cli-automl-forecasting-task-github-dau A Time-Series Forecasting job using Github DAU dataset that trains only the TCNForecaster model.
jobs/automl-standalone-jobs/cli-automl-image-classification-multiclass-task-fridge-items/cli-automl-img-cls-mc-task-fridge-items-automode.yml jobs/automl-standalone-jobs/cli-automl-image-classification-multiclass-task-fridge-items/cli-automl-img-cls-mc-task-fridge-items-automode A multi-class Image classification job using fridge items dataset
jobs/automl-standalone-jobs/cli-automl-image-classification-multiclass-task-fridge-items/cli-automl-img-cls-mc-task-fridge-items.yml jobs/automl-standalone-jobs/cli-automl-image-classification-multiclass-task-fridge-items/cli-automl-img-cls-mc-task-fridge-items A multi-class Image classification job using fridge items dataset
jobs/automl-standalone-jobs/cli-automl-image-classification-multilabel-task-fridge-items/cli-automl-img-cls-ml-task-fridge-items-automode.yml jobs/automl-standalone-jobs/cli-automl-image-classification-multilabel-task-fridge-items/cli-automl-img-cls-ml-task-fridge-items-automode A multi-label Image classification job using fridge items dataset
jobs/automl-standalone-jobs/cli-automl-image-classification-multilabel-task-fridge-items/cli-automl-img-cls-ml-task-fridge-items.yml jobs/automl-standalone-jobs/cli-automl-image-classification-multilabel-task-fridge-items/cli-automl-img-cls-ml-task-fridge-items A multi-label Image classification job using fridge items dataset
jobs/automl-standalone-jobs/cli-automl-image-instance-segmentation-task-fridge-items/cli-automl-img-ins-seg-task-fridge-items-automode.yml jobs/automl-standalone-jobs/cli-automl-image-instance-segmentation-task-fridge-items/cli-automl-img-ins-seg-task-fridge-items-automode An Image Instance segmentation job using fridge items dataset
jobs/automl-standalone-jobs/cli-automl-image-instance-segmentation-task-fridge-items/cli-automl-img-ins-seg-task-fridge-items.yml jobs/automl-standalone-jobs/cli-automl-image-instance-segmentation-task-fridge-items/cli-automl-img-ins-seg-task-fridge-items An Image Instance segmentation job using fridge items dataset
jobs/automl-standalone-jobs/cli-automl-image-object-detection-task-fridge-items/cli-automl-img-od-task-fridge-items-automode.yml jobs/automl-standalone-jobs/cli-automl-image-object-detection-task-fridge-items/cli-automl-img-od-task-fridge-items-automode An Image Object Detection job using fridge items dataset
jobs/automl-standalone-jobs/cli-automl-image-object-detection-task-fridge-items/cli-automl-img-od-task-fridge-items.yml jobs/automl-standalone-jobs/cli-automl-image-object-detection-task-fridge-items/cli-automl-img-od-task-fridge-items An Image Object Detection job using fridge items dataset
jobs/automl-standalone-jobs/cli-automl-regression-task-hardware-perf/cli-automl-regression-task-hardware-perf.yml jobs/automl-standalone-jobs/cli-automl-regression-task-hardware-perf/cli-automl-regression-task-hardware-perf A regression job using hardware performance dataset
jobs/automl-standalone-jobs/cli-automl-text-classification-multilabel-paper-cat/cli-automl-text-classification-multilabel-paper-cat.yml jobs/automl-standalone-jobs/cli-automl-text-classification-multilabel-paper-cat/cli-automl-text-classification-multilabel-paper-cat A text classification multilabel job using paper categorization data
jobs/automl-standalone-jobs/cli-automl-text-classification-newsgroup/cli-automl-text-classification-newsgroup.yml jobs/automl-standalone-jobs/cli-automl-text-classification-newsgroup/cli-automl-text-classification-newsgroup A text classification job using newsgroup dataset
jobs/automl-standalone-jobs/cli-automl-text-ner-conll-distributed-sweeping/cli-automl-text-ner-conll2003-distributed-sweeping.yml jobs/automl-standalone-jobs/cli-automl-text-ner-conll-distributed-sweeping/cli-automl-text-ner-conll2003-distributed-sweeping A text named entity recognition job using CoNLL 2003 data
jobs/automl-standalone-jobs/cli-automl-text-ner-conll/cli-automl-text-ner-conll2003.yml jobs/automl-standalone-jobs/cli-automl-text-ner-conll/cli-automl-text-ner-conll2003 A text named entity recognition job using CoNLL 2003 data
responsible-ai/cli-responsibleaidashboard-housing-classification/cli-responsibleaidashboard-housing-classification.yml responsible-ai/cli-responsibleaidashboard-housing-classification/cli-responsibleaidashboard-housing-classification no description
responsible-ai/cli-responsibleaidashboard-programmer-regression/cli-responsibleaidashboard-programmer-regression.yml responsible-ai/cli-responsibleaidashboard-programmer-regression/cli-responsibleaidashboard-programmer-regression no description
jobs/parallel/1a_oj_sales_prediction/pipeline.yml jobs/parallel/1a_oj_sales_prediction/pipeline The hello world pipeline job with partition by key
jobs/parallel/2a_iris_batch_prediction/pipeline.yml jobs/parallel/2a_iris_batch_prediction/pipeline The hello world pipeline job with inline parallel job
jobs/parallel/3a_mnist_batch_identification/pipeline.yml jobs/parallel/3a_mnist_batch_identification/pipeline The hello world pipeline job with inline parallel job
cli\foundation-models\azure_openai\oai-v1\openai_completions_finetune\openai_completions_finetune_spec.yaml cli\foundation-models\azure_openai\oai-v1\openai_completions_finetune\openai_completions_finetune_spec.yaml The hello world pipeline job with inline parallel job
cli\foundation-models\azure_openai\oai-v2\openai_completions_finetune_pipeline\openai_completions_finetune_pipeline_spec.yaml cli\foundation-models\azure_openai\oai-v2\openai_completions_finetune_pipeline\openai_completions_finetune_pipeline_spec.yaml The hello world pipeline job with inline parallel job

Endpoints (endpoints)

path status description
endpoints/batch/deploy-models/custom-outputs-parquet/endpoint.yml endpoints/batch/deploy-models/custom-outputs-parquet/endpoint A heart condition classifier for batch inference
endpoints/batch/deploy-models/heart-classifier-mlflow/endpoint.yml endpoints/batch/deploy-models/heart-classifier-mlflow/endpoint A heart condition classifier for batch inference
endpoints/batch/deploy-models/huggingface-text-summarization/endpoint.yml endpoints/batch/deploy-models/huggingface-text-summarization/endpoint A batch endpoint for summarizing text using a HuggingFace transformer model.
endpoints/batch/deploy-models/imagenet-classifier/endpoint.yml endpoints/batch/deploy-models/imagenet-classifier/endpoint A batch endpoint for performing image classification using a TFHub model ImageNet model.
endpoints/batch/deploy-models/mnist-classifier/endpoint.yml endpoints/batch/deploy-models/mnist-classifier/endpoint A batch endpoint for scoring images from the MNIST dataset.
endpoints/online/custom-container/minimal/multimodel/minimal-multimodel-endpoint.yml endpoints/online/custom-container/minimal/multimodel/minimal-multimodel-endpoint no description
endpoints/online/custom-container/minimal/single-model/conda-in-dockerfile/minimal-single-model-conda-in-dockerfile-endpoint.yml endpoints/online/custom-container/minimal/single-model/conda-in-dockerfile/minimal-single-model-conda-in-dockerfile-endpoint no description
endpoints/online/custom-container/minimal/single-model/minimal-single-model-endpoint.yml endpoints/online/custom-container/minimal/single-model/minimal-single-model-endpoint no description
endpoints/online/custom-container/mlflow/multideployment-scikit/mlflow-endpoint.yml endpoints/online/custom-container/mlflow/multideployment-scikit/mlflow-endpoint no description
endpoints/online/custom-container/r/multimodel-plumber/r-endpoint.yml endpoints/online/custom-container/r/multimodel-plumber/r-endpoint no description
endpoints/online/custom-container/torchserve/densenet/torchserve-endpoint.yml endpoints/online/custom-container/torchserve/densenet/torchserve-endpoint no description
endpoints/online/custom-container/triton/single-model/triton-cc-endpoint.yml endpoints/online/custom-container/triton/single-model/triton-cc-endpoint no description
endpoints/online/kubernetes/kubernetes-endpoint.yml endpoints/online/kubernetes/kubernetes-endpoint no description
endpoints/online/managed/sample/endpoint.yml endpoints/online/managed/sample/endpoint no description
endpoints/online/managed/vnet/mlflow/endpoint.yml endpoints/online/managed/vnet/mlflow/endpoint no description
endpoints/online/managed/vnet/sample/endpoint.yml endpoints/online/managed/vnet/sample/endpoint no description

Resources (resources)

path status description
resources/compute/cluster-basic.yml resources/compute/cluster-basic no description
resources/compute/cluster-location.yml resources/compute/cluster-location no description
resources/compute/cluster-low-priority.yml resources/compute/cluster-low-priority no description
resources/compute/cluster-minimal.yml resources/compute/cluster-minimal no description
resources/compute/cluster-ssh-password.yml resources/compute/cluster-ssh-password no description
resources/compute/cluster-system-identity.yml resources/compute/cluster-system-identity no description

Assets (assets)

path status description
assets/component/pipeline.yml assets/component/pipeline pipeline component with inline job
assets/component/train.yml assets/component/train A example train component
assets/data/cloud-file-https.yml assets/data/cloud-file-https Data asset created from a file in cloud using https URL.
assets/data/cloud-file-wasbs.yml assets/data/cloud-file-wasbs Data asset created from a file in cloud using wasbs URL.
assets/data/cloud-file.yml assets/data/cloud-file Data asset created from file in cloud.
assets/data/cloud-folder-https.yml assets/data/cloud-folder-https Dataset created from folder in cloud using https URL.
assets/data/cloud-folder-wasbs.yml assets/data/cloud-folder-wasbs Data asset created from folder in cloud using wasbs URL.
assets/data/cloud-folder.yml assets/data/cloud-folder Data asset created from folder in cloud.
assets/data/cloud-mltable.yml assets/data/cloud-mltable Titanic data
assets/data/iris-csv-example.yml assets/data/iris-csv-example no description
assets/data/local-file.yml assets/data/local-file Data asset created from local file.
assets/data/local-folder-sampledata.yml assets/data/local-folder-sampledata Dataset created from local folder.
assets/data/local-folder.yml assets/data/local-folder Dataset created from local folder.
assets/data/local-mltable.yml assets/data/local-mltable Data asset created from local MLTable.
assets/data/public-file-https.yml assets/data/public-file-https Data asset created from a publicly available file using https URL.
assets/environment/docker-context.yml assets/environment/docker-context no description
assets/environment/docker-image-plus-conda.yaml assets/environment/docker-image-plus-conda Environment created from a Docker image plus Conda environment.
assets/environment/docker-image.yml assets/environment/docker-image Environment created from a Docker image.
assets/model/local-file.yml assets/model/local-file Model created from local file.
assets/model/local-mlflow.yml assets/model/local-mlflow Model created from local MLflow model directory.

Schedules

path status
schedules/cron-job-schedule.yml schedules/cron-job-schedule
schedules/cron-with-settings-job-schedule.yml schedules/cron-with-settings-job-schedule
schedules/recurrence-job-schedule.yml schedules/recurrence-job-schedule

Contents

directory description
assets assets
endpoints endpoints
jobs jobs
resources resources

Contributing

We welcome contributions and suggestions! Please see the contributing guidelines for details.

Code of Conduct

This project has adopted the Microsoft Open Source Code of Conduct. Please see the code of conduct for details.

Reference