Merge pull request #283 from microsoft/pabuehle_hyperd
Hyperdrive edits
This commit is contained in:
PatrickBue
GitHub
Коммит
af0b4b4fd8
|
|
@ -20,16 +20,16 @@
|
|||
"cell_type": "markdown",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"In this notebook, we'll cover how to test different hyperparameters for a particular dataset and how to benchmark different parameters across a group of datasets using AzureML"
|
||||
"In this notebook, we'll cover how to test different hyperparameters for a particular dataset and how to benchmark different parameters across a group of datasets using AzureML. We assume familiarity with the basic concepts and parameters, which are discussed in the [01_training_introduction.ipynb](01_training_introduction.ipynb), [02_multilabel_classification.ipynb](02_multilabel_classification.ipynb) and [03_training_accuracy_vs_speed.ipynb](03_training_accuracy_vs_speed.ipynb) notebooks. "
|
||||
]
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"Similar to [11_exploring_hyperparameters.ipynb](https://github.com/microsoft/ComputerVision/blob/master/classification/notebooks/11_exploring_hyperparameters.ipynb), we will learn more about how different learning rates and different image sizes affect our model's accuracy when restricted to 10 epochs, and we want to build an AzureML experiment to test out these hyperparameters. \n",
|
||||
"Similar to [11_exploring_hyperparameters.ipynb](https://github.com/microsoft/ComputerVision/blob/master/classification/notebooks/11_exploring_hyperparameters.ipynb), we will learn more about how different learning rates and different image sizes affect our model's accuracy when restricted to 16 epochs, and we want to build an AzureML experiment to test out these hyperparameters. \n",
|
||||
"\n",
|
||||
"We will be using a ResNet50 model to classify a set of images into 4 categories - 'can', 'carton', 'milk_bottle', 'water_bottle'. We will then conduct hyper-parameter tuning to find the best set of parameters for this model. For this,\n",
|
||||
"We will be using a ResNet18 model to classify a set of images into 4 categories: 'can', 'carton', 'milk_bottle', 'water_bottle'. We will then conduct hyper-parameter tuning to find the best set of parameters for this model. For this,\n",
|
||||
"we present an overall process of utilizing AzureML, specifically [Hyperdrive](https://docs.microsoft.com/en-us/python/api/azureml-train-core/azureml.train.hyperdrive?view=azure-ml-py) component to run this tuning in parallel (and not successively).We demonstrate the following key steps: \n",
|
||||
"* Configure AzureML Workspace\n",
|
||||
"* Create Remote Compute Target (GPU cluster)\n",
|
||||
|
|
@ -43,15 +43,7 @@
|
|||
"cell_type": "code",
|
||||
"execution_count": 1,
|
||||
"metadata": {},
|
||||
"outputs": [
|
||||
{
|
||||
"name": "stdout",
|
||||
"output_type": "stream",
|
||||
"text": [
|
||||
"SDK version: 1.0.48\n"
|
||||
]
|
||||
}
|
||||
],
|
||||
"outputs": [],
|
||||
"source": [
|
||||
"import os\n",
|
||||
"import sys\n",
|
||||
|
|
@ -65,15 +57,14 @@
|
|||
"from azureml.core.compute import ComputeTarget, AmlCompute\n",
|
||||
"from azureml.core.compute_target import ComputeTargetException\n",
|
||||
"import azureml.data\n",
|
||||
"from azureml.train.hyperdrive import RandomParameterSampling, BanditPolicy, HyperDriveConfig, PrimaryMetricGoal, choice\n",
|
||||
"from azureml.train.estimator import Estimator\n",
|
||||
"\n",
|
||||
"from azureml.train.hyperdrive import (\n",
|
||||
" RandomParameterSampling, BanditPolicy, HyperDriveConfig, PrimaryMetricGoal, choice, uniform\n",
|
||||
")\n",
|
||||
"import azureml.widgets as widgets\n",
|
||||
"\n",
|
||||
"from utils_cv.classification.data import Urls\n",
|
||||
"from utils_cv.common.data import unzip_url\n",
|
||||
"\n",
|
||||
"print(\"SDK version:\", azureml.core.VERSION)"
|
||||
"from utils_cv.common.data import unzip_url"
|
||||
]
|
||||
},
|
||||
{
|
||||
|
|
@ -98,8 +89,7 @@
|
|||
"cell_type": "markdown",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"### 1. Config AzureML workspace\n",
|
||||
"Below we setup AzureML workspace and get all its details as follows:"
|
||||
"We now define some parameters which will be used in this notebook:"
|
||||
]
|
||||
},
|
||||
{
|
||||
|
|
@ -116,36 +106,37 @@
|
|||
"subscription_id = \"YOUR_SUBSCRIPTION_ID\"\n",
|
||||
"resource_group = \"YOUR_RESOURCE_GROUP_NAME\" \n",
|
||||
"workspace_name = \"YOUR_WORKSPACE_NAME\" \n",
|
||||
"workspace_region = \"YOUR_WORKSPACE_REGION\" #Possible values eastus, eastus2 and so on.\n",
|
||||
"workspace_region = \"YOUR_WORKSPACE_REGION\" #Possible values eastus, eastus2, etc.\n",
|
||||
"\n",
|
||||
"max_total_runs=50\n"
|
||||
"# Choose a size for our cluster and the maximum number of nodes\n",
|
||||
"VM_SIZE = \"STANDARD_NC6\" #\"STANDARD_NC6S_V3\"\n",
|
||||
"MAX_NODES = 12\n",
|
||||
"\n",
|
||||
"# Hyperparameter search space\n",
|
||||
"IM_SIZES = [150, 300]\n",
|
||||
"LEARNING_RATE_MAX = 1e-3\n",
|
||||
"LEARNING_RATE_MIN = 1e-5\n",
|
||||
"MAX_TOTAL_RUNS = 10 #Set to higher value to test more parameter combinations\n",
|
||||
"\n",
|
||||
"# Image data\n",
|
||||
"DATA = unzip_url(Urls.fridge_objects_path, exist_ok=True)"
|
||||
]
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"### 1. Config AzureML workspace\n",
|
||||
"Below we setup (or load an existing) AzureML workspace, and get all its details as follows. Note that the resource group and workspace will get created if they do not yet exist. For more information regaring the AzureML workspace see also the [20_azure_workspace_setup.ipynb](20_azure_workspace_setup.ipynb) notebook.\n",
|
||||
"\n",
|
||||
"To simplify clean-up (see end of this notebook), we recommend creating a new resource group to run this notebook."
|
||||
]
|
||||
},
|
||||
{
|
||||
"cell_type": "code",
|
||||
"execution_count": 4,
|
||||
"execution_count": null,
|
||||
"metadata": {},
|
||||
"outputs": [
|
||||
{
|
||||
"name": "stderr",
|
||||
"output_type": "stream",
|
||||
"text": [
|
||||
"WARNING - Warning: Falling back to use azure cli login credentials.\n",
|
||||
"If you run your code in unattended mode, i.e., where you can't give a user input, then we recommend to use ServicePrincipalAuthentication or MsiAuthentication.\n",
|
||||
"Please refer to aka.ms/aml-notebook-auth for different authentication mechanisms in azureml-sdk.\n"
|
||||
]
|
||||
},
|
||||
{
|
||||
"name": "stdout",
|
||||
"output_type": "stream",
|
||||
"text": [
|
||||
"Workspace name: smoketestwsnew\n",
|
||||
"Workspace region: eastus2\n",
|
||||
"Subscription id: 0ca618d2-22a8-413a-96d0-0f1b531129c3\n",
|
||||
"Resource group: smoketestnew11\n"
|
||||
]
|
||||
}
|
||||
],
|
||||
"outputs": [],
|
||||
"source": [
|
||||
"from utils_cv.common.azureml import get_or_create_workspace\n",
|
||||
"\n",
|
||||
|
|
@ -167,9 +158,9 @@
|
|||
"metadata": {},
|
||||
"source": [
|
||||
"### 2. Create Remote Target\n",
|
||||
"We create a GPU cluster as our remote compute target. If a cluster with the same name already exists in our workspace, the script will load it instead. We can see [here](https://docs.microsoft.com/en-us/azure/machine-learning/service/how-to-set-up-training-targets#compute-targets-for-training) to learn more about setting up a compute target on different locations.\n",
|
||||
"We create a GPU cluster as our remote compute target. If a cluster with the same name already exists in our workspace, the script will load it instead. This [link](https://docs.microsoft.com/en-us/azure/machine-learning/service/how-to-set-up-training-targets#compute-targets-for-training) provides more information about how to set up a compute target on different locations.\n",
|
||||
"\n",
|
||||
"This notebook selects STANDARD_NC6 virtual machine (VM) and sets its priority as 'lowpriority' to reduce costs."
|
||||
"By default, the VM size is set to use _STANDARD_NC6_ machines. However, if quota is available, our recommendation is to use _STANDARD_NC6S_V3_ machines which come with the much faster V100 GPU."
|
||||
]
|
||||
},
|
||||
{
|
||||
|
|
@ -181,37 +172,32 @@
|
|||
"name": "stdout",
|
||||
"output_type": "stream",
|
||||
"text": [
|
||||
"Found existing compute target.\n",
|
||||
"{'currentNodeCount': 1, 'targetNodeCount': 0, 'nodeStateCounts': {'preparingNodeCount': 0, 'runningNodeCount': 0, 'idleNodeCount': 0, 'unusableNodeCount': 0, 'leavingNodeCount': 1, 'preemptedNodeCount': 0}, 'allocationState': 'Resizing', 'allocationStateTransitionTime': '2019-07-22T04:40:41.047000+00:00', 'errors': None, 'creationTime': '2019-07-22T02:26:37.808395+00:00', 'modifiedTime': '2019-07-22T02:26:53.969636+00:00', 'provisioningState': 'Succeeded', 'provisioningStateTransitionTime': None, 'scaleSettings': {'minNodeCount': 0, 'maxNodeCount': 4, 'nodeIdleTimeBeforeScaleDown': 'PT120S'}, 'vmPriority': 'Dedicated', 'vmSize': 'STANDARD_NC6'}\n"
|
||||
"Creating a new compute target...\n",
|
||||
"Creating\n",
|
||||
"Succeeded\n",
|
||||
"AmlCompute wait for completion finished\n",
|
||||
"Minimum number of nodes requested have been provisioned\n",
|
||||
"{'currentNodeCount': 0, 'targetNodeCount': 0, 'nodeStateCounts': {'preparingNodeCount': 0, 'runningNodeCount': 0, 'idleNodeCount': 0, 'unusableNodeCount': 0, 'leavingNodeCount': 0, 'preemptedNodeCount': 0}, 'allocationState': 'Steady', 'allocationStateTransitionTime': '2019-08-06T15:57:12.457000+00:00', 'errors': None, 'creationTime': '2019-08-06T15:56:43.315467+00:00', 'modifiedTime': '2019-08-06T15:57:25.740370+00:00', 'provisioningState': 'Succeeded', 'provisioningStateTransitionTime': None, 'scaleSettings': {'minNodeCount': 0, 'maxNodeCount': 12, 'nodeIdleTimeBeforeScaleDown': 'PT120S'}, 'vmPriority': 'Dedicated', 'vmSize': 'STANDARD_NC6'}\n"
|
||||
]
|
||||
}
|
||||
],
|
||||
"source": [
|
||||
"# choose a name for our cluster\n",
|
||||
"cluster_name = \"gpu-cluster-nc6\"\n",
|
||||
"# Remote compute (cluster) configuration. If you want to reduce costs even more, set these to small.\n",
|
||||
"# For example, using Standard_DS1_v2 instead of using STANDARD_NC6\n",
|
||||
"VM_SIZE = 'STANDARD_NC6'\n",
|
||||
"VM_PRIORITY = 'lowpriority'\n",
|
||||
"\n",
|
||||
"# Cluster nodes\n",
|
||||
"MIN_NODES = 0\n",
|
||||
"MAX_NODES = 4\n",
|
||||
"CLUSTER_NAME = \"gpu-cluster\"\n",
|
||||
"\n",
|
||||
"try:\n",
|
||||
" # Retrieve if a compute target with the same cluster_name already exists\n",
|
||||
" compute_target = ComputeTarget(workspace=ws, name=cluster_name)\n",
|
||||
" # Retrieve if a compute target with the same cluster name already exists\n",
|
||||
" compute_target = ComputeTarget(workspace=ws, name=CLUSTER_NAME)\n",
|
||||
" print('Found existing compute target.')\n",
|
||||
" \n",
|
||||
"except ComputeTargetException:\n",
|
||||
" # If it doesn't already exist, we create a new one with the name provided\n",
|
||||
" print('Creating a new compute target...')\n",
|
||||
" compute_config = AmlCompute.provisioning_configuration(vm_size=VM_SIZE,\n",
|
||||
" min_nodes=MIN_NODES,\n",
|
||||
" min_nodes=0,\n",
|
||||
" max_nodes=MAX_NODES)\n",
|
||||
"\n",
|
||||
" # create the cluster\n",
|
||||
" compute_target = ComputeTarget.create(ws, cluster_name, compute_config)\n",
|
||||
"\n",
|
||||
" compute_target = ComputeTarget.create(ws, CLUSTER_NAME, compute_config)\n",
|
||||
" compute_target.wait_for_completion(show_output=True)\n",
|
||||
"\n",
|
||||
"# we can use get_status() to get a detailed status for the current cluster. \n",
|
||||
|
|
@ -228,327 +214,10 @@
|
|||
},
|
||||
{
|
||||
"cell_type": "code",
|
||||
"execution_count": 6,
|
||||
"execution_count": null,
|
||||
"metadata": {},
|
||||
"outputs": [
|
||||
{
|
||||
"name": "stdout",
|
||||
"output_type": "stream",
|
||||
"text": [
|
||||
"Uploading an estimated of 138 files\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/cvbp_milk_bottle.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/cvbp_water_bottle.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/example.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects.zip\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/1.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/10.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/11.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/12.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/13.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/14.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/15.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/16.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/17.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/18.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/19.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/2.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/20.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/21.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/22.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/23.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/24.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/25.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/26.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/27.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/28.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/29.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/3.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/30.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/31.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/32.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/4.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/5.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/15.jpg, 1 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/6.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/32.jpg, 2 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/7.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/cvbp_water_bottle.jpg, 3 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/8.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/11.jpg, 4 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/9.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/6.jpg, 5 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/33.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/cvbp_milk_bottle.jpg, 6 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/34.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/14.jpg, 7 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/35.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/5.jpg, 8 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/36.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/example.jpg, 9 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/37.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/18.jpg, 10 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/38.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/7.jpg, 11 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/39.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/9.jpg, 12 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/40.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/36.jpg, 13 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/41.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/13.jpg, 14 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/42.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/34.jpg, 15 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/43.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/39.jpg, 16 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/44.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/33.jpg, 17 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/45.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/41.jpg, 18 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/23.jpg, 19 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/1.jpg, 20 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/46.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/47.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/12.jpg, 21 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/48.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/49.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/16.jpg, 22 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/50.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/31.jpg, 23 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/51.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/26.jpg, 24 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/52.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/47.jpg, 25 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/53.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/44.jpg, 26 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/54.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/49.jpg, 27 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/55.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/53.jpg, 28 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/56.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/29.jpg, 29 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/57.jpg\n"
|
||||
]
|
||||
},
|
||||
{
|
||||
"name": "stdout",
|
||||
"output_type": "stream",
|
||||
"text": [
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/56.jpg, 30 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/58.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/43.jpg, 31 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/59.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/54.jpg, 32 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/60.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/8.jpg, 33 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/61.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/55.jpg, 34 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/62.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/40.jpg, 35 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/63.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/10.jpg, 36 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/64.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/58.jpg, 37 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/100.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/42.jpg, 38 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/101.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/59.jpg, 39 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/65.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/100.jpg, 40 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/66.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/62.jpg, 41 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/67.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/48.jpg, 42 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/68.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/45.jpg, 43 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/69.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/51.jpg, 44 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/70.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/50.jpg, 45 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/71.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/46.jpg, 46 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/72.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/60.jpg, 47 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/73.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/66.jpg, 48 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/74.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/65.jpg, 49 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/75.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/25.jpg, 50 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/76.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/73.jpg, 51 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/77.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/67.jpg, 52 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/78.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/77.jpg, 53 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/79.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/52.jpg, 54 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/80.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/22.jpg, 55 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/81.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/75.jpg, 56 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/82.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/63.jpg, 57 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/83.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/78.jpg, 58 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/84.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/101.jpg, 59 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/85.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/79.jpg, 60 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/86.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/74.jpg, 61 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/87.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/61.jpg, 62 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/88.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/57.jpg, 63 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/89.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/69.jpg, 64 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/90.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/70.jpg, 65 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/91.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/68.jpg, 66 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/92.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/83.jpg, 67 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/93.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/72.jpg, 68 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/94.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/81.jpg, 69 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/95.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/64.jpg, 70 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/3.jpg, 71 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/96.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/97.jpg\n"
|
||||
]
|
||||
},
|
||||
{
|
||||
"name": "stdout",
|
||||
"output_type": "stream",
|
||||
"text": [
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/84.jpg, 72 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/35.jpg, 73 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/98.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/99.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/71.jpg, 74 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/102.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/85.jpg, 75 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/103.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/17.jpg, 76 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/104.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/87.jpg, 77 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/105.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/94.jpg, 78 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/106.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/97.jpg, 79 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/107.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/2.jpg, 80 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/108.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/88.jpg, 81 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/109.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/28.jpg, 82 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/110.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/21.jpg, 83 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/111.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/27.jpg, 84 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/112.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/106.jpg, 85 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/113.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/86.jpg, 86 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/114.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/108.jpg, 87 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/115.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/102.jpg, 88 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/116.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/20.jpg, 89 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/117.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/76.jpg, 90 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/118.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/104.jpg, 91 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/119.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/90.jpg, 92 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/120.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/91.jpg, 93 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/121.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/93.jpg, 94 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/122.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/109.jpg, 95 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/123.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/113.jpg, 96 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/124.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/19.jpg, 97 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/125.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/92.jpg, 98 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/126.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/122.jpg, 99 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/127.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/80.jpg, 100 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/128.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/96.jpg, 101 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/119.jpg, 102 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/24.jpg, 103 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/129.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/130.jpg\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/131.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/116.jpg, 104 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/132.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/120.jpg, 105 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/133.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/121.jpg, 106 files out of an estimated total of 138\n",
|
||||
"Uploading /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/134.jpg\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/89.jpg, 107 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/103.jpg, 108 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/123.jpg, 109 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/128.jpg, 110 files out of an estimated total of 138\n"
|
||||
]
|
||||
},
|
||||
{
|
||||
"name": "stdout",
|
||||
"output_type": "stream",
|
||||
"text": [
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/118.jpg, 111 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/127.jpg, 112 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/126.jpg, 113 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/38.jpg, 114 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/133.jpg, 115 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/134.jpg, 116 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/124.jpg, 117 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/99.jpg, 118 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/131.jpg, 119 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/132.jpg, 120 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/82.jpg, 121 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/129.jpg, 122 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/98.jpg, 123 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/111.jpg, 124 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/117.jpg, 125 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/107.jpg, 126 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/4.jpg, 127 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/114.jpg, 128 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/milk_bottle/95.jpg, 129 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/125.jpg, 130 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/110.jpg, 131 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/105.jpg, 132 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/112.jpg, 133 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/can/30.jpg, 134 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/130.jpg, 135 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/carton/37.jpg, 136 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects/water_bottle/115.jpg, 137 files out of an estimated total of 138\n",
|
||||
"Uploaded /Users/richinjain/projects/ComputerVision/data/fridgeObjects.zip, 138 files out of an estimated total of 138\n",
|
||||
"Uploaded 138 files\n"
|
||||
]
|
||||
},
|
||||
{
|
||||
"data": {
|
||||
"text/plain": [
|
||||
"$AZUREML_DATAREFERENCE_f63fbd85fa17436fa173eb6034cd9eb5"
|
||||
]
|
||||
},
|
||||
"execution_count": 6,
|
||||
"metadata": {},
|
||||
"output_type": "execute_result"
|
||||
}
|
||||
],
|
||||
"outputs": [],
|
||||
"source": [
|
||||
"# Note, all the files under DATA will be uploaded to the data store\n",
|
||||
"DATA = unzip_url(Urls.fridge_objects_path, exist_ok=True)\n",
|
||||
"REPS = 3\n",
|
||||
"\n",
|
||||
"# Retrieving default datastore that got automatically created when we setup a workspace\n",
|
||||
"ds = ws.get_default_datastore()\n",
|
||||
"\n",
|
||||
|
|
@ -594,7 +263,7 @@
|
|||
"name": "stdout",
|
||||
"output_type": "stream",
|
||||
"text": [
|
||||
"Overwriting /Users/richinjain/projects/ComputerVision/classification/notebooks/hyperparameter/train.py\n"
|
||||
"Overwriting C:\\Users\\pabuehle\\Desktop\\ComputerVision\\classification\\notebooks\\hyperparameter/train.py\n"
|
||||
]
|
||||
}
|
||||
],
|
||||
|
|
@ -615,69 +284,66 @@
|
|||
"\n",
|
||||
"run = Run.get_context()\n",
|
||||
"\n",
|
||||
"\n",
|
||||
"#------------------------------------------------------------------\n",
|
||||
"# Define parameters that we are going to use for training\n",
|
||||
"ARCHITECTURE = models.resnet50\n",
|
||||
"ARCHITECTURE = models.resnet18\n",
|
||||
"EPOCHS_HEAD = 4\n",
|
||||
"EPOCHS_BODY = 12\n",
|
||||
"BATCH_SIZE = 16\n",
|
||||
"#------------------------------------------------------------------\n",
|
||||
"\n",
|
||||
"\n",
|
||||
"# Parse arguments passed by Hyperdrive\n",
|
||||
"parser = argparse.ArgumentParser()\n",
|
||||
"\n",
|
||||
"\n",
|
||||
"# Data path\n",
|
||||
"parser.add_argument('--data-folder', type=str, dest='DATA_DIR', help=\"Datastore path\")\n",
|
||||
"parser.add_argument('--im_size', type=int, dest='IM_SIZE')\n",
|
||||
"parser.add_argument('--learning_rate', type=float, dest='LEARNING_RATE')\n",
|
||||
"\n",
|
||||
"args = parser.parse_args()\n",
|
||||
"params = vars(args)\n",
|
||||
"\n",
|
||||
"if params['IM_SIZE'] is None:\n",
|
||||
" raise ValueError(\"Image Size empty\")\n",
|
||||
" \n",
|
||||
"if params['LEARNING_RATE'] is None:\n",
|
||||
" raise ValueError(\"Learning Rate empty\")\n",
|
||||
"\n",
|
||||
"if params['DATA_DIR'] is None:\n",
|
||||
" raise ValueError(\"Data folder empty\")\n",
|
||||
" \n",
|
||||
"\n",
|
||||
"# Getting training and validation data\n",
|
||||
"path = params['DATA_DIR'] + '/data/fridgeObjects'\n",
|
||||
"\n",
|
||||
"# Getting training and validation data and training the CNN as done in 01_training_introduction.ipynb\n",
|
||||
"data = (ImageList.from_folder(path)\n",
|
||||
" .split_by_rand_pct(valid_pct=0.2, seed=10)\n",
|
||||
" .split_by_rand_pct(valid_pct=0.5, seed=10)\n",
|
||||
" .label_from_folder() \n",
|
||||
" .transform(size=params['IM_SIZE']) \n",
|
||||
" .databunch(bs=16) \n",
|
||||
" .databunch(bs=BATCH_SIZE) \n",
|
||||
" .normalize(imagenet_stats))\n",
|
||||
"\n",
|
||||
"# Get model and run training\n",
|
||||
"learn = cnn_learner(\n",
|
||||
" data,\n",
|
||||
" ARCHITECTURE,\n",
|
||||
" metrics=[accuracy]\n",
|
||||
")\n",
|
||||
"\n",
|
||||
"epochs=1 # Change the value to 10 to see multiple runs, defaulting to 1 for quick run of notebook.\n",
|
||||
"learn.fit_one_cycle(EPOCHS_HEAD, params['LEARNING_RATE'])\n",
|
||||
"learn.unfreeze()\n",
|
||||
"learn.fit(epochs, params['LEARNING_RATE'])\n",
|
||||
"learn.fit_one_cycle(EPOCHS_BODY, params['LEARNING_RATE'])\n",
|
||||
"\n",
|
||||
"# Add log entries\n",
|
||||
"training_losses = [x.numpy().ravel()[0] for x in learn.recorder.losses]\n",
|
||||
"accuracy = [x[0].numpy().ravel()[0] for x in learn.recorder.metrics][-1]\n",
|
||||
"\n",
|
||||
"#run.log_list('training_loss', training_losses)\n",
|
||||
"#run.log_list('validation_loss', learn.recorder.val_losses)\n",
|
||||
"#run.log_list('error_rate', error_rate)\n",
|
||||
"accuracy = [100*x[0].numpy().ravel()[0] for x in learn.recorder.metrics][-1]\n",
|
||||
"run.log('data_dir',params['DATA_DIR'])\n",
|
||||
"run.log('im_size', params['IM_SIZE'])\n",
|
||||
"run.log('learning_rate', params['LEARNING_RATE'])\n",
|
||||
"run.log('accuracy', float(accuracy)) # Logging our primary metric 'accuracy'\n",
|
||||
"\n",
|
||||
"# Save trained model\n",
|
||||
"current_directory = os.getcwd()\n",
|
||||
"output_folder = os.path.join(current_directory, 'outputs')\n",
|
||||
"MODEL_NAME = 'im_classif_resnet50' # Name we will give our model both locally and on Azure\n",
|
||||
"PICKLED_MODEL_NAME = MODEL_NAME + '.pkl'\n",
|
||||
"model_name = 'im_classif_resnet' # Name we will give our model both locally and on Azure\n",
|
||||
"os.makedirs(output_folder, exist_ok=True)\n",
|
||||
"\n",
|
||||
"learn.export(os.path.join(output_folder, PICKLED_MODEL_NAME))"
|
||||
"learn.export(os.path.join(output_folder, model_name + \".pkl\"))"
|
||||
]
|
||||
},
|
||||
{
|
||||
|
|
@ -686,8 +352,6 @@
|
|||
"source": [
|
||||
"### 5. Setup and run Hyperdrive experiment\n",
|
||||
"\n",
|
||||
"Next step is to prepare scripts that AzureML Hyperdrive will use to train and evaluate models with selected hyperparameters. To run the model notebook from the Hyperdrive Run, all we need is to prepare an entry script which parses the hyperparameter arguments, passes them to the notebook, and records the results of the notebook to AzureML Run logs. \n",
|
||||
"\n",
|
||||
"#### 5.1 Create Experiment \n",
|
||||
"Experiment is the main entry point into experimenting with AzureML. To create new Experiment or get the existing one, we pass our experimentation name 'hyperparameter-tuning'.\n"
|
||||
]
|
||||
|
|
@ -708,10 +372,7 @@
|
|||
"source": [
|
||||
"#### 5.2. Define search space\n",
|
||||
"\n",
|
||||
"Now we define the search space of hyperparameters. For example, if you want to test different batch sizes of {64, 128, 256}, you can use azureml.train.hyperdrive.choice(64, 128, 256). To search from a continuous space, use uniform(start, end). For more options, see [Hyperdrive parameter expressions](https://docs.microsoft.com/en-us/python/api/azureml-train-core/azureml.train.hyperdrive.parameter_expressions?view=azure-ml-py).\n",
|
||||
"\n",
|
||||
"In this notebook we use the ResNet50 architecture, and fix the number of epochs to 10.\n",
|
||||
"In the search space, we set different learning rates and image sizes. Details about the hyperparameters can be found in [11_exploring_hyperparameters.ipynb notebook](https://github.com/microsoft/ComputerVision/blob/master/classification/notebooks/11_exploring_hyperparameters.ipynb).\n",
|
||||
"Now we define the search space of hyperparameters. As shown below, to test discrete parameter values use 'choice()', and for uniform sampling use 'uniform()'. For more options, see [Hyperdrive parameter expressions](https://docs.microsoft.com/en-us/python/api/azureml-train-core/azureml.train.hyperdrive.parameter_expressions?view=azure-ml-py).\n",
|
||||
"\n",
|
||||
"Hyperdrive provides three different parameter sampling methods: 'RandomParameterSampling', 'GridParameterSampling', and 'BayesianParameterSampling'. Details about each method can be found [here](https://docs.microsoft.com/en-us/azure/machine-learning/service/how-to-tune-hyperparameters). Here, we use the 'RandomParameterSampling'."
|
||||
]
|
||||
|
|
@ -722,20 +383,13 @@
|
|||
"metadata": {},
|
||||
"outputs": [],
|
||||
"source": [
|
||||
"IM_SIZES = [299, 499]\n",
|
||||
"LEARNING_RATES = [1e-3, 1e-4, 1e-5]\n",
|
||||
"\n",
|
||||
"# Hyperparameter search space\n",
|
||||
"param_sampling = RandomParameterSampling( {\n",
|
||||
" '--learning_rate': choice(LEARNING_RATES),\n",
|
||||
" '--learning_rate': uniform(LEARNING_RATE_MIN, LEARNING_RATE_MAX),\n",
|
||||
" '--im_size': choice(IM_SIZES)\n",
|
||||
" }\n",
|
||||
")\n",
|
||||
"\n",
|
||||
"primary_metric_name = 'accuracy'\n",
|
||||
"primary_metric_goal = PrimaryMetricGoal.MAXIMIZE\n",
|
||||
"max_concurrent_runs=4\n",
|
||||
"\n",
|
||||
"early_termination_policy = BanditPolicy(slack_factor=0.15, evaluation_interval=1, delay_evaluation=20)"
|
||||
]
|
||||
},
|
||||
|
|
@ -781,7 +435,7 @@
|
|||
"- early termination policy, in this case we use [Bandit Policy](https://docs.microsoft.com/en-us/azure/machine-learning/service/how-to-tune-hyperparameters#bandit-policy)\n",
|
||||
"- primary metric name reported by our runs, in this case it is accuracy \n",
|
||||
"- the goal, which determines whether the primary metric has to be maximized/minimized, in this case it is to maximize our accuracy \n",
|
||||
"- number of total child-runs, in this case it is 4\n",
|
||||
"- number of total child-runs\n",
|
||||
"\n",
|
||||
"The bigger the search space, the more child-runs get triggered for better results."
|
||||
]
|
||||
|
|
@ -795,10 +449,10 @@
|
|||
"hyperdrive_run_config = HyperDriveConfig(estimator=est,\n",
|
||||
" hyperparameter_sampling=param_sampling,\n",
|
||||
" policy=early_termination_policy,\n",
|
||||
" primary_metric_name=primary_metric_name,\n",
|
||||
" primary_metric_goal=primary_metric_goal,\n",
|
||||
" max_total_runs=max_total_runs,\n",
|
||||
" max_concurrent_runs= max_concurrent_runs)"
|
||||
" primary_metric_name='accuracy',\n",
|
||||
" primary_metric_goal=PrimaryMetricGoal.MAXIMIZE,\n",
|
||||
" max_total_runs=MAX_TOTAL_RUNS,\n",
|
||||
" max_concurrent_runs=MAX_NODES)"
|
||||
]
|
||||
},
|
||||
{
|
||||
|
|
@ -816,7 +470,7 @@
|
|||
{
|
||||
"data": {
|
||||
"application/vnd.jupyter.widget-view+json": {
|
||||
"model_id": "fff89f7fb8284f24a94932ca876cbae2",
|
||||
"model_id": "5c51804ba4794f3aa163354fef634c59",
|
||||
"version_major": 2,
|
||||
"version_minor": 0
|
||||
},
|
||||
|
|
@ -826,25 +480,12 @@
|
|||
},
|
||||
"metadata": {},
|
||||
"output_type": "display_data"
|
||||
},
|
||||
{
|
||||
"data": {
|
||||
"application/vnd.jupyter.widget-view+json": {
|
||||
"model_id": "9a3c69449ea34e48a4e0c884ced34538",
|
||||
"version_major": 2,
|
||||
"version_minor": 0
|
||||
},
|
||||
"text/plain": [
|
||||
"_UserRunWidget(widget_settings={'childWidgetDisplay': 'popup', 'send_telemetry': False, 'log_level': 'INFO', '…"
|
||||
]
|
||||
},
|
||||
"metadata": {},
|
||||
"output_type": "display_data"
|
||||
}
|
||||
],
|
||||
"source": [
|
||||
"# Now we submit the Run to our experiment. \n",
|
||||
"hyperdrive_run = exp.submit(config=hyperdrive_run_config)\n",
|
||||
"\n",
|
||||
"# We can see the experiment progress from this notebook by using \n",
|
||||
"widgets.RunDetails(hyperdrive_run).show()"
|
||||
]
|
||||
|
|
@ -857,18 +498,18 @@
|
|||
{
|
||||
"data": {
|
||||
"text/plain": [
|
||||
"{'runId': 'hyperparameter-tuning_1563770544897',\n",
|
||||
" 'target': 'gpu-cluster-nc6',\n",
|
||||
"{'runId': 'hyperparameter-tuning_1565107066432',\n",
|
||||
" 'target': 'gpu-cluster',\n",
|
||||
" 'status': 'Completed',\n",
|
||||
" 'startTimeUtc': '2019-07-22T04:42:25.393015Z',\n",
|
||||
" 'endTimeUtc': '2019-07-22T04:49:58.250673Z',\n",
|
||||
" 'startTimeUtc': '2019-08-06T15:57:46.90426Z',\n",
|
||||
" 'endTimeUtc': '2019-08-06T16:13:21.185098Z',\n",
|
||||
" 'properties': {'primary_metric_config': '{\"name\": \"accuracy\", \"goal\": \"maximize\"}',\n",
|
||||
" 'runTemplate': 'HyperDrive',\n",
|
||||
" 'azureml.runsource': 'hyperdrive',\n",
|
||||
" 'platform': 'AML',\n",
|
||||
" 'baggage': 'eyJvaWQiOiAiNmY1Yjc5M2UtZjhiOS00NGY0LTk0N2YtNTg3N2ZjMDFjZmFjIiwgInRpZCI6ICI3MmY5ODhiZi04NmYxLTQxYWYtOTFhYi0yZDdjZDAxMWRiNDciLCAidW5hbWUiOiAiMDRiMDc3OTUtOGRkYi00NjFhLWJiZWUtMDJmOWUxYmY3YjQ2In0',\n",
|
||||
" 'ContentSnapshotId': 'a63feca7-742e-49c3-b568-9cf6a53b34c3'},\n",
|
||||
" 'logFiles': {'azureml-logs/hyperdrive.txt': 'https://smoketesstorage0231aa20c.blob.core.windows.net/azureml/ExperimentRun/dcid.hyperparameter-tuning_1563770544897/azureml-logs/hyperdrive.txt?sv=2018-03-28&sr=b&sig=LL8Fx6UZhJ9jddaqS1xeR%2BHi98wUHPZ%2FYuAxGH3Y39I%3D&st=2019-07-22T04%3A39%3A59Z&se=2019-07-22T12%3A49%3A59Z&sp=r'}}"
|
||||
" 'baggage': 'eyJvaWQiOiAiNWFlYTJmMzAtZjQxZC00ZDA0LWJiOGUtOWU0NGUyZWQzZGQ2IiwgInRpZCI6ICI3MmY5ODhiZi04NmYxLTQxYWYtOTFhYi0yZDdjZDAxMWRiNDciLCAidW5hbWUiOiAiMDRiMDc3OTUtOGRkYi00NjFhLWJiZWUtMDJmOWUxYmY3YjQ2In0',\n",
|
||||
" 'ContentSnapshotId': 'c662f56a-ff58-432e-b732-8a3bc6818778'},\n",
|
||||
" 'logFiles': {'azureml-logs/hyperdrive.txt': 'https://pabuehlestorage1c7e31216.blob.core.windows.net/azureml/ExperimentRun/dcid.hyperparameter-tuning_1565107066432/azureml-logs/hyperdrive.txt?sv=2018-11-09&sr=b&sig=8D2gwxb%2BYn7nbzgGVHE7QSzJ%2FG7C1swzmLD7%2Fior2vE%3D&st=2019-08-06T17%3A36%3A08Z&se=2019-08-07T01%3A46%3A08Z&sp=r'}}"
|
||||
]
|
||||
},
|
||||
"execution_count": 14,
|
||||
|
|
@ -877,7 +518,7 @@
|
|||
}
|
||||
],
|
||||
"source": [
|
||||
"hyperdrive_run.wait_for_completion()\n"
|
||||
"hyperdrive_run.wait_for_completion()"
|
||||
]
|
||||
},
|
||||
{
|
||||
|
|
@ -911,15 +552,15 @@
|
|||
"name": "stdout",
|
||||
"output_type": "stream",
|
||||
"text": [
|
||||
"* Best Run Id:hyperparameter-tuning_1563770544897_0\n",
|
||||
"* Best Run Id:hyperparameter-tuning_1565107066432_8\n",
|
||||
"Run(Experiment: hyperparameter-tuning,\n",
|
||||
"Id: hyperparameter-tuning_1563770544897_0,\n",
|
||||
"Id: hyperparameter-tuning_1565107066432_8,\n",
|
||||
"Type: azureml.scriptrun,\n",
|
||||
"Status: Completed)\n",
|
||||
"\n",
|
||||
"* Best hyperparameters:\n",
|
||||
"{'--data-folder': '$AZUREML_DATAREFERENCE_workspaceblobstore', '--im_size': '299', '--learning_rate': '0.001'}\n",
|
||||
"Accuracy = 0.26923078298568726\n"
|
||||
"{'--data-folder': '$AZUREML_DATAREFERENCE_workspaceblobstore', '--im_size': '150', '--learning_rate': '0.000552896672441507'}\n",
|
||||
"Accuracy = 92.53731369972229\n"
|
||||
]
|
||||
}
|
||||
],
|
||||
|
|
@ -956,8 +597,7 @@
|
|||
"name": "stdout",
|
||||
"output_type": "stream",
|
||||
"text": [
|
||||
"Downloading outputs/im_classif_resnet50.pkl..\n",
|
||||
"119547037146038801333356\n"
|
||||
"Downloading outputs/im_classif_resnet.pkl..\n"
|
||||
]
|
||||
}
|
||||
],
|
||||
|
|
@ -968,11 +608,10 @@
|
|||
"os.makedirs(output_folder, exist_ok=True)\n",
|
||||
"\n",
|
||||
"for f in best_run.get_file_names():\n",
|
||||
" if f.startswith('outputs/im_classif_resnet50'):\n",
|
||||
" if f.startswith('outputs/im_classif_resnet'):\n",
|
||||
" print(\"Downloading {}..\".format(f))\n",
|
||||
" best_run.download_file('outputs/im_classif_resnet50.pkl')\n",
|
||||
"saved_model =joblib.load('im_classif_resnet50.pkl')\n",
|
||||
"print(saved_model)"
|
||||
" best_run.download_file('outputs/im_classif_resnet.pkl')\n",
|
||||
"saved_model =joblib.load('im_classif_resnet.pkl')"
|
||||
]
|
||||
},
|
||||
{
|
||||
|
|
@ -984,12 +623,27 @@
|
|||
"saved_model.predict(image)\n",
|
||||
"```"
|
||||
]
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"### 7. Clean up\n",
|
||||
"\n",
|
||||
"To avoid unnecessary expenses, all resources which were created in this notebook need to get deleted once parameter search is concluded. To simplify this clean-up step, we recommend creating a new resource group to run this notebook. This resource group can then be deleted, e.g. using the Azure Portal, which will remove all created resources."
|
||||
]
|
||||
},
|
||||
{
|
||||
"cell_type": "code",
|
||||
"execution_count": null,
|
||||
"metadata": {},
|
||||
"outputs": [],
|
||||
"source": []
|
||||
}
|
||||
],
|
||||
"metadata": {
|
||||
"celltoolbar": "Tags",
|
||||
"kernelspec": {
|
||||
"display_name": "cv",
|
||||
"display_name": "Python (cv)",
|
||||
"language": "python",
|
||||
"name": "cv"
|
||||
},
|
||||
|
|
|
|||
|
|
@ -113,9 +113,11 @@ def test_24_notebook_run(
|
|||
subscription_id,
|
||||
resource_group,
|
||||
workspace_name,
|
||||
workspace_region
|
||||
workspace_region,
|
||||
):
|
||||
notebook_path = classification_notebooks["24_exploring_hyperparameters_on_azureml"]
|
||||
notebook_path = classification_notebooks[
|
||||
"24_exploring_hyperparameters_on_azureml"
|
||||
]
|
||||
pm.execute_notebook(
|
||||
notebook_path,
|
||||
OUTPUT_NOTEBOOK,
|
||||
|
|
@ -125,8 +127,9 @@ def test_24_notebook_run(
|
|||
resource_group=resource_group,
|
||||
workspace_name=workspace_name,
|
||||
workspace_region=workspace_region,
|
||||
epochs=1,
|
||||
max_total_runs=1
|
||||
MAX_NODES=2,
|
||||
MAX_TOTAL_RUNS=1,
|
||||
IM_SIZES=[30, 40],
|
||||
),
|
||||
kernel_name=KERNEL_NAME,
|
||||
)
|
||||
|
|
|
|||
Загрузка…
Ссылка в новой задаче