Граф коммитов

429 Коммитов

Автор SHA1 Сообщение Дата
João Pedro Martins 98a610ff1a
Clarified/Fixed getting started instructions for WebApp/AppService deployment (#390)
* Revision of getting started guide up to Batch scoring. Also new diagam and fix to ARM template to remove region restrictions.

* Detail on Batch scoring for Getting Started and additional debug message in the copy to ease of diagnosing issues

* Tweaked text and added a NOQA for message

* Clarified/Fixed getting started instructions for WebApp/AppService deployment

Co-authored-by: Joao Pedro Martins <joaopedro.martins@microsoft.com>
2021-12-15 18:09:36 +01:00
João Pedro Martins 4a9a1ff7bb
Add details on the Batch scoring session of Getting Started (#389)
* Revision of getting started guide up to Batch scoring. Also new diagam and fix to ARM template to remove region restrictions.

* Detail on Batch scoring for Getting Started and additional debug message in the copy to ease of diagnosing issues

* Tweaked text and added a NOQA for message

Co-authored-by: Joao Pedro Martins <joaopedro.martins@microsoft.com>
2021-12-14 22:04:31 +01:00
Tim Johnson 4b2667e34b
Improve readability of exceptions in build pipeline script (#357)
* Update manage_environment.py

* Update attach_compute.py

* Update attach_compute.py

* Update manage_environment.py

Co-authored-by: João Pedro Martins <lokijota@users.noreply.github.com>
2021-12-14 21:27:26 +01:00
Katzmann1983 d081fc2fe6
Fix evaluate issue (#381)
* update documentation

* fix evaluate issue

* linting

Co-authored-by: Jens Humrich <jens.humrich@siemensgamesa.com>
Co-authored-by: João Pedro Martins <lokijota@users.noreply.github.com>
2021-12-14 21:00:54 +01:00
JennyPopova d8e29ccdfd
JP aks deployment fix (#388)
* Change AKS deployment configuration

Deployment config changed from 1CPU/4GB to 0.5CPU/2GB so it fits a AKS created with default parameters

* Update custom_model.md

Co-authored-by: João Pedro Martins <lokijota@users.noreply.github.com>
2021-12-14 20:56:50 +01:00
João Pedro Martins fa03633cdb
Revision of getting started guide up to Batch scoring. Also new diagam and fix to ARM template to remove region restrictions. (#387)
Co-authored-by: Joao Pedro Martins <joaopedro.martins@microsoft.com>
2021-12-14 16:54:49 +01:00
Katzmann1983 c321a26329
update documentation (#379)
Co-authored-by: Jens Humrich <jens.humrich@siemensgamesa.com>
2021-12-14 15:15:02 +01:00
Jenny So ae60e489f0
Pin azureml version to 1.27.* (#361)
* Update ci_dependencies.yml

* Update diabetes_regression-cd.yml

* Update diabetes_regression-package-model-template.yml

* Update diabetes_regression-publish-model-artifact-template.yml

* Update conda_dependencies.yml

* Update conda_dependencies_scorecopy.yml

* Update conda_dependencies_scoring.yml
2021-05-13 01:17:44 -07:00
Jenny So 2892680a58
Pin AzureML SDK > 1.18.0 for pyyaml fix (#356)
* Update conda_dependencies_scoring.yml

* Update conda_dependencies_scorecopy.yml

* Update conda_dependencies_scoring.yml
2021-03-11 10:38:53 -08:00
Daniel Heinze 2f905b25eb
Added AKS compute name details (#355)
Added a clarification, that the AKS compute name comes from the inference cluster, which needs to be created to continue.
2021-03-11 10:22:11 -08:00
SATO Naoki (Neo) 771c8ef1de
fix TRAIN_SCRIPT_PATH value in .env.example (#348)
TRAIN_SCRIPT_PATH value updated from 'training/train.py' to 'training/train_aml.py'.

This is aligned with /.pipelines/diabetes_regression-variables-template.yml.
2021-02-18 11:27:36 -08:00
SATO Naoki (Neo) aba8aefc4b
development_setup.md update (#349)
* development_setup.md update

development_setup.md updated to use install_requirements.sh.

See #158:

> Use conda rather than pip packages when possible (as recommended in AML docs).
> Dev environment is hence also constrained to conda (no more pip install -r requirements.txt).

* Content of install_requirements.sh deleted

* build_train_pipeline.py filename fixed

* build_train_pipeline.py filename fixed
2021-02-16 13:20:23 -08:00
Jenny So 31512d3d6e
Update docs (#339)
* Update getting_started.md

* Update custom_model.md
2020-12-09 14:23:10 -08:00
Jenny So 74885302c4
Fix Batch Scoring docs (#333)
* docs

* more fixes
2020-09-23 16:37:39 -07:00
Jenny So bf34623249
Update azureml-sdk to use latest (#331)
* Update ci_dependencies.yml

* Update conda_dependencies.yml
2020-09-22 15:06:27 -07:00
Jenny So a6014d04ce
update azureml sdk (#326) 2020-09-04 13:42:01 -07:00
Jenny So 15de3c4715
Update getting_started.md (#317) 2020-07-10 16:23:01 -07:00
Jenny So 1d789c2abb
Fix default parameters to batch scoring pipeline + doc fixes (#310)
* fix default params in build batch score

* docs

* fix image

* fix images

* update to azure ml studio pics
2020-07-10 16:09:30 -07:00
Jenny So 27b7d2a7bb
Update docs and pipeline status badge (#303)
* docs

* fix pipeline status badge and tf naming uniqueness

* add a note about how to change the name of the pipeline

* extra clarification on workspace connection
2020-07-06 18:50:33 -07:00
Tom Care 6d02555358
Fix CD deployment break (#305)
Recently the step to get the model version had a name associated with the step. We need to also update the references in future step to use the step name as a prefix. This resulted in the MODEL_VERSION variable causing failures in each CD deployment step.

This did not show up in CI because the MODEL_VERSION var is hard coded in the variable group. We should also remove that.
2020-07-03 16:26:50 -07:00
Tom Care 0906986926
Restore call convention compatibility in get_model (#304)
A bug surfaced where first time evaluation of a model fails due to the
Model constructor throwing if the model does not exist.

Looking deeper, we see that most calls to get_model expect a possible
None response and check at the call site. Unfortunately we get the same
WebserviceException class for a model not being found as we do a REST
error or similar.

This change is a stopgap mitigation to restore compatibility with the
existing callers, and compromises by allowing the model version
dependent behavior to continue passing on exceptions.

In a future follow up we should settle on a convention and allow version
checks to propagate failure while still giving the possibility for
handling a service exception in the caller.
2020-07-03 16:16:10 -07:00
Jenny So b21a46e025
Convert to new split pipeline approach for CI/CD (#278)
* new split pipelines

* specify channel

* fix pip jq install

* fixes and cleanup

* add new lines

* add docs and clean up naming

* use shared image

* rename

* strip quotes from location

* fix env var

* remove succeeded condition

* remove extra deploy yml

* no pr trigger

* remove unused template

* remove unused pipeline

* add more docs and add to bootstrap

* linting

* fix model package to show logs

* Squashed commit of the following:

commit 01af8da39c
Author: j-so <jenns@microsoft.com>
Date:   Fri Jun 12 14:15:35 2020 -0700

    fixed failure handling

commit 1e6f906845
Author: j-so <jenns@microsoft.com>
Date:   Fri Jun 12 14:03:09 2020 -0700

    test failed conda dep

commit a8030d75ec
Author: j-so <jenns@microsoft.com>
Date:   Fri Jun 12 13:55:00 2020 -0700

    test package fail

commit c7845aaca1
Author: j-so <jenns@microsoft.com>
Date:   Fri Jun 12 13:46:27 2020 -0700

    fail on deploy error'

* Squashed commit of the following:

commit 5af6eeb242
Author: j-so <jenns@microsoft.com>
Date:   Mon Jun 15 18:31:15 2020 -0700

    fix bootstrap

commit f61e103ed0
Merge: 2796b40 08bb6f4
Author: j-so <jenns@microsoft.com>
Date:   Mon Jun 15 18:30:21 2020 -0700

    Merge branch 'master' into jenns/splitpipeline_docfix

commit 2796b40024
Author: j-so <jenns@microsoft.com>
Date:   Mon Jun 15 18:30:00 2020 -0700

    remove old pipeline

commit 08bb6f4a26
Author: David Tesar <david.tesar@microsoft.com>
Date:   Mon Jun 15 14:09:12 2020 -0700

    Simplify docs flow (#297)

commit cd762ecaa9
Author: jotaylo <jotaylo@microsoft.com>
Date:   Mon Jun 15 12:28:23 2020 -0700

    Move instruction to install AML extension to Azure Devops setup instructions (#298)

* remove need for model build id

* fix batch scoring

* use model version for batch scoring

* linting

* Squashed commit of the following:

commit 493ed3e64f
Author: j-so <jenns@microsoft.com>
Date:   Mon Jun 22 16:42:07 2020 -0700

    mark as output

commit 1ca7a592ad
Author: j-so <jenns@microsoft.com>
Date:   Mon Jun 22 16:12:10 2020 -0700

    fix import

commit 743e301081
Author: j-so <jenns@microsoft.com>
Date:   Mon Jun 22 15:59:43 2020 -0700

    more fixes

commit 44abcac49d
Author: j-so <jenns@microsoft.com>
Date:   Mon Jun 22 15:50:49 2020 -0700

    fix batch scoring

* improve the docs

* fix secret access

* pass to cli task and impove naming
2020-06-26 11:24:46 -07:00
jitghosh bcdac5c3ae
Jitghosh/parallelbatchscore (#289)
* Batch Scoring First Draft: Added pipeline creation and run scripts, scoring script, new environment variables, changes to env loading script, compute creation and AML environment creation scripts, and new Azure pipeline for batch scoring CI

* Score copy step added

* Modified bootstrap.py, updated getting started doc

* Addressed PR comments

* Addressed PR comments

* Doc fix

* Doc fix
2020-06-22 11:02:30 -04:00
My 90562854f3
update arm template to make workspace sku configurable (#283) 2020-06-18 09:48:01 -07:00
David Tesar 08bb6f4a26
Simplify docs flow (#297) 2020-06-15 14:09:12 -07:00
jotaylo cd762ecaa9
Move instruction to install AML extension to Azure Devops setup instructions (#298) 2020-06-15 12:28:23 -07:00
Jenny So cbeadae5b5
update azureml sdk (#287) 2020-06-02 14:30:15 -07:00
Kosuke Fujimoto f8cd70f3b1
Replaced Env class with dataclass (#277) 2020-05-20 13:51:13 -07:00
Stephanie Visser 8fb12afe70
Add Terraform option to environment_setup (#268)
* setup basic folder and file structure

* add tf backend file and bash script to create state storage

* basic pipeline for infrastructure with tf - yaml, tf, bash

* naming and deleting unnecessary bash script

* updated documentation

* added to the get_started.md guide

* added terraform plan step
2020-05-05 11:16:56 -07:00
Tom Care 32dd48fef2
Update SDK to 1.3.0 (#266)
Fixes #265.
2020-04-14 17:19:41 -07:00
Tom Care 996e0a65a8
Fix docker pipeline by removing trailing whitespace (#264)
The docker pipeline fails to tag because the trailing whitespace gets included in the tag name.
2020-04-13 14:55:03 -07:00
Tom Care d0e91cfaa1
Update CI conda deps to match training/scoring SDK (#263)
- Tied SDK version to 1.2.x as with conda_dependencies.yml
- Lock versions to point updates
- Kept the rest of the deps manually specified to keep image size small and minimize regressions
2020-04-13 14:27:25 -07:00
Tom Care 506d557ebd
Fix training/scoring conda deps (#262)
Azure deprecated their top level meta-package which led to a deprecation error. We don't actually need this top level package.

I took the opportunity to clean up the conda deps using the dependency tree.

- Trimmed the package list
- Explicitly list pip to avoid conda warning
- Use azureml-defaults for WebApp dependencies
- Lock azureml-sdk and azureml-defaults versions
- Add comments for dependencies
2020-04-10 12:38:44 -07:00
Sushant Divate 0fd052e6c1
Update Image creation to use new package (#260)
Update Image creation to use the new package
2020-04-09 16:46:30 -07:00
Olivier Martin 9459616550
fixed function not requiring param (#254)
Co-authored-by: Eugene Fedorenko <eugene.fedor@gmail.com>
2020-04-08 09:35:29 -07:00
Cindy Weng bb62f3d2de
remove file_name parameter because it's not used in function (#252) 2020-04-08 09:22:40 -07:00
Tom Care 3ed9a90e9d
Bootstrap fixes (#250) 2020-04-02 18:27:53 -07:00
jotaylo 319cae6643
Making changes to experiment notebook based on changes to tutorial document (#249)
* making changes to notebook based on changes to tutorial document

* test update to assert_almost_equal

* reference repo details in byoc guide
2020-04-02 09:28:37 -07:00
jotaylo 27afdbb919
clearer explanation of the pipeline stages in the getting started guide (#247) 2020-03-31 10:36:59 -07:00
jotaylo af2b772953
Moving code integration guide into this repo (#243)
* Moving code integration guide into this repo

* dtzar feedback

* add recommendation
2020-03-30 09:29:30 -07:00
Sushant Divate cace90de95
set allow reuse to true (#242)
Co-authored-by: Eugene Fedorenko <eugene.fedor@gmail.com>
2020-03-25 17:34:12 -07:00
Sushant Divate a562b59858
Sudivate dockertag (#240) 2020-03-25 17:30:26 -07:00
Sushant Divate f2dc7d77ce
update doc with aks auth details (#239) 2020-03-25 10:52:52 -07:00
jotaylo 352ebbeba7
Model registration tags come from parameters.json (#237) 2020-03-24 10:48:35 -07:00
Eugene Fedorenko 2d543113f1
Latest Azure ML SDK in the Docker image (#235)
upgrade to  latest aml sdk for build agent
2020-03-17 10:44:11 -07:00
Claus M 1d2d773360
Add an env var flag to recreate AMLS Environment (#230) 2020-03-16 13:28:34 -07:00
Daniel Heinze d531b2e3eb
Added get_latest_model method (#231) 2020-03-15 10:52:00 -07:00
Claus M 58876338ed
added abtest.yml to bootstrapping (#233) 2020-03-12 13:42:53 -07:00
Tom Care e6dbfb1054
Improve Canary guide and add prerequisites (#225) 2020-03-11 09:57:19 -07:00
Tom Care 86c6a1f832
Canary pipeline fixes (#224)
* Add vars template to canary pipeline

* Enable ACR authentication on AKS using a service principal
- Upgrade helm version to 3.1.1
- Remove ACR secret from the abtest-model deployment
2020-03-09 16:10:56 -07:00