Chenhui/add CI tests for notebooks

Former-commit-id: 47c6ac5f6f
This commit is contained in:
Ubuntu 2020-03-24 03:24:48 +00:00
Родитель 3eca65c20e
Коммит 2866b95a25
31 изменённых файлов: 1076 добавлений и 974 удалений

Различия файлов скрыты, потому что одна или несколько строк слишком длинны

Различия файлов скрыты, потому что одна или несколько строк слишком длинны

Различия файлов скрыты, потому что одна или несколько строк слишком длинны

Различия файлов скрыты, потому что одна или несколько строк слишком длинны

Просмотреть файл

@ -20,7 +20,7 @@ Note that the week number starts from 40 in this dataset, while the full Dominic
The following summarizes each directory of the forecasting examples.
| Directory | Content | Description |
| --- | --- | --- |
|--------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| [python](./python) | [00_quick_start/](./python/00_quick_start) <br>[01_prepare_data/](./python/01_prepare_data) <br> [02_model/](./python/02_model) <br> [03_model_tune_deploy/](./python/03_model_tune_deploy/) | <ul> <li> Quick start examples for single-round training </li> <li> Data exploration and preparation notebooks </li> <li> Multi-round training examples </li> <li> Model tuning and deployment example </li> </ul> |
| [R](./R) | [01_dataprep.Rmd](R/01_dataprep.Rmd) <br> [02_basic_models.Rmd](R/02_basic_models.Rmd) <br> [02a_reg_models.Rmd](R/02a_reg_models.Rmd) <br> [02b_prophet_models.Rmd](R/02b_prophet_models.Rmd) | <ul> <li>Data preparation</li> <li>Basic time series models</li> <li>ARIMA-regression models</li> <li>Prophet models</li> </ul> |

Просмотреть файл

@ -8,7 +8,7 @@ This folder contains Jupyter notebooks with Python examples for building forecas
The following summarizes each directory of the Python best practice notebooks.
| Directory | Content | Description |
| --- | --- | --- |
|-------------------------------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| [00_quick_start](./00_quick_start) | [autoarima_single_round.ipynb](./00_quick_start/autoarima_single_round.ipynb) <br>[azure_automl_single_round.ipynb](./00_quick_start/azure_automl_single_round.ipynb) <br> [lightgbm_single_round.ipynb](./00_quick_start/lightgbm_single_round.ipynb) | Quick start notebooks that demonstrate workflow of developing a forecasting model using one-round training and testing data |
| [01_prepare_data](./01_prepare_data) | [ojdata_exploration.ipynb](./01_prepare_data/ojdata_exploration.ipynb) <br> [ojdata_preparation.ipynb](./01_prepare_data/ojdata_preparation.ipynb) | Data exploration and preparation notebooks |
| [02_model](./02_model) | [dilatedcnn_multi_round.ipynb](./02_model/dilatedcnn_multi_round.ipynb) <br> [lightgbm_multi_round.ipynb](./02_model/lightgbm_multi_round.ipynb) <br> [autoarima_multi_round.ipynb](./02_model/autoarima_multi_round.ipynb) | Deep dive notebooks that perform multi-round training and testing of various classical and deep learning forecast algorithms |

Просмотреть файл

@ -1,31 +0,0 @@
# Pull request against these branches will trigger this build
#pr:
#- staging
#- master
# Any commit to these branches will trigger the build.
#trigger:
#- staging
#- master
pool:
name: ForecastingBP
vmImage: "forecastingtestmachine"
steps:
- bash: |
echo "##vso[task.prependpath]/data/anaconda/bin"
displayName: Add conda to PATH
- bash: |
. /anaconda/etc/profile.d/conda.sh && \
conda activate forecasting_base && \
pytest tests/python/unit -m "not notebooks and not spark and not gpu" --junitxml=reports/python-unit-tests-base.xml && \
conda deactivate
displayName: "Run unit tests"
- task: PublishTestResults@2
inputs:
testResultsFiles: "reports/python-unit-tests-base.xml"
testRunTitle: "Test results of unit tests"

Просмотреть файл

@ -1,31 +0,0 @@
# Pull request against these branches will trigger this build
#pr:
#- staging
#- master
# Any commit to these branches will trigger the build.
#trigger:
#- staging
#- master
pool:
name: ForecastingBP
vmImage: 'forecastingtestmachine'
steps:
- bash: |
echo "##vso[task.prependpath]/data/anaconda/bin"
displayName: Add conda to PATH
- bash: |
. /anaconda/etc/profile.d/conda.sh && \
conda activate forecasting_base && \
Rscript tests/unit/source_entire.R -m "not notebooks and not spark and not gpu" --junitxml=reports/test-unit.xml && \
conda deactivate
displayName: 'Run R unit tests'
- task: PublishTestResults@2
inputs:
testResultsFiles: '**/test-unitttest.xml'
testRunTitle: 'Test results for R Unit Tests'

Просмотреть файл

@ -1,3 +1,6 @@
# Copyright (c) Microsoft Corporation.
# Licensed under the MIT License.
import os
import pytest
from fclib.common.utils import git_repo_path