Azure
/
azureml-assets
зеркало из https://github.com/Azure/azureml-assets.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность

remove python 3.8 and fix ci test (#3339) 

* remove python 3.8

* update pipelines

* update numpy

* update

* update requirements

* change

* test

* test

* test

* check

* change path

* revert

* try v4

* version

* test

* try fix

* try ls

* try

* add hidden files

* fix

* try fix model performance
This commit is contained in:
yuacheng35 2024-09-10 09:58:12 -07:00 коммит произвёл GitHub
Родитель 5fe73c673e
Коммит 8e1a300a20
Не найден ключ, соответствующий данной подписи
Идентификатор ключа GPG: B5690EEEBB952194
24 изменённых файлов: 14 добавлений и 31 удалений
Показать статистику Скачать Patch файл Скачать Diff файл Показать все файлы Свернуть все файлы

13
.github/workflows/model-monitoring-ci.yml поставляемый
Просмотреть файл

@ -43,10 +43,10 @@ jobs:
uses: Azure/azureml-assets/.github/actions/clone-repo@main
with:
forked-pr: ${{ needs.check-execution-context.outputs.forked_pr }}
- name: Use Python 3.8
- name: Use Python 3.9
uses: actions/setup-python@v4
with:
python-version: '3.8'
python-version: '3.9'
- name: Install dependencies
run: pip install -r ${{ env.testsRootPath }}/requirements.txt
- name: Log in to Azure and create resources
@ -64,11 +64,12 @@ jobs:
RESOURCE_GROUP: ${{ env.resource_group }}
WORKSPACE_NAME: ${{ env.workspace }}
- name: Upload component Version artifact
uses: actions/upload-artifact@v3
uses: actions/upload-artifact@v4
if: always()
with:
name: ${{ env.pytest_component_version_folder }}
path: ${{ env.pytest_component_version_file }}
include-hidden-files: true
run-momo-tests:
name: Run Monitoring Component Tests
@ -85,14 +86,14 @@ jobs:
forked-pr: ${{ needs.check-execution-context.outputs.forked_pr }}
- name: Download component version
id: download-version
uses: actions/download-artifact@v3
uses: actions/download-artifact@v4
with:
name: ${{ env.pytest_component_version_folder }}
path: ./
- name: Use Python 3.8
- name: Use Python 3.9
uses: actions/setup-python@v4
with:
python-version: '3.8'
python-version: '3.9'
- name: Log in to Azure and create resources
uses: ./.github/actions/create-azure-resources
with:

4
.github/workflows/model-monitoring-gsq-ci.yml поставляемый
Просмотреть файл

@ -41,10 +41,10 @@ jobs:
uses: Azure/azureml-assets/.github/actions/clone-repo@main
with:
forked-pr: ${{ needs.check-execution-context.outputs.forked_pr }}
- name: Use Python 3.8
- name: Use Python 3.9
uses: actions/setup-python@v4
with:
python-version: '3.8'
python-version: '3.9'
- name: Install fusepy
run: sudo apt-get install -y fuse

1
assets/model_monitoring/components/data_drift/data_drift_compute_metrics/spec.yaml
Просмотреть файл

@ -62,7 +62,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/data_quality/data_quality_compute_metrics/spec.yaml
Просмотреть файл

@ -52,7 +52,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/data_quality/data_quality_metrics_joiner/spec.yaml
Просмотреть файл

@ -41,7 +41,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/data_quality/data_quality_statistics/spec.yaml
Просмотреть файл

@ -40,7 +40,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/feature_attribution_drift/feature_attribution_drift_compute_metrics/spec.yaml
Просмотреть файл

@ -39,7 +39,6 @@ conf:
- defaults
- anaconda
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/feature_attribution_drift/feature_importance_metrics/spec.yaml
Просмотреть файл

@ -46,7 +46,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/genai_token_statistics/genai_token_statistics_compute_metrics/spec.yaml
Просмотреть файл

@ -40,7 +40,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/generation_safety_quality/input_schema_adaptor/spec.yaml
Просмотреть файл

@ -31,7 +31,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/model_monitor/genai_mdc_preprocessor/spec.yaml
Просмотреть файл

@ -44,7 +44,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/model_monitor/model_data_collector_preprocessor/spec.yaml
Просмотреть файл

@ -41,7 +41,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/model_monitor/model_monitor_azmon_metric_publisher/spec.yaml
Просмотреть файл

@ -45,7 +45,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/model_monitor/model_monitor_compute_histogram/spec.yaml
Просмотреть файл

@ -43,7 +43,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/model_monitor/model_monitor_compute_histogram_buckets/spec.yaml
Просмотреть файл

@ -44,7 +44,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/model_monitor/model_monitor_create_manifest/spec.yaml
Просмотреть файл

@ -70,7 +70,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/model_monitor/model_monitor_data_joiner/spec.yaml
Просмотреть файл

@ -41,7 +41,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/model_monitor/model_monitor_evaluate_metrics_threshold/spec.yaml
Просмотреть файл

@ -35,7 +35,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/model_monitor/model_monitor_feature_selector/spec.yaml
Просмотреть файл

@ -46,7 +46,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/model_monitor/model_monitor_metric_outputter/spec.yaml
Просмотреть файл

@ -46,7 +46,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

1
assets/model_monitoring/components/model_monitor/model_monitor_output_metrics/spec.yaml
Просмотреть файл

@ -54,7 +54,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0

2
assets/model_monitoring/components/model_performance/model_performance_compute_metrics/spec.yaml
Просмотреть файл

@ -65,7 +65,6 @@ conf:
channels:
- defaults
dependencies:
- python=3.8
- pip:
- azure-storage-file-datalake~=12.8.0
- azure-ai-ml~=1.13.0
@ -73,6 +72,7 @@ conf:
- azureml-fsspec~=1.0.0
- fsspec~=2023.4.0
- azureml-metrics[tabular]~=0.0.42
- setuptools[core]
name: momo-base-spark
args: >-
--task ${{inputs.task}}

2
assets/model_monitoring/components/tests/e2e/utils/test_publish_components_for_ci.py
Просмотреть файл

@ -15,4 +15,4 @@ class TestPublishComponentsForCI():
def test_publish_components(self, upload_component_version_file, cleanup_previous_e2e_tests):
"""Init calls fixture to publish components."""
pass
assert os.path.exists('.version_upload')

5
assets/model_monitoring/components/tests/requirements.txt
Просмотреть файл

@ -5,7 +5,7 @@ azureml-fsspec~=1.0.0
azureml-mlflow~=1.49.0
fsspec~=2023.4.0
mltable~=1.3.0
numpy~=1.19.0
numpy~=1.23.4
pandas~=1.4.3
pyspark
pytest~=7.2.1
@ -16,4 +16,5 @@ scipy~=1.10.0
pytest-xdist
pytest-split
pyspark-test~=0.2.0
azureml-metrics[tabular]~=0.0.42
azureml-metrics[tabular]~=0.0.42
setuptools[core]