bigquery-etl/pytest.ini

[pytest]
addopts =
    --strict-markers
    --ignore-glob=tests/sql/glam-fenix-dev/glam_etl/*/data.py
    --ignore-glob=tests/sql/glam-fenix-dev/glam_etl/*.py
filterwarnings =
# upstream lib imports ABC improperly for backward compatibility
    ignore::DeprecationWarning:google.protobuf.descriptor
    ignore::DeprecationWarning:google.protobuf.internal.well_known_types
# Silence: "Your application has authenticated using end user credentials from Google Cloud SDK"
    ignore::UserWarning:google.auth
markers =
    integration: mark tests that check integration with external services. Skipped when not specifically enabled.
norecursedirs =
    venv
    script/legacy
testpaths =
    bigquery_etl
    tests
    # todo: make this more generic to support other projects
    sql/moz-fx-data-shared-prod/udf
    sql/moz-fx-data-shared-prod/udf_js
    sql/mozfun
    script
    sql/bigquery-etl-integration-test
Add first test (#9) 2019-03-07 23:43:21 +03:00			`[pytest]`
Add minimal set of tests for GLAM Fenix queries (#1488) * Add script to determine query dependencies * Add schemas and folders for minimal test * Add schema for geckoview_versions * Add query params to each query * Update schema for new queries * Remove main from bootstrap file * Add dataset prefix to schemas * Add failing test for clients_histogram_aggregates It turns out that the dependency resolution I'm using for autogenerate the schemas is ignoring the views. I actually want to keep the views around. The tables also all need to be prefixed with the dataset name or they won't be inserted into the sql query correctly. * Add successful test for clients histogram aggregates * Add minimal tests for clients_scalar_aggregates * Remove skeleton files for views (no test support for views) * Add tests for latest versions * Add tests for scalar bucket counts that passes * Add scalar bucket counts * Add test for scalar percentiles * Add test for histogram bucket counts * Add passing test for probe counts * Add test for histogram percentiles * Add tests for extract counts * Update readme * Add data for scalar percentiles test * Fix linting errors * Fix mypy issues with tests module * Name it data instead of tests..data Ignore mypy on tests directory * Remove mypy section * Remove extra line in pytest * Try pytest invocation of mypy-scripts-are-modules * Run mypy outside of pytest * Use exec on pytest instead of mypy * Update tests/sql/glam-fenix-dev/glam_etl/bootstrap.py Co-authored-by: Ben Wu <benjaminwu124@gmail.com> * Update tests/sql/glam-fenix-dev/glam_etl/README.md Co-authored-by: Ben Wu <benjaminwu124@gmail.com> * Document bootstrap in documentation * Use artificial range for histogram_percentiles * Simplify parameters for scalar probe counts * Simplify tests for histogram probe counts * Add test for incremental histogram aggregates * Update scalar percentile counts to count distinct client ids * Update readme for creating a new test * Use unorded list for sublist * Use --ignore-glob for pytest to avoid data files Co-authored-by: Ben Wu <benjaminwu124@gmail.com> 2020-12-02 04:11:45 +03:00			`addopts =`
			`--strict-markers`
			`--ignore-glob=tests/sql/glam-fenix-dev/glam_etl/*/data.py`
			`--ignore-glob=tests/sql/glam-fenix-dev/glam_etl/*.py`
Add first test (#9) 2019-03-07 23:43:21 +03:00			`filterwarnings =`
			`# upstream lib imports ABC improperly for backward compatibility`
Create and publish docker image (#95) * Create and publish docker image * Update config.yml 2019-04-19 19:19:36 +03:00			`ignore::DeprecationWarning:google.protobuf.descriptor`
			`ignore::DeprecationWarning:google.protobuf.internal.well_known_types`
Add support for testing queries with persistent UDFs (#285) 2019-08-06 00:14:19 +03:00			`# Silence: "Your application has authenticated using end user credentials from Google Cloud SDK"`
			`ignore::UserWarning:google.auth`
update dependencies (#994) also fix unregistered marker warnings also fix new lint errors 2020-05-21 01:55:17 +03:00			`markers =`
Use zetasql to find sql dependencies (#1802) 2021-02-17 22:48:40 +03:00			`integration: mark tests that check integration with external services. Skipped when not specifically enabled.`
Add athena query migration script for posterity (#592) * Add athena query migration script for posterity * Add legacy athena migration script to pytest exclusions 2019-12-13 01:55:02 +03:00			`norecursedirs =`
			`venv`
Upgrade to pytest 6.0.1 (#1281) Also upgrade and fix pytest plugins 2020-09-02 21:30:14 +03:00			`script/legacy`
Improve pytest failure output for udf and sql tests (#391) * Improve pytest failure output for udf and sql tests * address review 2019-10-01 22:48:22 +03:00			`testpaths =`
Add pytest plugins to lint python scripts (#410) * Add pytest plugins to lint python scripts * Fix lint errors 2019-10-09 00:00:11 +03:00			`bigquery_etl`
Improve pytest failure output for udf and sql tests (#391) * Improve pytest failure output for udf and sql tests * address review 2019-10-01 22:48:22 +03:00			`tests`
Update DAGs 2020-09-30 23:00:57 +03:00			`# todo: make this more generic to support other projects`
			`sql/moz-fx-data-shared-prod/udf`
			`sql/moz-fx-data-shared-prod/udf_js`
			`sql/mozfun`
Add pytest plugins to lint python scripts (#410) * Add pytest plugins to lint python scripts * Fix lint errors 2019-10-09 00:00:11 +03:00			`script`
Add bigquery-etl-integration-test to testpath (#5976) 2024-07-30 20:16:18 +03:00			`sql/bigquery-etl-integration-test`