telemetry-airflow/.gitignore

*.pyc
*.retry
*undo-tree~
*.un~
venv/
.venv/

logs
unittests.cfg
airflow-webserver.pid
airflow-worker.pid
.config
.viminfo
.credentials
.bash_history
.mysql_history

/dags/bigquery-etl-dags
/dags/bigquery-etl-dags/*

*~

.cache

# IDE
.idea
.vscode/
Add a git ignore file. 2016-06-29 18:07:48 +03:00			`*.pyc`
			`*.retry`
EMR release version should be configurable As we want to support multiple versions of Spark we have to allow users to configure the EMR release they want their tasks to run in. 2016-09-15 15:54:03 +03:00			`*undo-tree~`
			`*.un~`
fix(backfill): fix BackfillParams import issues (#1587) * fix(backfill): fix BackfillParams import issues 2022-11-18 00:11:16 +03:00			`venv/`
			`.venv/`
Features/gcp taar amodump (#628) * Added gitignore directives for artifacts left by tests and staging the airflow instance locally * Converted the taar_lite_guidguid job to use SubDagOperator and moz_dataproc_pyspark_runner. Converted AMO jobs to use GKEPodOperator * deleted broken connection stub for `google_cloud_derived_datasets` * changed job to use temp bucket while testing whole DAG * Downsampled the taar-lite GUID GUID job to 5% * swapped test gcs location for pyspark job with production location 2019-10-10 22:49:31 +03:00
			`logs`
			`unittests.cfg`
Upgrade airflow WTMO to 1.10.12 2020-10-28 23:51:15 +03:00			`airflow-webserver.pid`
[DSRE-6] Upgrade Airflow (wtmo) to 2.1.1 2021-10-13 03:29:13 +03:00			`airflow-worker.pid`
Features/gcp taar amodump (#628) * Added gitignore directives for artifacts left by tests and staging the airflow instance locally * Converted the taar_lite_guidguid job to use SubDagOperator and moz_dataproc_pyspark_runner. Converted AMO jobs to use GKEPodOperator * deleted broken connection stub for `google_cloud_derived_datasets` * changed job to use temp bucket while testing whole DAG * Downsampled the taar-lite GUID GUID job to 5% * swapped test gcs location for pyspark job with production location 2019-10-10 22:49:31 +03:00			`.config`
Step to validate airflow dags as part of CI (#1446) * script to validate dag tags and step to circle ci * trying out dag tagg validation through parsing * added missing tag so that tag check does not fail * Using SQL approach for validation, added extra logging and clean up * added check to make sure all DAGs have tags * fixed 3 DAGs missing tags * implemented suggestions by @haroldwoo in #1446 Co-authored-by: = <=> 2022-01-14 15:04:32 +03:00			`.viminfo`
Upgrade airflow WTMO to 1.10.12 2020-10-28 23:51:15 +03:00			`.credentials`
Step to validate airflow dags as part of CI (#1446) * script to validate dag tags and step to circle ci * trying out dag tagg validation through parsing * added missing tag so that tag check does not fail * Using SQL approach for validation, added extra logging and clean up * added check to make sure all DAGs have tags * fixed 3 DAGs missing tags * implemented suggestions by @haroldwoo in #1446 Co-authored-by: = <=> 2022-01-14 15:04:32 +03:00			`.bash_history`
			`.mysql_history`
Fixing Backfill ui plugin 2020-03-29 03:39:14 +03:00
Removes bqetl_* dags. We will sync these to our airflow deployment from github bigquery-etl/dags and symlink them to dags/bigquery-etl-dags 2020-07-28 21:55:06 +03:00			`/dags/bigquery-etl-dags`
			`/dags/bigquery-etl-dags/*`

Fixing Backfill ui plugin 2020-03-29 03:39:14 +03:00			`*~`
feat: Adds Airflow DAG for running some of the DIM checks (#1583) * Add data monitoring dag * made final tweaks to the data_monitoring DAG * made changes as requested by @alekhyamoz in PR#1583 Co-authored-by: Alekhya Kommasani <akommasani@mozilla.com> 2022-11-15 15:06:51 +03:00
			`.cache`

fix(backfill): fix BackfillParams import issues (#1587) * fix(backfill): fix BackfillParams import issues 2022-11-18 00:11:16 +03:00			`# IDE`
			`.idea`
			`.vscode/`