Allow field addition for one day of clients_daily and friends (#1468)

* Allow field addition for one day of clients_daily and friends

Allows Airflow to apply https://github.com/mozilla/bigquery-etl/pull/1455

* Commit DAG changes
This commit is contained in:
Jeff Klukas 2020-10-21 13:30:54 -04:00 коммит произвёл GitHub
Родитель 2a1454c309
Коммит 78ea72c5a5
Не найден ключ, соответствующий данной подписи
Идентификатор ключа GPG: 4AEE18F83AFDEB23
4 изменённых файлов: 7 добавлений и 4 удалений

Просмотреть файл

@ -74,6 +74,7 @@ with DAG(
start_date=datetime.datetime(2019, 11, 5, 0, 0),
date_partition_parameter="submission_date",
depends_on_past=False,
allow_field_addition_on_date="2020-10-20",
dag=dag,
)
@ -94,6 +95,7 @@ with DAG(
depends_on_past=True,
parameters=["submission_date:DATE:{{ds}}"],
priority_weight=80,
allow_field_addition_on_date="2020-10-20",
dag=dag,
)
@ -108,6 +110,7 @@ with DAG(
date_partition_parameter="submission_date",
depends_on_past=True,
priority_weight=85,
allow_field_addition_on_date="2020-10-20",
dag=dag,
)

Просмотреть файл

@ -1,8 +1,5 @@
description: 'A daily aggregate of main pings from each Firefox desktop client, partitioned
by day
'
friendly_name: Clients Daily
description: A daily aggregate of main pings from each Firefox desktop client, partitioned by day
labels:
application: firefox
schedule: daily
@ -11,3 +8,4 @@ owners:
scheduling:
dag_name: bqetl_main_summary
start_date: '2019-11-05'
allow_field_addition_on_date: '2020-10-20'

Просмотреть файл

@ -12,6 +12,7 @@ labels:
scheduling:
dag_name: bqetl_main_summary
start_date: '2020-05-05'
allow_field_addition_on_date: '2020-10-20'
priority: 80
depends_on_past: true
# This query updates the entire existing table every day rather than appending

Просмотреть файл

@ -11,5 +11,6 @@ scheduling:
dag_name: bqetl_main_summary
priority: 85
start_date: '2019-04-15'
allow_field_addition_on_date: '2020-10-20'
email: ['dthorn@mozilla.com', 'jklukas@mozilla.com']
depends_on_past: true