Allow field addition for one day of clients_daily and friends (#1468)
* Allow field addition for one day of clients_daily and friends Allows Airflow to apply https://github.com/mozilla/bigquery-etl/pull/1455 * Commit DAG changes
This commit is contained in:
Родитель
2a1454c309
Коммит
78ea72c5a5
|
@ -74,6 +74,7 @@ with DAG(
|
|||
start_date=datetime.datetime(2019, 11, 5, 0, 0),
|
||||
date_partition_parameter="submission_date",
|
||||
depends_on_past=False,
|
||||
allow_field_addition_on_date="2020-10-20",
|
||||
dag=dag,
|
||||
)
|
||||
|
||||
|
@ -94,6 +95,7 @@ with DAG(
|
|||
depends_on_past=True,
|
||||
parameters=["submission_date:DATE:{{ds}}"],
|
||||
priority_weight=80,
|
||||
allow_field_addition_on_date="2020-10-20",
|
||||
dag=dag,
|
||||
)
|
||||
|
||||
|
@ -108,6 +110,7 @@ with DAG(
|
|||
date_partition_parameter="submission_date",
|
||||
depends_on_past=True,
|
||||
priority_weight=85,
|
||||
allow_field_addition_on_date="2020-10-20",
|
||||
dag=dag,
|
||||
)
|
||||
|
||||
|
|
|
@ -1,8 +1,5 @@
|
|||
description: 'A daily aggregate of main pings from each Firefox desktop client, partitioned
|
||||
by day
|
||||
|
||||
'
|
||||
friendly_name: Clients Daily
|
||||
description: A daily aggregate of main pings from each Firefox desktop client, partitioned by day
|
||||
labels:
|
||||
application: firefox
|
||||
schedule: daily
|
||||
|
@ -11,3 +8,4 @@ owners:
|
|||
scheduling:
|
||||
dag_name: bqetl_main_summary
|
||||
start_date: '2019-11-05'
|
||||
allow_field_addition_on_date: '2020-10-20'
|
||||
|
|
|
@ -12,6 +12,7 @@ labels:
|
|||
scheduling:
|
||||
dag_name: bqetl_main_summary
|
||||
start_date: '2020-05-05'
|
||||
allow_field_addition_on_date: '2020-10-20'
|
||||
priority: 80
|
||||
depends_on_past: true
|
||||
# This query updates the entire existing table every day rather than appending
|
||||
|
|
|
@ -11,5 +11,6 @@ scheduling:
|
|||
dag_name: bqetl_main_summary
|
||||
priority: 85
|
||||
start_date: '2019-04-15'
|
||||
allow_field_addition_on_date: '2020-10-20'
|
||||
email: ['dthorn@mozilla.com', 'jklukas@mozilla.com']
|
||||
depends_on_past: true
|
||||
|
|
Загрузка…
Ссылка в новой задаче