* add sean

* add anna

* add chelsey

* add frank
This commit is contained in:
Leli 2024-09-13 20:02:33 +02:00 коммит произвёл GitHub
Родитель ce267f6209
Коммит e2f89e0373
Не найден ключ, соответствующий данной подписи
Идентификатор ключа GPG: B5690EEEBB952194
43 изменённых файлов: 63 добавлений и 65 удалений

Просмотреть файл

@ -791,9 +791,9 @@ bqetl_acoustic_contact_export:
fivetran_acoustic_contact_export
DAG to clean up the data loaded from Acoustic.
default_args:
owner: leli@mozilla.com
owner: cbeck@mozilla.com
start_date: "2024-04-03"
email: ["telemetry-alerts@mozilla.com", "leli@mozilla.com"]
email: ["telemetry-alerts@mozilla.com", "cbeck@mozilla.com"]
retries: 1
retry_delay: 5m
tags:
@ -806,9 +806,9 @@ bqetl_acoustic_raw_recipient_export:
fivetran_acoustic_raw_recipient_export
DAG to clean up the data loaded from Acoustic.
default_args:
owner: leli@mozilla.com
owner: cbeck@mozilla.com
start_date: "2024-04-03"
email: ["telemetry-alerts@mozilla.com", "leli@mozilla.com"]
email: ["telemetry-alerts@mozilla.com", "cbeck@mozilla.com"]
retries: 1
retry_delay: 5m
tags:
@ -1017,11 +1017,11 @@ bqetl_fivetran_costs:
depends_on_past: false
email:
- telemetry-alerts@mozilla.com
- lschiestl@mozilla.com
- srose@mozilla.com
email_on_failure: true
email_on_retry: true
end_date: null
owner: lschiestl@mozilla.com
owner: srose@mozilla.com
retries: 2
retry_delay: 30m
start_date: '2023-01-18'
@ -1419,17 +1419,16 @@ bqetl_telemetry_dev_cycle:
depends_on_past: false
email:
- telemetry-alerts@mozilla.com
- leli@mozilla.com
- ascholtz@mozilla.com
email_on_failure: true
email_on_retry: false
end_date: null
owner: leli@mozilla.com
owner: ascholtz@mozilla.com
retries: 2
retry_delay: 30m
start_date: '2023-12-19'
description: |
DAG for Telemetry Dev Cycle Dashboard
Airflow Triage Note:
The tables are build every day so only the last run needs to be successful.
repo: bigquery-etl
@ -1513,9 +1512,9 @@ bqetl_acoustic_suppression_list:
description: |
ETL for Acoustic suppression list.
default_args:
owner: leli@mozilla.com
owner: cbeck@mozilla.com
email:
- leli@mozilla.com
- cbeck@mozilla.com
start_date: '2024-04-03'
retries: 1
retry_delay: 30m
@ -1524,7 +1523,6 @@ bqetl_acoustic_suppression_list:
bqetl_braze:
schedule_interval: 0 5,13,21 * * *
description: |
ETL for Braze workflows.
## Triage notes:
@ -1547,9 +1545,9 @@ bqetl_braze_currents:
description: |
Load Braze current data from GCS into BigQuery
default_args:
owner: leli@mozilla.com
owner: cbeck@mozilla.com
email:
- leli@mozilla.com
- cbeck@mozilla.com
start_date: '2024-04-15'
retries: 1
retry_delay: 30m
@ -1561,9 +1559,9 @@ bqetl_marketing_suppression_list:
description: |
Ingest marketing suppression lists into BigQuery
default_args:
owner: leli@mozilla.com
owner: cbeck@mozilla.com
email:
- leli@mozilla.com
- cbeck@mozilla.com
start_date: '2024-04-21'
retries: 1
retry_delay: 30m

Просмотреть файл

@ -8,7 +8,7 @@ description: >
Jira: https://mozilla-hub.atlassian.net/browse/DENG-17
Moved from moz-fx-data-marketing-prod to moz-fx-data-shared-prod in https://mozilla-hub.atlassian.net/browse/DENG-3287
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false

Просмотреть файл

@ -14,7 +14,7 @@ labels:
incremental: true
owners:
- leli@mozilla.com
- cbeck@mozilla.com
scheduling:
dag_name: bqetl_acoustic_contact_export

Просмотреть файл

@ -15,7 +15,7 @@ labels:
incremental: true
owners:
- leli@mozilla.com
- cbeck@mozilla.com
scheduling:
dag_name: bqetl_acoustic_raw_recipient_export

Просмотреть файл

@ -16,7 +16,7 @@ labels:
incremental: true
owners:
- leli@mozilla.com
- cbeck@mozilla.com
scheduling:
dag_name: bqetl_acoustic_contact_export

Просмотреть файл

@ -20,7 +20,7 @@ labels:
incremental: true
owners:
- leli@mozilla.com
- cbeck@mozilla.com
scheduling:
dag_name: bqetl_acoustic_raw_recipient_export

Просмотреть файл

@ -4,7 +4,7 @@ description: >
The suppression list was pruned in April 2024 -- https://mozilla-hub.atlassian.net/browse/CTMS-163
Moved from moz-fx-data-marketing-prod to moz-fx-data-shared-prod in https://mozilla-hub.atlassian.net/browse/DENG-3287
owners:
- leli@mozilla.com
- cbeck@mozilla.com
scheduling:
dag_name: bqetl_acoustic_suppression_list
date_partition_parameter: null

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -4,7 +4,7 @@ description: |-
Braze sends data in currents to GCS. These tables are build from those files.
The tables are rebuild every day.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -2,7 +2,7 @@ friendly_name: Daily Connector Costs
description: |-
Daily Costs per Fivetran Connector
owners:
- lschiestl@mozilla.com
- srose@mozilla.com
labels: {}
scheduling:
dag_name: bqetl_fivetran_costs

Просмотреть файл

@ -2,7 +2,7 @@ friendly_name: Destinations
description: |-
Destinations Table for Fivetran Costs.
owners:
- lschiestl@mozilla.com
- srose@mozilla.com
labels: {}
scheduling:
dag_name: bqetl_fivetran_costs

Просмотреть файл

@ -2,7 +2,7 @@ friendly_name: Incremental MAR
description: |-
Incremental MAR (monthly active rows) populated from Fivetran logs
owners:
- lschiestl@mozilla.com
- srose@mozilla.com
labels: {}
scheduling:
dag_name: bqetl_fivetran_costs

Просмотреть файл

@ -2,7 +2,7 @@ friendly_name: Monthly Costs
description: |-
Monthly Cost for fivetran connectors. Before September 2022 the costs are given in credits, after in USD. populated from Fivetran Logs
owners:
- lschiestl@mozilla.com
- srose@mozilla.com
labels: {}
scheduling:
dag_name: bqetl_fivetran_costs

Просмотреть файл

@ -2,7 +2,7 @@ friendly_name: Accounts
description: |-
Account information for different Google Ads accounts
owners:
- lschiestl@mozilla.com
- frank@mozilla.com
labels: {}
scheduling:
scheduling:

Просмотреть файл

@ -3,7 +3,7 @@ description: |-
Main Suppression List for Marketing Suppression List.
This is a List of email addresses that should not be sent marketing emails.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -3,7 +3,7 @@ description: |-
This python script gets the suppression list from Campaign Monitor via their API.
The data then gets stored into BigQuery.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: false
owner1: leli

Просмотреть файл

@ -3,7 +3,7 @@ description: |-
This python script gets the table new_suppression_list_entries_for_mofo_v1 and uploads the result to the Campaign Monitor API.
Emails that are malformed and cannot be uploaded to Campaign Monitor due to not being real emails will be added to the table.
owners:
- leli@mozilla.com
- cbeck@mozilla.com
labels:
incremental: true
owner1: leli

Просмотреть файл

@ -2,10 +2,10 @@ friendly_name: Firefox Major Release Dates
description: |-
Dates for major firefox releases in release, beta and nightly
owners:
- leli@mozilla.com
- ascholtz@mozilla.com
labels:
incremental: false
owner1: leli@mozilla.com
owner1: ascholtz@mozilla.com
scheduling:
dag_name: bqetl_telemetry_dev_cycle
date_partition_parameter: null

Просмотреть файл

@ -2,10 +2,10 @@ friendly_name: Glean Metrics Dates
description: |-
Dates for glean metrics to be released and expired for Telemetry Dev Cycle Dashboard.
owners:
- leli@mozilla.com
- ascholtz@mozilla.com
labels:
incremental: false
owner1: leli@mozilla.com
owner1: ascholtz@mozilla.com
scheduling:
dag_name: bqetl_telemetry_dev_cycle
date_partition_parameter: null

Просмотреть файл

@ -2,10 +2,10 @@ friendly_name: Telemetry Probes
description: |-
Dates for telemetry probes to be released and expired for Telemetry Dev Cycle Dashboard.
owners:
- leli@mozilla.com
- ascholtz@mozilla.com
labels:
incremental: false
owner1: leli@mozilla.com
owner1: ascholtz@mozilla.com
scheduling:
dag_name: bqetl_telemetry_dev_cycle
date_partition_parameter: null

Просмотреть файл

@ -3,10 +3,10 @@ description: |-
This table represents data downloaded from bugzilla API https://bugzilla.mozilla.org/rest/bug
The downloaded data is cleaned and only data relevant for the telemetry dev cycle dashboard is stored here.
owners:
- leli@mozilla.com
- ascholtz@mozilla.com
labels:
incremental: false
owner1: leli@mozilla.com
owner1: ascholtz@mozilla.com
scheduling:
dag_name: bqetl_telemetry_dev_cycle
date_partition_parameter: null

Просмотреть файл

@ -4,10 +4,10 @@ description: |-
compared with config files downloaded from https://github.com/mozilla/metric-hub/tree/main/jetstream
The downloaded data is cleaned and only data relevant for the telemetry dev cycle dashboard is stored here.
owners:
- leli@mozilla.com
- ascholtz@mozilla.com
labels:
incremental: false
owner1: leli@mozilla.com
owner1: ascholtz@mozilla.com
scheduling:
dag_name: bqetl_telemetry_dev_cycle
date_partition_parameter: null

Просмотреть файл

@ -3,10 +3,10 @@ description: |-
This table represents data downloaded from https://probeinfo.telemetry.mozilla.org/glean/{glean_app}/metric.
The downloaded data is cleaned and only data relevant for the telemetry dev cycle dashboard is stored here.
owners:
- leli@mozilla.com
- ascholtz@mozilla.com
labels:
incremental: false
owner1: leli@mozilla.com
owner1: ascholtz@mozilla.com
scheduling:
dag_name: bqetl_telemetry_dev_cycle
date_partition_parameter: null

Просмотреть файл

@ -3,10 +3,10 @@ description: |-
This table represents data downloaded from https://probeinfo.teletemetry.mozilla.org/firefox/{channel}/main/all_probes.
The downloaded data is cleaned and only data relevant for the telemetry dev cycle dashboard is stored here.
owners:
- leli@mozilla.com
- ascholtz@mozilla.com
labels:
incremental: false
owner1: leli@mozilla.com
owner1: ascholtz@mozilla.com
scheduling:
dag_name: bqetl_telemetry_dev_cycle
date_partition_parameter: null