mozilla
/
bigquery-etl
зеркало из https://github.com/mozilla/bigquery-etl.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
bigquery-etl/dags
История
Marlene Hirose bbc685b447
first commit for adjust_cohort data, add cohort job to DAG, update de… (#4100) 
* first commit for adjust_cohort data, add cohort job to DAG, update description of deliverables metadata.yaml

* fix URL construction by getting rid of extraneous ?, add time_spent to CSV fields, separate period_length and period in csv fields, change dates[apps] to period[apps]

* alphabetize tasks in bq_etl_adjust DAG

* add more details to description

* take out extra description as per Circle Ci suggestions

* shorten description of dag

* add view for cohort data, change name of column adjust_kpi_deliverables view

* change date grouping to month, add in the static start date, update column names to cohort_start_month in python and schema files, add in more explicit error messages when checking URL responses

* add error messaging for URL link errors such as unauthorized users, bad links and such
 		2023-07-21 20:24:51 -07:00
..
bqetl_acoustic_contact_export.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_acoustic_raw_recipient_export.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_activity_stream.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_addons.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_adjust.py first commit for adjust_cohort data, add cohort job to DAG, update de… (#4100) 2023-07-21 20:24:51 -07:00
bqetl_amo_stats.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_analytics_aggregations.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_analytics_tables.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_campaign_cost_breakdowns.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_cjms_nonprod.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_core.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_ctxsvc_derived.py [RS-688] Suggest forecasting v1 (#3719) 2023-07-12 14:24:47 -07:00
bqetl_deletion_request_volume.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_desktop_funnel.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_desktop_mobile_search_monthly.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_desktop_platform.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_devtools.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_domain_meta.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_download_funnel_attribution.py Ensure all necessary parameters are passed to DQ checks (#4005) 2023-06-29 13:40:52 -07:00
bqetl_error_aggregates.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_event_rollup.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_experimenter_experiments_import.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_experiments_daily.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_feature_usage.py Split main_1pct (#4022) 2023-07-05 13:00:29 -07:00
bqetl_fenix_event_rollup.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_fenix_external.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_firefox_ios.py updated firefox_ios_derived attributable_clients_v1 and firefox_ios_clients_v1 execution_delta to 3h instead of 1h to fix sensor not working correctly (#4020) 2023-07-05 12:03:26 +02:00
bqetl_fivetran_apple_ads.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_fivetran_copied_tables.py Copy App Store tables from Fivetran (#4030) 2023-07-07 14:24:03 -04:00
bqetl_fivetran_costs.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_fivetran_google_ads.py Expose Ad Group tables (#4097) 2023-07-19 11:09:33 -04:00
bqetl_fog_decision_support.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_fxa_events.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_google_analytics_derived.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_gud.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_internal_tooling.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_internet_outages.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_iprospect.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_main_summary.py [RS-688] Suggest forecasting v1 (#3719) 2023-07-12 14:24:47 -07:00
bqetl_mdn_yari.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_messaging_system.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_mobile_activation.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_mobile_search.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_monitoring.py DENG-1052 Added bigquery_usage_v2 table (#3978) 2023-07-10 09:09:20 -07:00
bqetl_monitoring_airflow.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_mozilla_vpn_site_metrics.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_newtab.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_nondesktop.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_org_mozilla_fenix_derived.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_org_mozilla_firefox_derived.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_org_mozilla_focus_derived.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_pocket.py ETL task for ingesting Pocket event data (#3920) 2023-06-29 09:27:27 -07:00
bqetl_public_data_json.py Replace references of deprecated task_sensor with upstream airflows externaltasksensor (#3447) 2022-12-12 12:20:32 -08:00
bqetl_regrets_reporter_summary.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_release_criteria.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_releases.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_search.py [RS-688] Suggest forecasting v1 (#3719) 2023-07-12 14:24:47 -07:00
bqetl_search_dashboard.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_search_terms_daily.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_sponsored_tiles_clients_daily.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_ssl_ratios.py Pass date partition parameters to check tasks (#4032) 2023-07-07 12:36:38 -07:00
bqetl_status_check.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_subplat.py Move `stripe_subscriptions_changelog_v1` ETL to `stripe_external` dataset (DENG-974) (#4036) 2023-07-11 11:09:53 -07:00
bqetl_unified.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00
bqetl_urlbar.py DENG 946 - Update DAG generation to include ETL checks (#3969) 2023-06-28 13:50:41 -04:00