* updated fxa nonprod/staging queries to be in line with what production queries look like
* Apply suggestions from code review provided by srose
Co-authored-by: Sean Rose <1994030+sean-rose@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Sean Rose <1994030+sean-rose@users.noreply.github.com>
* tweaks made as suggested by srose in PR#4297
---------
Co-authored-by: Sean Rose <1994030+sean-rose@users.noreply.github.com>
* introducing fxa_log_device_command_events_v2 to pull relevant logs from GCP log table
* updated the bqetl_fxa_events DAG
* correcting the source table
* added fxa_log_device_command_events_v2 to dry run skip list due to the source table permissions issue and added date filters to incidcate tiemframes for which events are included in both tables
* Update sql/moz-fx-data-shared-prod/firefox_accounts_derived/fxa_log_device_command_events_v2/query.sql
Co-authored-by: akkomar <akkomar@users.noreply.github.com>
* made changes as suggested by srose in PR#4308
---------
Co-authored-by: akkomar <akkomar@users.noreply.github.com>
* Add `stripe_customers_revised_changelog_v1` ETL.
* Add `stripe_customers_history_v1` ETL.
* Replace `stripe_external.pre_fivetran_customers` with `stripe_external.pre_fivetran_customer`.
It's almost exactly the same, except it also has a `created` column.
* Rename `stripe_external.pre_fivetran_customer` to `pre_fivetran_customers_v1`.
* Include customers deleted before the initial Fivetran Stripe sync in `stripe_customers_revised_changelog_v1`.
* Include customer data in `stripe_subscriptions_history_v2`.
* glam: Partition clients_histogram_aggregates by sample_id (has been running like this since April 3 from a different branch)
* glam: Non normalized aggregations to legacy histograms
* glam: add non-normalized aggs to probe counts extract
* glam: add init.sql to relevant tbls for non-norm aggs
* glam: ignore dryrun histogram_percentiles
* glam: add description and eol to init
* glam: Partition clients_histogram_aggregates by sample_id (has been running like this since April 3 from a different branch)
* glam: Non normalized aggregations to legacy histograms
* glam: add non-normalized aggs to probe counts extract
* glam: add init.sql to relevant tbls for non-norm aggs
* glam: ignore dryrun histogram_percentiles
* glam: add description and eol to init
* fix schema files
* fix clients_histogram_probe_counts schema
* remove another init.sql
* fix dryrun ignore order
* fix table name
* change dryrun ignore order to try avoiding fenix for being on path
* another change in dryrun
* Move glam queries from dryrun to bqetl_project.yaml to ignore
* add tbl deps on tests
* Add DE for mobile
* Format query
* Update sql/moz-fx-data-shared-prod/contextual_services_derived/adm_forecasting_v1/query.sql
Co-authored-by: skahmann3 <16420065+skahmann3@users.noreply.github.com>
* Fix two typos
* Suggest has no new markets
* Fix merge error and reformat
* Update & separate suggest forecasting from Tiles
* Less filters
Don't need all the filters in the back half of this query since they're already employed in the source table
* Update to focus on funnel metrics
- I manually renamed the files from "suggest_forecasting" to "suggest_revenue_levers_daily" so hopefully that won't break anything.
- Since this is being used for funnel analysis, there are multiple ratios built using two other variables in the table. We could drop the ratios if storage costs are a concern, I've kept them since I prefer the convenience of having the ratios ready to go.
* Removed ratios
Think better to define ratios in Looker (since then can more easily change the definitions) than to set in BQ which is harder to change/ may require backfill.
Note for DE: schema command doesn't work for me, so may need to be run manually
* add schema.yaml and scheduling to metadata.yaml
* correct the view name
* add suggest revenue to skip dry run
* correct dag generation
* Add changes to bqetl_search.py dag
---------
Co-authored-by: Curtis Morales <cmorales@mozilla.com>
Co-authored-by: Alekhya Kommasani <akommasani@mozilla.com>
Co-authored-by: Alekhya <88394696+alekhyamoz@users.noreply.github.com>
* Move `stripe_subscriptions_changelog_v1` ETL to `stripe_external` dataset.
* Include all subscription metadata in `stripe_external.subscriptions_changelog_v1`.
kik-kik
akkomar
Sean Rose
Eduardo Filho
Frank Bertsch
Rebecca BurWei
Anna Scholtz
skahmann3
Leli