* Add topic selection fields to newtab_visits
* Remove duplicate from schema
* Add new metric to test schema
* Fix event name in test yaml
* Test yaml fix
* Add visit id to test case
---------
Co-authored-by: Chelsey Beck <64881557+chelseybeck@users.noreply.github.com>
* Add is_sap_monetizable to aggregates table
* Fix tests
* add is_acer_cohort
* Add normalized_default_search_engine column for mobile and desktop
* Fix test cases
* Remove percentiles
* Remove tests that test percentiles
* Refresh scripts insert null to new percentiles
* Remove percentile columns from queries and schemas
* Delete more percentile tables
* Formatting
* histogram_cast_struct's keys are strings
* Re-add test after fixing failure cause
* DENG-4201 remove blogs_goals_v1 since now in shared prod
* DENG-4201 remove blogs_sessions_v1 from mktg prod since now in shared prod
* DENG-4201 remove www_site_hits_v1 from mktg prod since now in shared prod
* DENG-4201 remove firefox_whatsnew_summary_v1 from mktg prod since now in shared prod
* DENG-4201 remove www_site_downloads_v1 from mktg prod since now in shared prod
* DENG-4201 remove www_site_events_metrics_v1 from mktg prod since now moved to shared prod
* DENG-4201 remove www_site_landing_page_metrics_v1 from mktg prod since now moved to shared prod
* DENG-4201 remove www_site_page_metrics_v1 from mktg prod since now moved to shared prod
* DENG-4201 remove blogs_daily_summary_v1 from mktg prod since now moved to shared prod
* DENG-4201 remove blogs_landing_page_summary_v1 from mktg prod since now moved to shared prod
* DENG-4201 remove blogs_empty_check_v1
* DENG-4201 remove www_site_empty_check_v1
* DENG-4201 remove www_site_metrics_summary_v1 from mktg prod since now moved to shared prod
* DENG-4201 remove dl with attr v1 and v2 from mktg prod since now in shared prod instead
* DENG-4201 remove tests from mktg prod since tables no longer live in mktg prod
* Add fully-qualified identifiers when formatting queries
* Fully-qualified identifiers for queries in sql/
* Check in only formatted SQL to generated-sql branch
* Add comment
* Fully qualify more tables
* Fully qualify test files
* Formatting improvements around CTEs and unit tests
* Option to skip auto qualifying queries
* RS 959 - Add OS breakouts
* Add mobile OS breakouts
Add mobile OS breakouts
* Add mobile OS breakouts
* Add tests for desktop
* Add mobile tests
* Fix tests
* Fix CI issue
* updates to mobile_search_aggregates and search_revenue_levers_table
adding search_with_ads_organic to mobile_search_aggregates and search_revenue_levers_table
* Update query.sql
* Fix schema.yaml and test files
* Fix CI issue
Fix CI issue
---------
Co-authored-by: Alekhya Kommasani <akommasani@mozilla.com>
Co-authored-by: Alekhya <88394696+alekhyamoz@users.noreply.github.com>
* feat: update firefox_android_clients_v1 to pull distribution_id only from the baseline ping
* feat: update firefox_android_clients_v1 baseline test schema to include distribution_id
* fix: resolve distribution_id not in baseline error
---------
Co-authored-by: Katie Windau <153020235+kwindau@users.noreply.github.com>
* removing acoustic last engaged timestamp
* removing suppression list model and tests
* removing dependency until frequency is increased
* formatting
* formatting
* adding organic searches with ads to this table
* updating mobile_search_aggregates table with search_with_ads_organic column
* updating the search revenue lever table
- include search_with_ads_organic columns for Bing, Google and DDG
* Fix CI issues
* Fix tests CI failure
* fix tests
* Fix test sql failure
* Update query.sql
reverting back to original code for search_revenue_levers table
---------
Co-authored-by: Alekhya Kommasani <akommasani@mozilla.com>
Co-authored-by: Alekhya <88394696+alekhyamoz@users.noreply.github.com>
* Add mobile suggest to event_aggregates and event_aggregates_suggest
* Rename test files
* Update expected values
* Fix tests
* Omit null values from expect.yaml
* updating source table and adding column
* updating tests to add new field
* changing to use updated_at
* formatting
---------
Co-authored-by: Leli <33942105+lelilia@users.noreply.github.com>
* changing structure of payload and structuring timestamps
* updating time filter and standardizing
* adding changed subscriptions model and updating time filter
* moving udf to separate pr and changing source table
* adding comments and moving max to timestamps
* filtering out mofo users and fxa_account_deleted true"
* updating filter on tables to pull most recent and adding acoustic event data
* formatting and refactoring
* formatting
* updating format and adding comments
* removing time filter
* fix alias
* reverting waitlists code back to original
* add lower() to waitlists platform and source
* ading inner join to users
* fix test_braze_subscriptions
* fix test_braze_waitlists
* DENG-3658 braze add unit test for users_v1
* add more tests
* only show users with active braze subscriptions
* reformat query
---------
Co-authored-by: Chelsey Beck <cbeck@mozilla.com>
Co-authored-by: Chelsey Beck <64881557+chelseybeck@users.noreply.github.com>
* Update description, partitioning and clustering setting for fenix_derived.firefox_android_clients_v1
* making sure _previous only includes entries older than the submission_date
* adding back parameter settings
* Update sql/moz-fx-data-shared-prod/fenix_derived/firefox_android_clients_v1/metadata.yaml
Co-authored-by: Lucia <30448600+lucia-vargas-a@users.noreply.github.com>
* feat: remove sample_id from clustering
* feat: use first_seen_date as filter when retrieving previous records. This has no impact as first_seen_date is the same as submission_date
---------
Co-authored-by: Lucia <30448600+lucia-vargas-a@users.noreply.github.com>
* changing structure of payload and structuring timestamps
* updating time filter and standardizing
* adding changed subscriptions model and updating time filter
* moving udf to separate pr and changing source table
* adding comments and moving max to timestamps
* filtering out mofo users and fxa_account_deleted true"
* updating filter on tables to pull most recent and adding acoustic event data
* formatting and refactoring
* formatting
* updating format and adding comments
* removing time filter
* fix alias
* reverting waitlists code back to original
* add lower() to waitlists platform and source
* ading inner join to users
* fix test_braze_subscriptions
* fix test_braze_waitlists
---------
Co-authored-by: Leli Schiestl <lschiestl@mozilla.com>
* status quo
* fix tests
* reformat query
* renaming to add v:
* add lower() to braze countries
* adding type
* updating field name
* updating user attributes payload within array to be _v1
* adding newsletter check
* updating snapshot to correct name
* formatting sql
* adding product checks
* adding subscriptions checks
* fixing schema
* removing checks for now and updating snapshot metadata
* updating interval
---------
Co-authored-by: Leli Schiestl <lschiestl@mozilla.com>
Katie Windau
Anna Scholtz
Alekhya
Chelsey Beck
m-d-bowerman
Eduardo Filho
Curtis Morales
Preethi Issac
kik-kik
Leli