* Remove unnecessary filter
* Remove unnecessary filter
* Remove unnecessary filter
* Remove unnecessary filter
* Remove unnecessary filter
* Remove unnecessary filter
* Add channel to query to make table more usable for others, and update view to be release only so Fx Health dashboard still works as expected
* Add normalized OS to the table to make it more usable for other use cases, and update view to be Windows only so Fx Health dashboard still works as expected
* Update clustering
* feat: add backfill.yaml entries for fenix retention, new_profiles and engagement queries
* feat: add backfill.yaml entries for firefox_ios retention, new_profiles and engagement queries
* feat: add a note to metadata that the new fields are available on firefox ios and fenix starting 2024-03-04
* feat: add shredder_mitigation flag to the new backfills entries, but set it to false also in metadata for now.
* update schema to turn created_at into a TIMESTAMP, add url parameters to designate date for data to be downloaded
* add date functions to get day before and day after of submission_date, add microseconds to date in url params so we can make sure to get all decisions made on a single day
* feat: add backfill.yaml to addons_derived.search_detection_v1
* feat: update shredder mitigation to false to match the backfill entry
* feat: remove amo/prod workgroup for now
* Fix ADM daily aggregates
* Address feedback
* Reformat SQL
* Add mock data for quick_suggest_v1 to fix tests
Also change block IDs to be integers across the board
* Fix expected data
* More fixes to expected data
* Add quick_suggest_ping_type, and a click that should be ignored
* Move quick_suggest_context_id to uuid
* Fix expected data
* Specify ping info fields in event_monitoring_live
* (
Co-authored-by: Sean Rose <1994030+sean-rose@users.noreply.github.com>
---------
Co-authored-by: Sean Rose <1994030+sean-rose@users.noreply.github.com>
* CI check that table exists and is not-empty before applying the shredder-mitigation label.
* Formatting.
* Use schema tables to validate that a table exists and is not empty to handle tables with restricted permissions.
* Change total_rows which is not present in all BigQuery versions.
* Formatting
* Capture Forbidden exception.
* Formatting
* Catch generic exception to fix permission error.
* Formatting
* fix: incorrect user_facing setting for addons_derived
* fix: use hash instead of -- for yaml comment
* Update sql/moz-fx-data-shared-prod/addons_derived/dataset_metadata.yaml
Co-authored-by: Sean Rose <1994030+sean-rose@users.noreply.github.com>
---------
Co-authored-by: Sean Rose <1994030+sean-rose@users.noreply.github.com>
* CI check that table exists and is not-empty before applying the shredder-mitigation label.
* Formatting.
* Use schema tables to validate that a table exists and is not empty to handle tables with restricted permissions.
* Change total_rows which is not present in all BigQuery versions.
* Formatting
* Capture Forbidden exception.
* Formatting
* CI check that table exists and is not-empty before applying the shredder-mitigation label.
* Formatting.
* Use schema tables to validate that a table exists and is not empty to handle tables with restricted permissions.
* Change total_rows which is not present in all BigQuery versions.
* Formatting
* CI check that table exists and is not-empty before applying the shredder-mitigation label.
* Formatting.
* Use schema tables to validate that a table exists and is not empty to handle tables with restricted permissions.
* feat: add addons dataset along with addon_events_clients that can be used for accessing addon event data by the downstream jobs
* feat: add search_detection_v1 aggregate
* feat: add user facing view for accessing the search_detection aggregate
* feat: apply bqetl sql formating
* feat: fix invalid clustering field
* fix: correct source dataset reference
* fix: missing description for the country field
* feat: remove hashed_addon_id alias as is incorrect in this context
* Create monitoring_derived.table_storage_v1
* Change from weekly to daily
* Remove shredder mitigation label from old backfill to fix CI error
* Restore to what it was
Katie Windau
Alekhya
Vanessa Sabino
Ben Wu
kik-kik
Yashika Khurana
dependabot[bot]
Can Berk Güder
Marlene Hirose
Anna Scholtz
Can Berk Güder
Winnie Chan
Gaurang Katre
Lucia
Eduardo Filho
Wil Clouser
Sean Rose