9a8df1ff15
Exclude `monitor_backend` Glean app from baseline ping checks. ( #5857 )
...
The `monitor_backend` app won't have any baseline pings.
2024-06-27 11:48:28 -07:00
57bd939905
Fully qualified identifiers in SQL queries ( #5764 )
...
* Add fully-qualified identifiers when formatting queries
* Fully-qualified identifiers for queries in sql/
* Check in only formatted SQL to generated-sql branch
* Add comment
* Fully qualify more tables
* Fully qualify test files
* Formatting improvements around CTEs and unit tests
* Option to skip auto qualifying queries
2024-06-27 09:53:33 -07:00
b5cab3fc3d
Fix glam_percentile udf ( #5854 )
2024-06-27 11:28:27 -04:00
efc6aaced3
Add normalized_app_name_os to mobile search aggregate table ( #5850 )
...
* Add normalized_app_name_os to mobile search aggregate table
* Fix CI
Fix CI
2024-06-27 10:58:46 -04:00
66d1c7aaf6
Bug 1901844 - Skip ads_backend in glean_usage generator ( #5832 )
2024-06-27 13:05:01 +02:00
cc64f376f0
Upgrade `google-auth` package to v2.30.0. ( #5852 )
...
To try to fix "Compute Engine Metadata server call to universe/universe_domain returned 404" errors.
2024-06-26 15:59:58 -07:00
b606d8b6ea
feat: add checks to mobile_kpi generator engagement and retention queries ( #5751 )
2024-06-26 23:08:11 +02:00
62414d7dc2
DENG-2492 Deprecate GA3 tables since GA3 feed ending 2024-06-30 ( #5848 )
2024-06-26 14:39:04 -05:00
7b2dd6a35f
Backfill mobile search daily counts table for 2 months ( #5846 )
...
FIX CI
2024-06-26 14:10:54 -04:00
b768992316
fix sql udf cast_json breaking w string keys ( #5845 )
2024-06-26 13:39:38 -04:00
99ffb65f60
Explicitly specify dag_id in CI for artifact deployment ( #5847 )
2024-06-26 09:48:42 -07:00
992a15e2fe
[Bug 1903788] Update checks for reference_browser_derived.baseline_clients_last_seen_v1 ( #5842 )
2024-06-26 08:55:37 -07:00
180f98619e
Fix histogram_cast_json udf ( #5844 )
2024-06-25 22:37:44 -04:00
790fab531e
delete extraneous print statements which were used for testing ( #5843 )
2024-06-25 16:20:41 -07:00
beeaa258b9
Fix schema search daily desktop ( #5840 )
...
* Fix schema.yaml for desktop search clients daily
* Fix schema.yaml for desktop search clients daily table
2024-06-25 17:19:38 -04:00
601e3047f2
Add new columns to www_site_hits_v2 & www_site_downloads_v2 ( #5839 )
...
* Add new columns to www_site_hits_v2
* Add new cols to www_site_downloads_v2
* Remove comments
* Update column descriptions to clarify which are CTS vs TS
2024-06-25 15:54:20 -05:00
9150fa879d
Fix schema search daily desktop ( #5838 )
...
* Backfilling 2 recent months of search_daily_client_v8 (desktop)
* Fix schema.yaml for desktop search clients daily
2024-06-25 16:12:10 -04:00
d38ef1f1ad
Backfilling 2 recent months of search_daily_client_v8 (desktop) ( #5837 )
...
* Backfilling 2 recent months of search_daily_client_v8 (desktop)
* Fix CI issue
2024-06-25 14:09:08 -04:00
a665903516
add in sleep timers in case of no data, refactor app_conversions_v1 script to deal with null dates. ( #5834 )
2024-06-25 10:09:29 -07:00
8bc0017b99
Remove dev_telemetry_derived dataset ( #5835 )
2024-06-25 13:05:33 -03:00
f021be1665
GLAM rewrite JS UDFs in SQL ( #5697 )
...
* GLAM - Rewrite JS UDFs in SQL
* formatting
* fix percentile udf
* Fix histogram_cast_json
* Reformat
* Fix generate_scalar_buckets
2024-06-25 11:24:19 -04:00
7935a6b52a
DENG-3273 Add check to validate backend event counts in accounts_events vs events pings ( #5831 )
2024-06-25 11:25:54 +02:00
37791da059
RS 959 - Add OS breakouts ( #5767 )
...
* RS 959 - Add OS breakouts
* Add mobile OS breakouts
Add mobile OS breakouts
* Add mobile OS breakouts
* Add tests for desktop
* Add mobile tests
* Fix tests
* Fix CI issue
2024-06-24 21:48:08 -04:00
9671061e08
[Bug 1904423] Support ohttp for generated app views ( #5829 )
2024-06-24 14:01:03 -07:00
aceb898d64
fix friendly name. This is Conversions, not acquisitions ( #5828 )
2024-06-24 09:05:15 -07:00
f4cd607e8e
DENG-3096 reduce timeouts ( #5827 )
2024-06-24 08:41:42 -05:00
d5422b049f
Move Google Search Console ETLs & views to `moz-fx-data-shared-prod` (DENG-1733) ( #5822 )
...
* Move Google Search Console ETLs & views to `moz-fx-data-shared-prod`.
* Temporarily add back Google Search Console views in `moz-fx-data-marketing-prod` to avoid breaking existing reporting.
* Update Google Search Console ETL entries in dry-run skip config.
* Temporarily add pass-through views in `moz-fx-data-marketing-prod` in place of Google Search Console ETL tables to avoid breaking existing reporting.
2024-06-21 11:49:42 -07:00
5a909de4ba
Try to fully specify `metrics` fields to select in Glean union views ( #5800 )
...
* Try to fully specify `metrics` fields to select in Glean union views to avoid problems when the underlying table/view schemas change due to new metrics being added, unless the generated SQL exceeds the character limit.
* Make use of `bq_dataset_family` channel app property in `GleanAppPingViews.generate_per_app()`.
* Satisfy flake8 and pydocstyle in `sql_generators/glean_usage/glean_app_ping_views.py`.
---------
Co-authored-by: Ben Wu <12437227+BenWu@users.noreply.github.com>
2024-06-21 10:52:24 -07:00
b64c845782
Revert "Fix initialize logic for materialized views ( #5640 )" ( #5826 )
...
This reverts commit 9552136dca
2024-06-21 09:25:11 -07:00
92a8dba70e
Have CI run SQL generation if files in `sql/` were renamed. ( #5823 )
2024-06-21 09:03:25 -07:00
149d3881e4
DENG-3096 fix data type in errors table ( #5825 )
2024-06-21 10:26:08 -05:00
624d8b4f6a
fix(fxci): Normalize 'resource.name' in fxci_derived.worker_costs_v1 ( #5809 )
...
It seems that the `resource.name` field from the billing export can
sometimes take the form:
projects/<id>/instances/<name>
And other times it's simply:
<name>
Update the worker costs query to account for this.
Issue: #5759
Co-authored-by: akkomar <akkomar@users.noreply.github.com>
2024-06-21 16:43:21 +02:00
72557a99ad
CODEOWNERS: add correct active user aggregates sql generation prefix ( #5821 )
...
Co-authored-by: Lucia <30448600+lucia-vargas-a@users.noreply.github.com>
2024-06-21 13:46:34 +02:00
1dd59f4d73
DENG-2407 Fix: Use flow_id string metric for accounts event flow monitoring ( #5824 )
2024-06-21 13:06:07 +02:00
6c52d395b8
Minor Google Search Console revisions (DENG-1733) ( #5820 )
...
* Add "foxfire" as a Firefox brand keyword for Google Search Console.
* Correct `localized_site` column description.
2024-06-20 16:17:41 -07:00
6cac504285
DENG-3096 cloudflare - minor updates ( #5818 )
...
* DENG-3096 fix config fpath
* Fix errors fpath
* Update precondition to None and update configs
* Fix typo - should be end_dt, not strt_dt
2024-06-20 16:14:36 -05:00
19c3f02e1b
Gclid Conversions - update time offset ( #5814 )
2024-06-20 12:54:48 -05:00
11d53b120b
add 'v1' suffix to microsoft table names ( #5816 )
2024-06-20 10:09:06 -07:00
9552136dca
Fix initialize logic for materialized views ( #5640 )
2024-06-20 09:44:20 -07:00
80dc78673f
GROWTH-143 add mozilla confidential work group ( #5815 )
2024-06-20 11:26:45 -05:00
25dbe88aaa
DENG-2407 Fix: Use flow_id string metric for accounts event flow monitoring ( #5813 )
2024-06-20 16:21:24 +02:00
79127d0681
GROWTH-143 add census permissions ( #5811 )
2024-06-20 08:09:03 -05:00
2b219f5a55
DENG-2407 Use flow_id string metric for accounts event flow monitoring ( #5812 )
2024-06-20 13:03:39 +02:00
fdb8161d29
GROWTH-143 add 3 new conversion events ( #5810 )
2024-06-19 18:57:02 -05:00
51f98709b4
Remove uri_count and active_hours from all the active_users_aggregates views. Stop updating active_users_aggregates_v1. Separate the scheduled update of Desktop and Mobile. ( #5808 )
2024-06-19 14:30:03 -04:00
1cbbf4fabb
DENG-3096 rename column name ( #5807 )
2024-06-19 12:48:17 -05:00
81bd103bff
take out args.app_list which is not used, add in json.loads of environment variable ( #5806 )
2024-06-19 10:05:33 -07:00
fe03b842f2
DENG-2407 Use standard event pings for accounts in event monitoring queries ( #5801 )
2024-06-19 17:32:45 +02:00
c368b28e21
DENG-3096 Cloudflare ( #5803 )
...
* DENG-3096 - cloudflare - remove line of code not doing anything
* DENG-3096 clean up names from copy/paste
* DENG-3096 fix data type in OS usage DAG
* DENG-3096 remove unnecessary cast
---------
Co-authored-by: Marlene Hirose <92952117+Marlene-M-Hirose@users.noreply.github.com>
2024-06-19 07:24:44 -05:00
162d1f949b
take out 'microsoft' from table name. ( #5805 )
...
* take out 'microsoft' from table name.
* take out 'microsoft' from installs and conversions
2024-06-18 20:04:28 -07:00
Sean Rose
Anna Scholtz
Eduardo Filho
Alekhya
akkomar
kik-kik
Katie Windau
Marlene Hirose
Andrew Halberstadt
whd
Lucia