af405c4ce8
Fix yaml format
2024-07-18 11:37:45 -04:00
0494d465dd
Fix the date order
2024-07-18 11:25:29 -04:00
3939cb947f
RS 1091 - Backfill search revenue levers after bug fix
2024-07-18 11:09:36 -04:00
3a29a82243
[RS-1091: client-level DAU] update query to adjust for default engine bugs ( #5937 )
...
* remove old default engine dau, update engaged dau to remove default
* Fix sql format
---------
Co-authored-by: Alekhya Kommasani <akommasani@mozilla.com>
Co-authored-by: Alekhya <88394696+alekhyamoz@users.noreply.github.com>
2024-07-18 10:43:22 -04:00
415c5813b1
GROWTH-90 Fix Grain of New Table - can have multiple rows per client per search engine ( #5940 )
2024-07-18 09:06:37 -05:00
ca2245d3f3
Fix: Keep the 3 GA3 tasks unscheduled but leave parameters information in metadata.yaml ( #5934 )
2024-07-17 17:01:57 -05:00
37f2f44608
Unschedule ga_sessions_v1, ga_clients_v1, and gclid_conversions_v1 from bqetl_mozilla_org_derived since GA3 fe… ( #5933 )
...
* Unschedule ga_sessions_v1 from bqetl_mozilla_org_derived since GA3 feed turned off 2024-06-30
* Unschedule gclid_conversions_v1 since the feed for GA3 stopped on 2025-06-30
* Unschedule ga_clients_v1 since the feed for GA3 turned off on 2024-06-30
2024-07-17 15:46:32 -05:00
2d1bb49b99
Mark the search revenue levers backfill complete ( #5932 )
2024-07-17 16:19:41 -04:00
eb1dd14e59
DENG-4201 Create downloads_with_attribution_v1 and _v2 in shared prod (to prep for removing from mktg prod) ( #5931 )
...
* DENG-4201 create DL w attr v1 and v2 in shared prod
* Update to new paths in shared prod
* DENG-4201 update to v2 version in view.sql
* Update metadata.yaml
* Update metadata.yaml
* Update bqetl_project.yaml
2024-07-17 14:32:06 -05:00
2a83ab1660
GROWTH-90 add depends_on_past = true to metadata.yaml ( #5930 )
2024-07-17 11:56:42 -05:00
b3fe28595f
GROWTH-90 add client_id as a cluster column ( #5927 )
2024-07-17 09:20:46 -05:00
978f26a931
Backfill search_revenue_levers_daily for MBR from 2023-01-01 to 2024-07-16 ( #5926 )
2024-07-17 10:03:37 -04:00
80b55a6473
Update accounts_events sql check ( #5925 )
2024-07-17 09:48:26 +02:00
c4ea3794fb
[RS-1091] Client-level Search DAU ( #5876 )
...
* Update DAU to pull from client-level active users aggregates
* Format sql query
* fix submission_date to param
* Add client-level DAU changes
Fix metadata yaml file
Fix metadata files
---------
Co-authored-by: Alekhya Kommasani <akommasani@mozilla.com>
Co-authored-by: Alekhya <88394696+alekhyamoz@users.noreply.github.com>
2024-07-16 22:34:07 -04:00
9dc8d43f3f
[DENG-3219] Use active_users_aggregates to calculate mau in public data ( #5905 )
2024-07-16 15:22:55 -04:00
7476972796
adding new subscription to map ( #5923 )
2024-07-16 09:04:25 -07:00
4f8ecf8548
Create new firefox_desktop_derived.adclick_history_v1 table and DAG ( #5922 )
2024-07-16 10:47:51 -05:00
ec7dcfb2f4
DENG-3273 Update accounts_events sql check ( #5910 )
...
* DENG-3273 Update accounts_events sql check
* Update checks
2024-07-16 14:22:21 +02:00
628645f8cd
Fix the `create_funnel_regex` UDF's regex for intermediate steps. ( #5915 )
...
Intermediate events and/or event properties may be encoded as newline characters, which the dot expression doesn't match.
2024-07-15 14:24:19 -07:00
237937e5af
[DENG-4268] Add client_id clustering to events stream tables ( #5918 )
2024-07-15 16:41:48 -04:00
8e65702362
DENG-4201 Create blogs_daily_summary_v1 and blogs_landing_page_summary_v1 in shared prod (to prep for removing from mktg prod) ( #5919 )
2024-07-15 14:46:09 -05:00
5dd4c45ab5
chore(data-privacy-mapping): DSRE-1690 - ignore tables contaiing RECORD type ( #5916 )
...
* chore(data-privacy-mapping): DSRE-1690 - ignore event_stream_v1 due to RECORD type
* Revert non workgroup metadata changes
2024-07-15 13:19:07 -04:00
ede864e6d4
DENG-4201 Create www_site_downloads_v1, www_site_events_metrics_v1, www_site_metrics_summary_v1, and www_site_landing_page_metrics_v1 in shared prod ( #5880 )
...
* DENG-4201 add www_site_downloads_v1 to shared prod
* Add more GA3 tables in shared prod to prepare to remove from mktg prod
* DENG-4201 add www_site_page_metrics_v1 to shared prod so we can remove from mktg prd
* DENG-4201 add www_site_metrics_summary_v1 to shared prod so we can remove from mktg prod
* DENG-4201 add backticks around date and switch owner
2024-07-15 07:07:18 -05:00
02832581ba
add desktop ltv udf ( #5906 )
...
* add desktop ltv udf
* format sql
---------
Co-authored-by: Katie Windau <153020235+kwindau@users.noreply.github.com>
2024-07-13 08:22:59 -05:00
83b0b2ed03
Remove the backfill yaml for desktop search aggregates ( #5912 )
2024-07-12 12:09:00 -04:00
0c21cf6eae
Deng 3971 parse campaign names udf ( #5896 )
...
* status quo
* update extract_segments_from_campaign_names to work for more accounts
* refix typo
* bqetl format
2024-07-12 16:27:48 +02:00
3eb3135ea0
chore(data-privacy-mapping): DSRE-1690 - Add dataset_metadata.yaml for monitor datasets ( #5904 )
...
* chore(data-privacy-mapping): DSRE-1690 - Add dataset_metadata.yaml for monitor datasets
* re-add missing dataset_base_acl
2024-07-11 13:13:49 -04:00
83e92f369b
Fix udf_js.gunzip to allow very long inputs ( #5902 )
2024-07-11 10:31:22 -04:00
1811b870fd
fix(glam_export): Update a task dep on task_group that forgot ( #5901 )
2024-07-10 16:16:43 -04:00
718a807212
feat(fxci): add metadata / schemas for new fxci-etl tables ( #5899 )
...
Bug: 1904928
Co-authored-by: akkomar <akkomar@users.noreply.github.com>
2024-07-10 11:02:07 -07:00
64ae537714
Update view.sql to point to prod source ( #5900 )
2024-07-10 10:37:14 -05:00
1a547e5dc7
Backfill desktop search aggregates from 2022-01-01' ( #5897 )
2024-07-09 18:23:18 -04:00
1ccc1b7ac1
RS1247 - Mark the search client level tables backfill as complete ( #5884 )
...
* Mark the search client level tables backfill as complete
* Remove mobile from completion
2024-07-09 16:50:11 -04:00
21949bcb79
Drafting backfill.yaml ( #5891 )
2024-07-09 13:26:14 -05:00
c9dda6e6d9
exchange iniative for initiative ( #5889 )
2024-07-09 19:02:58 +02:00
cdf9564157
Include task group in `TaskRef.task_key` if present. ( #5894 )
...
There could be multiple tasks in a DAG with the same task ID but in different task groups.
2024-07-09 09:05:24 -07:00
2fff9dacde
GLAM update dags to depend on the task group ( #5893 )
2024-07-08 18:54:13 -04:00
1758ea2df7
chore(glam): remove extract to gcs ( #5780 )
2024-07-08 18:39:52 -04:00
a4f1de5ed8
[DENG-4090] Add client_id clustering to telemetry_derived.event_events_v1 ( #5890 )
2024-07-08 14:19:51 -04:00
b0b64b51aa
Bump certifi from 2023.7.22 to 2024.7.4 ( #5888 )
...
Bumps [certifi](https://github.com/certifi/python-certifi ) from 2023.7.22 to 2024.7.4.
- [Commits](https://github.com/certifi/python-certifi/compare/2023.07.22...2024.07.04 )
---
updated-dependencies:
- dependency-name: certifi
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-08 08:34:55 -07:00
782ce3d2cd
Add paid vs organic to engagement and retention views ( #5886 )
...
* add paid vs organic to engagement and retention views
* fix: correct the generation of the paid_vs_organic field
* feat: move paid_vs_organic definition inside client level view
* feat: add paid_vs_organic to aggregate engagement and retention views
* fix: undo accidental change to mobile_kpi_support_metrics union
---------
Co-authored-by: kik-kik <kignasiak@mozilla.com>
2024-07-04 14:24:32 -04:00
03848a2321
DENG-3273 Add check to validate frontend event counts in accounts_events vs events pings ( #5887 )
2024-07-04 18:59:01 +02:00
a1291f5df8
Add snowplow_external dataset ( #5881 )
2024-07-03 20:13:43 +00:00
7d06e5a1cf
Bug 1895503 - Add script to export telemetry data for DSARs ( #5833 )
2024-07-03 19:50:28 +02:00
a09f5179a7
fix: incorrect source in app_store_syndication views and limit the number of syndicated views created to reduce noise ( #5882 )
2024-07-03 11:56:24 +02:00
54341c597f
DENG-4201 create www_site_hits_v1 & firefox_whatsnew_summary_v1 in shared-prod ( #5879 )
...
* DENG-4201 create www_site_hits_v1 in shared-prod
* DENG-4201 add firefox_whatsnew_summary_v1 to shared prod
* DENG-4201 fix schema.yaml
2024-07-02 17:14:24 -05:00
af4355fe03
DENG-4201 - Create blogs_goals_v1 & blogs_sessions_v1 in shared-prod ( #5878 )
...
* DENG-4201 - create new versions in shared prod, later on will remove mktg prod
2024-07-02 15:24:04 -05:00
3f87ec7d96
RS 1247- Backfill search mobile client level table ( #5877 )
2024-07-02 14:19:42 -04:00
16a1d44cf7
GLAM filter out versions above latest ( #5868 )
2024-07-02 12:28:42 -04:00
63e507998e
feat: Convert app_store_external to app_store_syndicate and add web_referrer views ( #5773 )
...
* feat: add corresponding firefox ios web_referrer tables to be copied over to moz-prod
* feat: convert app_store_external to be a syndicate dateset
* fix: correct typo in the description anx syndication configuration.
2024-07-02 12:05:52 +02:00
Alekhya Kommasani
skahmann3
Katie Windau
Alekhya
akkomar
Ben Wu
Chelsey Beck
Sean Rose
Alexander
Leif Oines
Leli
Eduardo Filho
Andrew Halberstadt
Braunk
Sergio E. Betancourt
dependabot[bot]
Vanessa Sabino
whd
kik-kik