c25f72e085
Bug 1711880 - Add poucave access to clients_daily ( #2053 )
2021-05-20 15:25:44 -04:00
b10eeaa98a
Deschedule fxa_auth_bounce_events query ( #2052 )
...
See https://github.com/mozilla/bigquery-etl/issues/2051#issuecomment-845362964
2021-05-20 14:42:53 -04:00
6821285456
Bump stripe from 2.56.0 to 2.57.0 ( #2048 )
2021-05-20 16:59:45 +00:00
94dc093070
Bump click from 8.0.0 to 8.0.1 ( #2049 )
2021-05-20 16:51:57 +00:00
1de82baedb
Remove search_engines_clients_sources_last_seen views
...
Turns out that the last_seen table has a different grain compared to the daily
table, so this is partially backing out
https://github.com/mozilla/bigquery-etl/pull/2045
It also clarifies that the last_seen tables here have a year window rather than
a 28-day window.
2021-05-20 11:58:48 -04:00
4f835913a7
DO-500 Rename search_clients_daily
...
See https://jira.mozilla.com/projects/DO/issues/DO-500
`search_clients_daily` becomes `search_clients_engines_sources_daily`
which more accurately represents the data model. We also rename the mobile
equivalent and the related `last_seen` views.
The old views stick around for now. We will need to announce deprecation of the
old views and a timeline for turning them off.
The underlying tables are unchanged. This effort is only about changing the
user interface.
2021-05-20 09:52:39 -04:00
0788f76fe4
Update docs for adding clients_daily fields
2021-05-19 12:51:11 -07:00
3e2e611ce6
Add tests
2021-05-19 12:51:11 -07:00
cd32f756ef
Support multiple derived_from sources
2021-05-19 12:51:11 -07:00
14175f5426
Update all downstream dependencies
2021-05-19 12:51:11 -07:00
8f9e9d5286
Update derived_from schema
2021-05-19 12:51:11 -07:00
2503e05944
Bump jinja2 from 3.0.0 to 3.0.1 ( #2044 )
...
Bumps [jinja2](https://github.com/pallets/jinja ) from 3.0.0 to 3.0.1.
- [Release notes](https://github.com/pallets/jinja/releases )
- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst )
- [Commits](https://github.com/pallets/jinja/compare/3.0.0...3.0.1 )
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-05-19 11:50:53 -07:00
ff42d1bef3
Prefix unnested event fields
2021-05-19 10:11:15 -07:00
9fe639172f
Generate events_unnested views
2021-05-19 10:11:15 -07:00
15de5cc6d8
Temporarily remove glean ios from mobile search ( #2040 )
2021-05-19 08:35:38 -07:00
29e324d397
Add --no-partition option to backfill
2021-05-18 19:18:07 -07:00
091156ef70
Pass project_id to run() when running backfill
2021-05-18 16:22:02 -07:00
2dbddcdbf4
Backfill explicit project
2021-05-18 15:43:16 -07:00
fe97683e70
Optional project_id parameter for is_authenticated
2021-05-18 13:38:24 -07:00
7486920237
Fix inconsistent invocation of bqetl in script ( #2037 )
...
This is causing view deploys to fail with:
> Please run ./bqetl bootstrap
2021-05-18 12:41:59 -07:00
e157599176
Update transitive dependency to fix deploy CI
2021-05-18 11:58:20 -07:00
4443a6e463
Specify output_dir in generate-sql script
...
Co-authored-by: Jeff Klukas <jklukas@mozilla.com>
2021-05-18 11:24:27 -07:00
7c7da24a55
bqetl backfill initialize table if not exist
2021-05-18 11:24:27 -07:00
5eb0ada329
Review feedback
2021-05-18 11:24:27 -07:00
7a3b4f499f
Remove old glean generation scripts
2021-05-18 11:24:27 -07:00
cee749c4ba
Backfill with init option
2021-05-18 11:24:27 -07:00
bc14ec8877
Generate Glean table when creating generated-sql branch
2021-05-18 11:24:27 -07:00
f0500ee01f
Generate cross channel views
2021-05-18 11:24:27 -07:00
1223a70a1f
Add dataset metadata for publicly facing generated glean datasets
2021-05-18 11:24:27 -07:00
9d963b9793
Move glean baseline generation logic to common
2021-05-18 11:24:27 -07:00
98aec7b880
Simplify baseline clients daily generation
2021-05-18 11:24:27 -07:00
6bcca20190
Bump gitpython from 3.1.14 to 3.1.17 ( #2030 )
2021-05-17 17:56:16 +00:00
f3a0bcb91d
Bump google-cloud-bigquery from 2.16.0 to 2.16.1 ( #2031 )
2021-05-17 17:48:05 +00:00
e48271f3cf
Bug 1673976 - Add glean ios search probes to mobile search tables ( #1974 )
2021-05-13 11:47:57 -04:00
df92ad9201
Bump click from 7.1.2 to 8.0.0 ( #2026 )
...
and fix `bqetl dag create`'s `--email` option
2021-05-12 17:16:10 -04:00
d3b4f5f5a8
Bump jinja2 from 2.11.3 to 3.0.0 ( #2025 )
2021-05-12 20:48:15 +00:00
a081bf22b5
Fix typo in mozilla_vpn_derived/all_subscriptions_v1/query.sql ( #2024 )
2021-05-11 20:14:43 -04:00
60ef5bfddc
Add country to paypal subscriptions via FxA logs ( #2023 )
2021-05-11 16:50:12 -07:00
1b01b6ed76
Refactor stripe import to simplify debugging ( #2012 )
2021-05-11 13:04:37 -04:00
8564f60b2a
Add back workgroup_access to clients_last_seen
2021-05-10 15:34:07 -07:00
cad761a7b9
Add glam workgroup access to buildhub2 ( #2019 )
2021-05-10 15:23:25 -07:00
68cac0fbfe
Bump mozilla-schema-generator from 0.1.4 to 0.3.0 ( #2007 )
...
* Bump mozilla-schema-generator from 0.1.4 to 0.3.0
Bumps [mozilla-schema-generator](https://github.com/mozilla/mozilla-schema-generator ) from 0.1.4 to 0.3.0.
- [Release notes](https://github.com/mozilla/mozilla-schema-generator/releases )
- [Commits](https://github.com/mozilla/mozilla-schema-generator/compare/v0.1.4...v0.3.0 )
Signed-off-by: dependabot[bot] <support@github.com>
* Update GleanPing constructor for 0.3 of msg
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Anthony Miyaguchi <amiyaguchi@mozilla.com>
2021-05-10 13:48:07 -04:00
314797aad8
Remove fission experiment monitoring tables ( #2016 )
...
Follow up to https://github.com/mozilla/telemetry-airflow/pull/1300 and https://github.com/mozilla/telemetry-airflow/pull/1301 .
Should be merged after updated aggregation job is validated.
2021-05-10 11:28:23 +02:00
8d9d42576d
Ensure correct directory structure for temporary SQL query files
2021-05-07 12:30:04 -07:00
e1bccb5530
Enable validate-schemas in CI
2021-05-07 12:30:04 -07:00
e30598b395
Update experiment_search_aggregates_v1 schema
2021-05-07 12:30:04 -07:00
4a3c559467
Summary for invalid schemas when validation fails
2021-05-07 12:30:04 -07:00
8a55e8f429
Bump google-cloud-bigquery from 2.15.0 to 2.16.0 ( #2014 )
2021-05-07 17:51:51 +00:00
84fffdee47
Bump attrs from 20.3.0 to 21.2.0 ( #2018 )
2021-05-07 17:42:28 +00:00
f18d19fd5f
Update workflow docs
2021-05-07 10:30:02 -07:00
whd
Jeff Klukas
dependabot[bot]
Jeff Klukas
Anna Scholtz
Ben Wu
Daniel Thorn
Blake Imsland
akkomar