* Init SQL for event_types_v1
* Fix comparison of differently-sized lists
* Add support for tests of init stmts
* Include metadata for event_types_v1
* Add tests for event_types init
* Reformat SQL
* Run black
* Skip invalid unicode sections in event_code_points_to_string
* Allow for init-only queries
* Partition events_daily_v1 by submission-date
This is not strictly required, but will aid in
debugging and reruns.
* Add assertion for not null
* Lint
* Alias events ping name
* Ignore time_ms event property
Airflow's publishing of mozfun definitions failed last night due to
https://github.com/mozilla/bigquery-etl/pull/1287
Long-term we should enforce that mozfun function definitions don't directly
reference mozfun.
See https://github.com/mozilla/bigquery-etl/pull/1250 for proposed logic of how
to parse a date from the 10-digit format, but this change should be reliable
for the specific case of determining whether we are before or after the
2020-07-03 epoch where naming of apps and channels changed.
This will affect GLAM and GUD.
Reverts https://github.com/mozilla/bigquery-etl/pull/1249
I will plan to run a backfill for GUD on the same day I merge this, and then
communicate out the change to data users, since channel breakdowns in GUD
will change for Fenix and Firefox Preview.
* Add `clients_last_seen.days_any_interaction_bits`.
This column is a 28-day bit array containing whether the client has any active ticks (thus nonzero active hours) associated with each of the last 28 submission dates.
* Change column name.
Follow the grammatical pattern for these column names, as pointed out by @jklukas.
* Update tests
* Reconcile order to satisfy IF
Co-authored-by: Jeff Klukas <jklukas@mozilla.com>
* Fix writing to temporary table when publishing JSON
* Update test_script_incremental_query test
* Ensure temporary artifacts are deleted
* Wrap deletion of artifacts into try finally block
Frank Bertsch
Anna Scholtz
Ben Miroglio
Jeff Klukas
Jeff Klukas
dependabot[bot]
Felix Lawrence
Daniel Thorn