bigquery-etl/udf
Frank Bertsch 5a17168e63
Create events daily rollup (#1296)
* Create events daily rollup

This takes the most recent days' data, rolls up the events,
and encodes them as unicode.

Add tests for android events daily

* Remove unecessary file

* Use map.mode_last

* Reformat sql

* Fix experiment aggregation

* Address review feedback

* Fix submission_date

* Git proper alias to events table
2020-09-10 17:48:31 -04:00
..
active_n_weeks_ago Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
active_values_from_days_seen_map Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
add_monthly_engine_searches Reformat UDFs 2020-09-02 10:24:38 -07:00
add_monthly_searches Reformat UDFs 2020-09-02 10:24:38 -07:00
add_searches_by_index Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
aggregate_active_addons Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
aggregate_map_first Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
aggregate_search_counts Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
aggregate_search_map Reformat UDFs 2020-09-02 10:24:38 -07:00
array_11_zeroes_then Reformat UDFs 2020-09-02 10:24:38 -07:00
array_drop_first_and_append Reformat UDFs 2020-09-02 10:24:38 -07:00
array_of_12_zeroes Reformat UDFs 2020-09-02 10:24:38 -07:00
array_slice Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
bitcount_lowest_7 Reformat UDFs 2020-09-02 10:24:38 -07:00
bitmask_365 Reformat UDFs 2020-09-02 10:24:38 -07:00
bitmask_lowest_7 Reformat UDFs 2020-09-02 10:24:38 -07:00
bitmask_lowest_28 Reformat UDFs 2020-09-02 10:24:38 -07:00
bitmask_range Reformat UDFs 2020-09-02 10:24:38 -07:00
bits28_active_in_range Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
bits28_days_since_seen Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
bits28_from_string Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
bits28_range Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
bits28_retention Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
bits28_to_dates Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
bits28_to_string Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
bits_to_active_n_weeks_ago Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
bits_to_days_seen Reformat UDFs 2020-09-02 10:24:38 -07:00
bits_to_days_since_first_seen Reformat UDFs 2020-09-02 10:24:38 -07:00
bits_to_days_since_seen Reformat UDFs 2020-09-02 10:24:38 -07:00
bool_to_365_bits Reformat UDFs 2020-09-02 10:24:38 -07:00
boolean_histogram_to_boolean Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
coalesce_adjacent_days_28_bits Reformat UDFs 2020-09-02 10:24:38 -07:00
coalesce_adjacent_days_365_bits Reformat UDFs 2020-09-02 10:24:38 -07:00
combine_adjacent_days_28_bits Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
combine_adjacent_days_365_bits Reformat UDFs 2020-09-02 10:24:38 -07:00
combine_days_seen_maps Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
combine_experiment_days Reformat UDFs 2020-09-02 10:24:38 -07:00
country_code_to_flag Reformat UDFs 2020-09-02 10:24:38 -07:00
days_seen_bytes_to_rfm Reformat UDFs 2020-09-02 10:24:38 -07:00
days_since_created_profile_as_28_bits Reformat UDFs 2020-09-02 10:24:38 -07:00
deanonymize_event Reformat UDFs 2020-09-02 10:24:38 -07:00
decode_int64 Reformat UDFs 2020-09-02 10:24:38 -07:00
dedupe_array Reformat UDFs 2020-09-02 10:24:38 -07:00
event_code_points_to_string Android event types init (#1289) 2020-09-10 12:12:56 -04:00
extract_count_histogram_value Reformat UDFs 2020-09-02 10:24:38 -07:00
extract_document_type Reformat UDFs 2020-09-02 10:24:38 -07:00
extract_document_version Reformat UDFs 2020-09-02 10:24:38 -07:00
extract_histogram_sum Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
extract_schema_validation_path Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
fenix_build_to_datetime Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
geo_struct Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
get_key Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
get_key_with_null Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
glean_timespan_nanos Reformat UDFs 2020-09-02 10:24:38 -07:00
glean_timespan_seconds Reformat UDFs 2020-09-02 10:24:38 -07:00
gzip_length_footer Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
histogram_max_key_with_nonzero_value Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
histogram_merge Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
histogram_normalize Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
histogram_percentiles Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
histogram_to_mean Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
histogram_to_threshold_count Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
hmac_sha256 Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
int_to_365_bits Reformat UDFs 2020-09-02 10:24:38 -07:00
int_to_hex_string Reformat UDFs 2020-09-02 10:24:38 -07:00
json_extract_histogram Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
json_extract_int_map Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
json_mode_last Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
keyed_histogram_get_sum Reformat UDFs 2020-09-02 10:24:38 -07:00
kv_array_append_to_json_string Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
kv_array_to_json_string Reformat UDFs 2020-09-02 10:24:38 -07:00
main_summary_scalars Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
map_bing_revenue_country_to_country_code Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
map_mode_last Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
map_revenue_country Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
map_sum Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
merge_scalar_user_data Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
mod_uint128 Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
mode_last Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
mode_last_retain_nulls Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
new_monthly_engine_searches_struct Reformat UDFs 2020-09-02 10:24:38 -07:00
normalize_fenix_metrics Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
normalize_glean_baseline_client_info Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
normalize_glean_ping_info Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
normalize_main_payload Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
normalize_metadata Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
normalize_monthly_searches Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
normalize_os Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
normalize_search_engine Reformat UDFs 2020-09-02 10:24:38 -07:00
null_if_empty_list Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
one_as_365_bits Reformat UDFs 2020-09-02 10:24:38 -07:00
pack_event_properties Create events daily rollup (#1296) 2020-09-10 17:48:31 -04:00
parquet_array_sum Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
parse_desktop_telemetry_uri Reformat UDFs 2020-09-02 10:24:38 -07:00
parse_iso8601_date Reformat UDFs 2020-09-02 10:24:38 -07:00
pos_of_leading_set_bit Reformat UDFs 2020-09-02 10:24:38 -07:00
pos_of_trailing_set_bit Reformat UDFs 2020-09-02 10:24:38 -07:00
quantile_search_metric_contribution Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
round_timestamp_to_minute Reformat UDFs 2020-09-02 10:24:38 -07:00
safe_crc32_uuid Prefix test data UDFs with test_ 2020-09-02 10:24:38 -07:00
safe_sample_id Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
shift_28_bits_one_day Reformat UDFs 2020-09-02 10:24:38 -07:00
shift_365_bits_one_day Reformat UDFs 2020-09-02 10:24:38 -07:00
shift_one_day Migrate UDFs to new format 2020-09-02 10:24:38 -07:00
smoot_usage_from_28_bits Reformat UDFs 2020-09-02 10:24:38 -07:00
vector_add Reformat UDFs 2020-09-02 10:24:38 -07:00
zero_as_365_bits Reformat UDFs 2020-09-02 10:24:38 -07:00
zeroed_array Reformat UDFs 2020-09-02 10:24:38 -07:00