85f1ae1463
Bump importlib-resources from 5.4.0 to 5.6.0 ( #2831 )
2022-03-28 18:30:43 +02:00
28f27366ef
Bump jinja2 from 3.0.3 to 3.1.1 ( #2833 )
2022-03-28 09:22:14 -07:00
b229b2e3a5
DVPN-119 - Add ETL for Non-Prod CJMS ( #2823 )
2022-03-25 14:56:11 -07:00
f6a76a7931
Monitor query usage for mozdata
2022-03-25 08:50:18 -07:00
6e72117fb4
Fix typo in view name ( #2824 )
2022-03-24 17:26:49 -07:00
1275170a0d
DVPN-83 - Migrate stripe to fivetran ( #2807 )
2022-03-24 20:18:50 -04:00
af403f2f99
Update stripe billing grace period ( #2821 )
...
for stripe smart retries
2022-03-24 17:06:14 -07:00
3f5bdc478d
Bump mkdocs-material from 8.2.5 to 8.2.6 ( #2819 )
2022-03-24 12:32:47 -04:00
fffc3a28a4
Bump stripe from 2.67.0 to 2.68.0 ( #2818 )
2022-03-24 12:24:38 -04:00
ff40754f49
remove unwanted versions from fenix etl ( #2820 )
2022-03-24 11:49:18 -04:00
78885a77dd
Add experiments field from clients_daily to urlbar_clients_daily ( #2814 )
...
* Add experiments field
* Updated urlbar_clients_daily schema
* Updated tests
Co-authored-by: Jeff Klukas <jklukas@mozilla.com>
Co-authored-by: Alexander Nicholson <anicholson@mozilla.com>
2022-03-23 16:48:16 -04:00
1a3a062639
Bump authlib from 0.15.5 to 1.0.0 ( #2804 )
2022-03-22 13:47:03 -04:00
e5d6bd5c2c
Bump google-cloud-storage from 2.1.0 to 2.2.1 ( #2803 )
2022-03-22 18:39:16 +01:00
c8c9d8e540
Bump pytest-flake8 from 1.1.0 to 1.1.1 ( #2812 )
2022-03-22 10:30:25 -07:00
79f2ffd9c2
Bug 1759019 - Don't drop partitions when shredding whole tables ( #2787 )
2022-03-21 17:25:35 -04:00
c37a152282
Ignore VPN when generating events_unnested ( #2813 )
2022-03-21 14:19:33 -07:00
5ae5299afa
changes to extract probes counts to include total_sample column ( #2781 )
...
* changes to extract probes counts to include total_sample column
* corrected the formatting
* corrected view sample counts
2022-03-21 09:23:04 -04:00
42a074397c
Remove stripe nonprod events schema check ( #2809 )
2022-03-18 21:37:42 -04:00
6f92adba23
DVPN-119 - Add ETL and view for Non-Prod FxA events ( #2799 )
2022-03-18 13:24:56 -07:00
fce0c0a4c3
Fix copypasta in channel_group_proportions view ( #2810 )
2022-03-18 13:12:04 -07:00
38d4261108
Exempt mobile topsites views from dry run ( #2811 )
...
Currently causing CI to fail
2022-03-18 15:16:30 -04:00
3765ae0795
Bump pytest from 7.1.0 to 7.1.1 ( #2808 )
2022-03-18 10:22:11 -07:00
530f82516a
DVPN-83 - Add support for importing stripe discounts ( #2798 )
...
and extract other resource schemas from event schema
2022-03-17 09:48:42 -07:00
8b3224a3f7
DVPN-118 - Delay channel_group_proportions_v1 ( #2802 )
2022-03-17 09:42:33 -07:00
6b0b918cc6
Ignore user count threshold in opmon views
2022-03-15 14:54:29 -07:00
cda79b9831
Exclude partition identifier from sql file path for vpn agg tables ( #2801 )
2022-03-15 13:30:06 -07:00
beaf8af46d
Fix jinja filter for delaying vpn aggregates ( #2800 )
2022-03-15 12:58:15 -07:00
7649d8a50e
DVPN-119 - Configure Non-Prod ETL for stripe ( #2788 )
2022-03-15 10:46:50 -07:00
3e50f1e30c
Bump pytest from 7.0.1 to 7.1.0 ( #2797 )
2022-03-14 14:37:17 -07:00
10144b1959
Bump stripe from 2.66.0 to 2.67.0 ( #2770 )
2022-03-14 21:56:26 +01:00
398c510de8
Bump google-cloud-bigquery from 2.34.0 to 2.34.2 ( #2780 )
2022-03-14 13:49:15 -07:00
ee657d10b9
Bump pytest-flake8 from 1.0.7 to 1.1.0 ( #2779 )
2022-03-14 16:42:16 -04:00
b8671b56b2
Bump pytest-pydocstyle from 2.2.0 to 2.3.0 ( #2789 )
2022-03-14 16:35:08 -04:00
736f464c61
Bump mkdocs-material from 8.2.3 to 8.2.5 ( #2778 )
2022-03-14 13:25:31 -07:00
b8454303e7
Remove unintentional column from vpn aggregates views ( #2794 )
2022-03-14 12:37:11 -07:00
49544b1827
DVPN-118 - Delay VPN aggregates for stability ( #2782 )
2022-03-14 11:12:34 -07:00
09b0e3da21
Fix doc_type versions for distinct_doc_ids queries
2022-03-14 10:42:06 -07:00
fd61bc9735
DVPN-126 - Add promotion_codes to channel_group_proportions_v1 ( #2784 )
2022-03-11 20:19:20 +01:00
09425d3d2c
Adding promotion_codes colum for DVPN-126 ( #2786 )
2022-03-11 11:12:51 -08:00
163831fdf8
Bug 1751979 Revert temporary shredder changes ( #2783 )
...
See https://bugzilla.mozilla.org/show_bug.cgi?id=1751979
All the sanitization is now complete, so this extra code
is no longer needed.
Reverts:
- https://github.com/mozilla/bigquery-etl/pull/2713
- https://github.com/mozilla/bigquery-etl/pull/2718
- https://github.com/mozilla/bigquery-etl/pull/2731
2022-03-11 13:19:06 -05:00
b2b7a330c0
Fix schema for proration_details ( #2777 )
2022-03-04 15:20:22 -08:00
3b7bf2cb1d
Add new stripe invoice field proration_details ( #2776 )
2022-03-04 12:04:09 -08:00
249d2789ff
DVPN-120 - Fix channel group udf call ( #2771 )
2022-03-02 22:37:49 +00:00
a436a574ff
Add agg_type to the sample counts for desktop and glean, remove the extract sample counts query ( #2772 )
...
* added agg_type for sample counts table
* removed the extract sample counts for both dekstop and glean products
* corrected sql formatting
corrected sql formatting
2022-03-02 15:51:20 -05:00
616d2c8e3c
Bug 1753489 Remove ETL for Firefox Reality ( #2767 )
...
* Bug 1753489 Remove ETL for Firefox Reality
Since this product is no longer maintained by Mozilla.
See https://bugzilla.mozilla.org/show_bug.cgi?id=1753489
This is just the first cleanup step. We can remove these datasets and all
content once this PR is merged. But the live/stable tables will require
a separate effort.
2022-03-02 15:03:21 +00:00
db4bd02f61
Fix clients_last_seen joins
2022-03-01 11:58:38 -08:00
5f51a80ae7
Wait even longer for stripe report ( #2766 )
2022-03-01 18:34:16 +00:00
99cf6a7021
Bump mkdocs-material from 8.2.1 to 8.2.3 ( #2756 )
2022-02-28 22:07:18 +00:00
f8601ee2ab
Add view of stripe report with state information ( #2755 )
2022-02-28 21:44:15 +00:00
976d38026c
Fix opmon scalar view dimensions ( #2763 )
2022-02-28 12:49:25 -08:00
dependabot[bot]
Daniel Thorn
Anna Scholtz
Alekhya
Rebecca BurWei
Jeff Klukas
Yeonjoo Yoo