70a355a0dd
Require authentication for dry run function and run gcloud auth when … ( #5171 )
...
* Require authentication for dry run function and run gcloud auth when not logged in
* authenticate step in CI, remove interactive gcloud auth
* Skip dryrun for ltv_state_values_v2
* Refactor skip_fork in CI, clarify login requirements
2024-03-06 15:06:29 -08:00
b2997d932e
Bump pytest-isort from 3.1.0 to 4.0.0 ( #5172 )
...
Bumps [pytest-isort](https://github.com/stephrdev/pytest-isort ) from 3.1.0 to 4.0.0.
- [Changelog](https://github.com/stephrdev/pytest-isort/blob/master/CHANGELOG.rst )
- [Commits](https://github.com/stephrdev/pytest-isort/compare/3.1.0...4.0.0 )
---
updated-dependencies:
- dependency-name: pytest-isort
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-06 08:56:32 -08:00
2fcbaaf89e
Bump mozilla-metric-config-parser from 2023.11.1 to 2024.3.1 ( #5173 )
...
Bumps [mozilla-metric-config-parser](https://github.com/mozilla/metric-config-parser ) from 2023.11.1 to 2024.3.1.
- [Release notes](https://github.com/mozilla/metric-config-parser/releases )
- [Commits](https://github.com/mozilla/metric-config-parser/compare/2023.11.1...2024.3.1 )
---
updated-dependencies:
- dependency-name: mozilla-metric-config-parser
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-06 08:49:01 -08:00
63d1e3f07d
Bug 1873431 - restrict access to tiktok reporter datasets ( #5159 )
...
Co-authored-by: akkomar <akkomar@users.noreply.github.com>
2024-03-05 22:42:40 +00:00
0ec741c910
Bump google-cloud-storage from 2.14.0 to 2.15.0 ( #5166 )
...
Bumps [google-cloud-storage](https://github.com/googleapis/python-storage ) from 2.14.0 to 2.15.0.
- [Release notes](https://github.com/googleapis/python-storage/releases )
- [Changelog](https://github.com/googleapis/python-storage/blob/main/CHANGELOG.md )
- [Commits](https://github.com/googleapis/python-storage/compare/v2.14.0...v2.15.0 )
---
updated-dependencies:
- dependency-name: google-cloud-storage
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Anna Scholtz <anna@scholtzan.net>
2024-03-05 08:57:33 -08:00
e6b68c460b
Bump google-cloud-bigquery from 3.17.2 to 3.18.0 ( #5167 )
...
Bumps [google-cloud-bigquery](https://github.com/googleapis/python-bigquery ) from 3.17.2 to 3.18.0.
- [Release notes](https://github.com/googleapis/python-bigquery/releases )
- [Changelog](https://github.com/googleapis/python-bigquery/blob/main/CHANGELOG.md )
- [Commits](https://github.com/googleapis/python-bigquery/compare/v3.17.2...v3.18.0 )
---
updated-dependencies:
- dependency-name: google-cloud-bigquery
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Anna Scholtz <anna@scholtzan.net>
2024-03-05 08:47:12 -08:00
027eb69562
DENG-2950 - Rename drafting -> initiate, modify json output of scheduled command ( #5164 )
...
* Update json write for scheduled commands to include date and watchers for DAG
* Rename drafting to initiate
2024-03-05 09:12:47 -05:00
efc0862ff3
DENG-2579 move gclid_conversions_v2 from GA3 dag to GA4 dag ( #5162 )
2024-03-04 12:09:59 -06:00
dd7355f8da
DENG-2837 - add 3 new data checks ( #5161 )
2024-03-04 10:54:28 -06:00
05587c4017
feat(): adding metadata.yaml files for old (v1 and v2, current v3) with deprecated label ( #5132 )
...
* adding metadata.yaml files for old (v1 and v2, current v3) and deprecates active_users_aggregates tables
* correct the deprecated configuration for active_users_aggregates v1 and v2
* updated friendly name as suggeted by lvargas
2024-03-04 14:41:48 +01:00
07b4d75fbf
Add metadata.yaml for firefox_accounts_derived.encrypted_keys_v1 ( #5133 )
2024-03-04 14:16:04 +01:00
414e0b93a8
Bug 1873431 - Don't generate glean_usage queries for tiktokreporter ( #5151 )
2024-03-01 22:37:57 +00:00
0c4652f0f2
DENG-2938 Update product download logic to limit to Firefox Desktop downloads only in www_site_landing_page_metrics_v2 ( #5158 )
...
* DENG-2938 - update schema column descriptions for product download columns
* DENG-2938 - update product download logic to be firefox desktop only
* DENG-2938 add backticks around date
2024-03-01 14:55:23 -06:00
c3e4c5984d
DENG-2940 - add 2 new columns to www_site_hits_v2 ( #5157 )
2024-03-01 13:18:31 -06:00
9235ec1212
Fix unified metrics check ( #5156 )
2024-03-01 10:41:36 -08:00
c231d14f58
Fixes #5126 - Add additional fields to org_mozilla_broken_site_report.user_reports view ( #5127 )
...
* Fixes #5126 - Add additional fields to org_mozilla_broken_site_report.user_reports view
* Update sql/moz-fx-data-shared-prod/org_mozilla_broken_site_report/user_reports/view.sql
---------
Co-authored-by: Anna Scholtz <anna@scholtzan.net>
2024-03-01 10:28:51 -08:00
0ce1ccd5eb
Adding missing string ( #5154 )
...
Co-authored-by: m-d-bowerman <107562575+m-d-bowerman@users.noreply.github.com>
2024-03-01 09:46:37 -08:00
b63c4e7b11
DENG-2924 - update product download logic ( #5155 )
...
* DENG-2924 - update product download logic
* DENG-2924 fix typo
* DENG-2919 switch to if per Kik's request
* DENG-2924 update alias name
2024-03-01 11:32:10 -06:00
f62e26e99d
Revert "feat(ci): Add artifact-deployment to CircleCI workflows ( #5136 )" ( #5146 )
...
This reverts commit 8b1e965303
2024-03-01 08:50:13 -08:00
21e6bd4c4e
Added ETL checks to fenix_derived.funnel_retention_* tables ( #5152 )
2024-03-01 16:01:25 +01:00
997788b4ec
DENG-2919 - add platform filter ( #5145 )
2024-02-29 16:40:34 -06:00
1efeaef01b
Change Fivetran Airflow operators to run synchronously so the task concurrency limit is respected. ( #5144 )
2024-02-29 14:10:38 -08:00
ab29873095
Add sponsored tiles available field ( #5143 )
2024-02-29 16:29:57 -05:00
bf7fd41c2e
DENG-2919 Change logic for measuring product downloads ( #5142 )
...
* DENG-2919 - update www_site_metrics_summary_v2 logic to count only Desktop Firefox downloads towards downloads
* DENG-2919 wrap reserved col names with backticks
2024-02-29 13:45:13 -06:00
dc60b040f5
DENG-2918-UDFs for URL parsing ( #5141 )
...
* DENG-2918-UDFs for URL parsing
* removing get_host because net.host() exists
2024-02-29 19:24:57 +01:00
311aab70ef
Bump mkdocs-material from 9.5.11 to 9.5.12 ( #5138 )
...
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material ) from 9.5.11 to 9.5.12.
- [Release notes](https://github.com/squidfunk/mkdocs-material/releases )
- [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG )
- [Commits](https://github.com/squidfunk/mkdocs-material/compare/9.5.11...9.5.12 )
---
updated-dependencies:
- dependency-name: mkdocs-material
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-02-29 09:02:44 -08:00
52882cd63d
Bump sqlglot from 22.0.1 to 22.1.0 ( #5139 )
...
Bumps [sqlglot](https://github.com/tobymao/sqlglot ) from 22.0.1 to 22.1.0.
- [Changelog](https://github.com/tobymao/sqlglot/blob/main/CHANGELOG.md )
- [Commits](https://github.com/tobymao/sqlglot/compare/v22.0.1...v22.1.0 )
---
updated-dependencies:
- dependency-name: sqlglot
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-02-29 09:02:06 -08:00
8af0c2989c
Add estimate for number of devices to accounts_backend.users_services_last_seen_v1 ( #5140 )
2024-02-29 07:52:34 -08:00
98c72c6704
Prepare for FxA payments server moving to our GCPv2 setup (OPST-296) ( #4903 )
...
After which its production logs should end up in `moz-fx-fxa-prod.gke_fxa_prod_log.stderr` or `moz-fx-fxa-prod.gke_fxa_prod_log.stdout`, and its stage logs should end up in `moz-fx-fxa-nonprod.gke_fxa_stage_log.stderr` or `moz-fx-fxa-nonprod.gke_fxa_stage_log.stdout`.
2024-02-28 15:39:48 -08:00
8b1e965303
feat(ci): Add artifact-deployment to CircleCI workflows ( #5136 )
2024-02-28 16:50:05 -05:00
6c185d0a88
Add estimate for number of devices to accounts_backend.users_services_daily_v1 ( #5131 )
2024-02-28 10:29:09 -08:00
638f44c4ff
DENG-2896 Telemetry Dev Cycle fix experimenter API ( #5135 )
2024-02-28 19:24:56 +01:00
18ef0db909
add firefox_accounts.funnel_events_source to version control ( #5130 )
2024-02-28 18:14:11 +01:00
db4c4fbc36
Bump sqlglot from 21.2.0 to 22.0.1 ( #5128 )
...
Bumps [sqlglot](https://github.com/tobymao/sqlglot ) from 21.2.0 to 22.0.1.
- [Changelog](https://github.com/tobymao/sqlglot/blob/main/CHANGELOG.md )
- [Commits](https://github.com/tobymao/sqlglot/compare/v21.2.0...v22.0.1 )
---
updated-dependencies:
- dependency-name: sqlglot
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-02-28 08:52:06 -08:00
8eeb7f4afa
Bump mkdocs-material from 9.5.9 to 9.5.11 ( #5129 )
...
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material ) from 9.5.9 to 9.5.11.
- [Release notes](https://github.com/squidfunk/mkdocs-material/releases )
- [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG )
- [Commits](https://github.com/squidfunk/mkdocs-material/compare/9.5.9...9.5.11 )
---
updated-dependencies:
- dependency-name: mkdocs-material
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-02-28 08:51:37 -08:00
c3fe99cb10
DENG-2095 Fix accounts_backend.users_services_daily_v1 ( #5124 )
2024-02-28 12:36:50 +01:00
bde2c50acd
improve is_unique data check message ( #5125 )
2024-02-27 21:00:11 +01:00
6c501a620c
Deng-2845: Remove default deprecated false ( #5118 )
...
* Removed deprecated field
* Removed deprecated false in metadata yaml
* Fixed test
2024-02-27 10:33:50 -08:00
cebe632132
Bump google-cloud-bigquery from 3.14.1 to 3.17.2 ( #5120 )
...
Bumps [google-cloud-bigquery](https://github.com/googleapis/python-bigquery ) from 3.14.1 to 3.17.2.
- [Release notes](https://github.com/googleapis/python-bigquery/releases )
- [Changelog](https://github.com/googleapis/python-bigquery/blob/main/CHANGELOG.md )
- [Commits](https://github.com/googleapis/python-bigquery/compare/v3.14.1...v3.17.2 )
---
updated-dependencies:
- dependency-name: google-cloud-bigquery
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-02-27 08:27:14 -08:00
3371fd1294
Bump pandas from 2.2.0 to 2.2.1 ( #5121 )
...
Bumps [pandas](https://github.com/pandas-dev/pandas ) from 2.2.0 to 2.2.1.
- [Release notes](https://github.com/pandas-dev/pandas/releases )
- [Commits](https://github.com/pandas-dev/pandas/compare/v2.2.0...v2.2.1 )
---
updated-dependencies:
- dependency-name: pandas
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-02-27 08:26:53 -08:00
9189ae8e4d
DENG-2095 Add accounts_backend.users_services_last_seen_v1 ( #5112 )
2024-02-27 12:07:07 +01:00
86ae2024b8
deprecated queries cost v1 ( #4990 )
2024-02-26 15:49:32 -08:00
a0cf8090dd
Remove submission_date from events_stream tables ( #5103 )
2024-02-26 13:19:36 -08:00
e5a6c18070
Revert "DENG-2837 add data checks to new ga4 tables ( #5102 )" ( #5117 )
...
This reverts commit 74ddf001e9
2024-02-26 11:53:53 -08:00
74ddf001e9
DENG-2837 add data checks to new ga4 tables ( #5102 )
...
* DENG-2837 Add 2 new QA checks
* DENG-2837 add spaces to end of checks
* DENG-2837 add where clause to blogs_goals_v2 check
* DENG-2837 - add QA check for www_site_hits_v2
* DENG-2837 adding more checks and adding extra empty line
* DENG-2837 add not null check to ga_sessions_v2
* DENG-2837 add pattern check for visit identifier on blogs_goals_v2
2024-02-26 13:13:04 -06:00
406098188c
DENG-2095 Update accounts_backend.users_services_daily_v1 ( #5116 )
2024-02-26 19:35:59 +01:00
7d28bb1785
Fix validate-routine CI ( #5115 )
2024-02-26 09:59:47 -08:00
41e953ea20
Conditional steps in CI ( #5095 )
...
* Revert "Revert "Path Filtering in CI (#4939 )""
This reverts commit d6189a7641#5030 )""
This reverts commit 3991a2574b#5035 )""
This reverts commit c4c651d0c5
2024-02-26 09:36:53 -08:00
101e8e4543
Preempt IndexError when unable to parse view content ( #5114 )
2024-02-26 11:57:41 -05:00
b365ff9389
Bump types-python-dateutil from 2.8.19.14 to 2.8.19.20240106 ( #5107 )
...
Bumps [types-python-dateutil](https://github.com/python/typeshed ) from 2.8.19.14 to 2.8.19.20240106.
- [Commits](https://github.com/python/typeshed/commits )
---
updated-dependencies:
- dependency-name: types-python-dateutil
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-02-26 08:03:43 -08:00
Anna Scholtz
dependabot[bot]
whd
Alexander
Katie Windau
kik-kik
akkomar
Ksenia
Sergio E. Betancourt
Sean Rose
m-d-bowerman
Leli
Mikaël Ducharme
Winnie Chan