Граф коммитов

11 Коммитов

Автор SHA1 Сообщение Дата
Sean Rose 5ee7b8cdc7
Pass the query's project to the dryrun cloud function (#4904)
So we don't have to rely on the dryrun cloud function using the `moz-fx-data-shared-prod` project by default.
2024-03-07 15:37:17 -08:00
Anna Scholtz 10cbb52126
Metric-hub integration (#3696)
* Metric-hub integration

* Add metrics.data_source()
2023-04-04 09:19:03 -07:00
Anna Scholtz 5945a44218 Create desktop funnel query schemas 2021-03-19 13:48:43 -07:00
Anna Scholtz 597822a792 Fix inflated numbers in desktop funnel queries 2021-03-19 13:48:43 -07:00
Jeff Klukas 33e7b7499a
Bug 1695654: Add a method to fetch dataset labels from dryrun service results (#1858)
* Add a method to fetch dataset labels from dryrun service results

* Update bigquery_etl/dryrun.py

Co-authored-by: Anna Scholtz <anna@scholtzan.net>

* Adapt tests to include real datasets in paths

Co-authored-by: Anna Scholtz <anna@scholtzan.net>
2021-03-02 09:13:08 -05:00
Daniel Thorn a190e18264
Automatically sort python imports (#1840) 2021-02-24 17:11:52 -05:00
Linh Nguyen 4f26049318
Generate referenced tables for views (#1763)
* WIP

* Get referenced tables for mozdata

* Address review comments and add tests

* Try 'SELECT from {view}' method

This approach returns a lot of unfound table errors,
it seems like there's not a direct 1:1 correlation
between bigquery-etl table names and BigQuery datasets
on the cloud

* Add tests

* Lint dryrun.py

* Add some minor cleanups

* Add test for multiple referenced tables

* Sort referenced table results
2021-02-16 11:49:19 -08:00
Anna Scholtz a6ef677b7f Use cached_property for DryRun 2020-08-14 11:08:15 -07:00
Anna Scholtz 47ff0d88f3 Refactor dry run and update integration tests 2020-08-14 11:08:15 -07:00
Anna Scholtz 58b3cf31b7 Add payload_bytes_* tables as referenced_tables for monitoring datasets 2020-08-14 11:08:15 -07:00
Anna Scholtz b1a9b4a781 Add dry run tests 2020-08-14 11:08:15 -07:00