Граф коммитов

24 Коммитов

Автор SHA1 Сообщение Дата
Anna Scholtz 03357769cc
Move view, schema and remaining configs to bqetl_project.yaml (#4051)
* Move view configs to bqetl_project.yaml

* Move schema config to bqetl_project.yaml

* Move docs config to bqetl_project.yaml

* Replace remaining configs
2023-07-11 13:10:57 -07:00
Sean Rose 02afdfb443
Ignore comments when detecting dependency table names. (#3927)
Otherwise the names of unaliased table references followed by a comment will incorrectly include the comment as part of the name.
2023-06-10 20:20:02 +00:00
Daniel Thorn a0d810275b
Remove java dependency in favor of sqlglot (#3755) 2023-05-17 14:56:42 -07:00
Anna Scholtz 08b45a40fe
Jinja queries support (#3691)
* Support Jinja templating in query files

* Formatting for Jinja

* ./bqetl query render command

* Fix running templates
2023-03-30 11:00:12 -07:00
kik-kik 51def19185
Bug 1825545 - Revert "Support Jinja templating in query files (#3685)" (#3689)
Bug 1825545 - This reverts commit a1c51124ec.
2023-03-30 10:47:17 -04:00
Anna Scholtz a1c51124ec
Support Jinja templating in query files (#3685)
* Support Jinja templating in query files

* Formatting for Jinja

* ./bqetl query render command
2023-03-29 10:38:08 -07:00
Sean Rose 550752cf6f
Fix bug generating task dependencies when queries reference stable views in `mozdata`. (#3504) 2023-01-13 16:07:18 -08:00
Daniel Thorn 0235d6087c
Reapply "Update to zetasql 2022.02.1 (#2862)" (#2881) 2022-04-07 14:02:20 -07:00
Daniel Thorn 22835e5706
Revert "Update to zetasql 2022.02.1 (#2862)" (#2879)
This reverts commit 9c9761feac.
2022-04-07 12:03:09 -07:00
Daniel Thorn 9c9761feac
Update to zetasql 2022.02.1 (#2862) 2022-04-05 18:55:52 +02:00
Daniel Thorn 71bfc9945e
DVPN-118 - Use intermediate table to count subscription activity (#2845) 2022-04-04 19:19:14 +02:00
Anna Scholtz cf966d2280 Move stable view generation into separate module 2022-01-05 12:26:52 -08:00
Will Lachance 5ca8f99931
Don't exit early when references for a table already exist in CI (#2498)
We were exiting from the entire process of reference-generation if we
found an existing reference (and `--skip-existing` was true) rather
than just skipping this directory as we should have been.
2021-11-16 11:09:14 -08:00
Anna Scholtz 858919d350 Revert "Revert "Add bqetl view validate command""
This reverts commit a0ccd7602b.
2021-08-04 14:49:38 -07:00
Anna Scholtz a0ccd7602b Revert "Add bqetl view validate command"
This reverts commit 62c85cb36c.
2021-07-29 10:47:24 -07:00
Anna Scholtz 62c85cb36c Add bqetl view validate command 2021-07-29 10:07:53 -07:00
Daniel Thorn 7045922816
Fix jvm startup race condition (#2167) 2021-07-06 18:04:04 +00:00
Jeff Klukas c6f0c3ce81
Allow generate_sql to twice without raising error (#2067)
Fixes https://github.com/mozilla/bigquery-etl/issues/2066
2021-05-24 16:36:11 -04:00
Anna Scholtz b75b089db4 Determine downstream dependencies when updating schemas 2021-05-07 10:30:02 -07:00
Daniel Thorn ca38326e91
Fix dependabot updates by separating pyjnius requirement (#1990) 2021-05-04 13:02:56 -04:00
Daniel Thorn d56f32ffe2
Detect views deployed to mozdata when resolving dependencies (#1994) 2021-05-03 16:57:58 -07:00
Daniel Thorn 024e993c44
Record table references in metadata.yaml (#1875) 2021-03-09 12:29:05 -05:00
Daniel Thorn 5d07beaca7
Use zetasql to get dependencies for dag generation (#1817) 2021-02-18 17:49:46 -05:00
Daniel Thorn f0ec77e27d
Use zetasql to find sql dependencies (#1802) 2021-02-17 11:48:40 -08:00