Anna Scholtz
03357769cc
Move view, schema and remaining configs to bqetl_project.yaml ( #4051 )
...
* Move view configs to bqetl_project.yaml
* Move schema config to bqetl_project.yaml
* Move docs config to bqetl_project.yaml
* Replace remaining configs
2023-07-11 13:10:57 -07:00
Sean Rose
02afdfb443
Ignore comments when detecting dependency table names. ( #3927 )
...
Otherwise the names of unaliased table references followed by a comment will incorrectly include the comment as part of the name.
2023-06-10 20:20:02 +00:00
Daniel Thorn
a0d810275b
Remove java dependency in favor of sqlglot ( #3755 )
2023-05-17 14:56:42 -07:00
Anna Scholtz
08b45a40fe
Jinja queries support ( #3691 )
...
* Support Jinja templating in query files
* Formatting for Jinja
* ./bqetl query render command
* Fix running templates
2023-03-30 11:00:12 -07:00
kik-kik
51def19185
Bug 1825545 - Revert "Support Jinja templating in query files ( #3685 )" ( #3689 )
...
Bug 1825545 - This reverts commit a1c51124ec
.
2023-03-30 10:47:17 -04:00
Anna Scholtz
a1c51124ec
Support Jinja templating in query files ( #3685 )
...
* Support Jinja templating in query files
* Formatting for Jinja
* ./bqetl query render command
2023-03-29 10:38:08 -07:00
Sean Rose
550752cf6f
Fix bug generating task dependencies when queries reference stable views in `mozdata`. ( #3504 )
2023-01-13 16:07:18 -08:00
Daniel Thorn
0235d6087c
Reapply "Update to zetasql 2022.02.1 ( #2862 )" ( #2881 )
2022-04-07 14:02:20 -07:00
Daniel Thorn
22835e5706
Revert "Update to zetasql 2022.02.1 ( #2862 )" ( #2879 )
...
This reverts commit 9c9761feac
.
2022-04-07 12:03:09 -07:00
Daniel Thorn
9c9761feac
Update to zetasql 2022.02.1 ( #2862 )
2022-04-05 18:55:52 +02:00
Daniel Thorn
71bfc9945e
DVPN-118 - Use intermediate table to count subscription activity ( #2845 )
2022-04-04 19:19:14 +02:00
Anna Scholtz
cf966d2280
Move stable view generation into separate module
2022-01-05 12:26:52 -08:00
Will Lachance
5ca8f99931
Don't exit early when references for a table already exist in CI ( #2498 )
...
We were exiting from the entire process of reference-generation if we
found an existing reference (and `--skip-existing` was true) rather
than just skipping this directory as we should have been.
2021-11-16 11:09:14 -08:00
Anna Scholtz
858919d350
Revert "Revert "Add bqetl view validate command""
...
This reverts commit a0ccd7602b
.
2021-08-04 14:49:38 -07:00
Anna Scholtz
a0ccd7602b
Revert "Add bqetl view validate command"
...
This reverts commit 62c85cb36c
.
2021-07-29 10:47:24 -07:00
Anna Scholtz
62c85cb36c
Add bqetl view validate command
2021-07-29 10:07:53 -07:00
Daniel Thorn
7045922816
Fix jvm startup race condition ( #2167 )
2021-07-06 18:04:04 +00:00
Jeff Klukas
c6f0c3ce81
Allow generate_sql to twice without raising error ( #2067 )
...
Fixes https://github.com/mozilla/bigquery-etl/issues/2066
2021-05-24 16:36:11 -04:00
Anna Scholtz
b75b089db4
Determine downstream dependencies when updating schemas
2021-05-07 10:30:02 -07:00
Daniel Thorn
ca38326e91
Fix dependabot updates by separating pyjnius requirement ( #1990 )
2021-05-04 13:02:56 -04:00
Daniel Thorn
d56f32ffe2
Detect views deployed to mozdata when resolving dependencies ( #1994 )
2021-05-03 16:57:58 -07:00
Daniel Thorn
024e993c44
Record table references in metadata.yaml ( #1875 )
2021-03-09 12:29:05 -05:00
Daniel Thorn
5d07beaca7
Use zetasql to get dependencies for dag generation ( #1817 )
2021-02-18 17:49:46 -05:00
Daniel Thorn
f0ec77e27d
Use zetasql to find sql dependencies ( #1802 )
2021-02-17 11:48:40 -08:00