bigquery-etl/bigquery_etl
Alexander f045e9d849
Support offset backfills, require metadata (#4627)
* Skip backfills for queries without metadata.yaml

* Support date_partition_offset

* Fixed exclude, modified exception

* Add test for offset backfill

* Apply suggestions from code review

Co-authored-by: Frank Bertsch <frank.bertsch@gmail.com>

* Formatting

---------

Co-authored-by: Frank Bertsch <frank.bertsch@gmail.com>
2023-12-05 14:07:09 -05:00
..
alchemer Bump click from 8.1.0 to 8.1.1 (#2849) 2022-03-31 10:51:51 -07:00
backfill Skip tables with all filtered backfill entries (#4217) 2023-08-30 10:54:09 -04:00
cli Support offset backfills, require metadata (#4627) 2023-12-05 14:07:09 -05:00
docs Add missing / for generating docs (#4055) 2023-07-11 15:55:01 -07:00
format_sql Implement simple generic active subscriptions table for KPIs (#4149) 2023-08-02 12:26:54 -07:00
glam GLAM avoid scientific notation for big sample counts (#4647) 2023-12-04 17:47:50 -05:00
metadata Make sure that metadata `friendly_name` and `description` are not None (#4513) 2023-11-17 11:48:11 -05:00
public_data Move view, schema and remaining configs to bqetl_project.yaml (#4051) 2023-07-11 13:10:57 -07:00
pytest_plugin Put assert UDFs in `mozfun` project (#4367) 2023-10-13 10:58:42 -07:00
query_scheduling Resolve correct task_id for tasks nested in a group (#4637) 2023-12-01 11:38:59 -08:00
routine Put assert UDFs in `mozfun` project (#4367) 2023-10-13 10:58:42 -07:00
schema Move view, schema and remaining configs to bqetl_project.yaml (#4051) 2023-07-11 13:10:57 -07:00
shredder feat(DENG-2083): added firefox_ios_derived.clients_activation_v1 and corresponding view (#4631) 2023-12-05 12:42:39 +01:00
stripe DS-2642 - Import stripe itemized tax report (#3999) 2023-07-10 17:22:18 -07:00
subplat Update dependencies missed by dependabot (#3566) 2023-02-06 12:14:32 -08:00
util DS-3054. Support running an initialization query in parallel (#4322) 2023-11-07 20:03:48 +01:00
view Include metadata check in view publishing (#4159) 2023-08-07 10:24:56 -04:00
__init__.py Set ConfigLoader's project directory on module initialization (#4062) 2023-07-12 17:45:08 +02:00
_version.py Bump CLI version 2020-12-16 13:06:58 -08:00
config.py Add ConfigLoader and move dry run skip to bqetl_project.yaml (#4000) 2023-07-06 10:42:29 -07:00
copy_deduplicate.py DS-3054. Support running an initialization query in parallel (#4322) 2023-11-07 20:03:48 +01:00
dependency.py Move view, schema and remaining configs to bqetl_project.yaml (#4051) 2023-07-11 13:10:57 -07:00
dryrun.py prefixing schema error message inside dryrun to "ERROR" to make it easier to find when searching logs for cause of exit code 1 (#4522) 2023-11-06 12:12:50 +01:00
generate_incremental_table.py Remove generate_incremental_table dependency on script/entrypoint (#2008) 2021-05-06 14:03:00 -07:00
metrics.py Metric-hub integration (#3696) 2023-04-04 09:19:03 -07:00
static.py Move view, schema and remaining configs to bqetl_project.yaml (#4051) 2023-07-11 13:10:57 -07:00