c1c73e690e
Make sure that metadata `friendly_name` and `description` are not None ( #4513 )
...
* Fill empty description
* Assign a friendly name if the table doesn't have one
* Update metadata tests
* Update bigquery_etl/metadata/parse_metadata.py
Co-authored-by: Alexander <anicholson@mozilla.com>
* update test again
---------
Co-authored-by: Alexander <anicholson@mozilla.com>
2023-11-17 11:48:11 -05:00
2e916eb856
DENG1381 - Add bqetl support for deprecation metadata ( #4213 )
...
* Support bq dataset deprecation process (metadata)
* Add bqetl metadata cli command
* Initial draft for adding deprecation support to bqetl
* Incorporate Anna's feedback
* Fix based on whd's feedback
* Fix ci issues
* Remove unnecessary logic from metadata.py
* Add dataset metadata yaml for ga_derived
* Ignore dirs that do not have dataset_metadata yaml
* Remove unwanted dataset metadata yamls
* Update bigquery_etl/cli/metadata.py
Co-authored-by: whd <whd@users.noreply.github.com>
---------
Co-authored-by: whd <whd@users.noreply.github.com>
2023-09-12 18:47:54 +00:00
1c3ba13b40
Skip non-emails in owner labels ( #3763 )
2023-05-11 17:02:46 -04:00
33a7ab0921
DENG-590 Added owner to labels metadata ( #3637 )
...
* Added owner to labels metadata
* Update bigquery_etl/metadata/parse_metadata.py
Co-authored-by: Alexander <anicholson@mozilla.com>
---------
Co-authored-by: Alexander <anicholson@mozilla.com>
2023-03-06 15:08:50 -08:00
45655229d3
Added sql_generators script to create schema.yaml files for derived views ( #2657 )
2022-01-13 15:46:06 -05:00
b3651eb338
Partition expiration in days
2021-12-02 08:56:56 -08:00
3e2e611ce6
Add tests
2021-05-19 12:51:11 -07:00
a190e18264
Automatically sort python imports ( #1840 )
2021-02-24 17:11:52 -05:00
3b2a672f78
Support python script query scheduling
2020-11-10 14:36:07 -08:00
89d48cd99e
Add multiple bug test
2020-10-28 09:01:43 -07:00
88b0e2066e
Listify review_bugs in tests and metadata files
2020-10-28 09:01:43 -07:00
2a1454c309
Update metadata validation logic (issue #924 ) ( #1463 )
...
* Validate metadata with attr
* Update and add tests
* Add check if file exists and update tests
* Format code and update validate metadata
* Revert changes to is_metadata_file()
* Remove format error: whitespaces
* Format test files
Co-authored-by: Anna Scholtz <anna@scholtzan.net>
2020-10-20 16:03:50 -07:00
87f1a4e19f
Update tests
2020-10-05 12:59:58 -07:00
bb2dbf176e
Alternate project support for CLI
2020-10-05 12:59:58 -07:00
368020f37d
Generate Airflow code for tasks
2020-05-28 14:12:24 -07:00
e7bd2fb50c
Move all metadata related scripts to a metadata directory
2020-04-29 14:18:53 -07:00
Linh Nguyen
Alekhya
Alexander
Winnie Chan
Anna Scholtz
Daniel Thorn
jailang