209b75ae57
Bigeye - Add support for deploying and removing custom SQL rules ( #6379 )
...
* Add support for defining custom SQL rules
* Added monitoring rollback command
* Reformat
* Add tests
* Address review feedback
* Add flags for deleting Bigeye checks
* Fix formatting
* Fix tests
2024-11-04 17:41:46 +00:00
66b37ada4a
Add support for secrets when generating Airflow DAGs ( #6241 )
...
* Add support for secrets when generating Airflow DAGs
* update test_publish_metadata owner
* Conditional import of Airflow Secrets
2024-09-23 19:58:43 +00:00
33f9017c75
DENG-2823: Added deprecate cli command ( #5219 )
...
* Added deprecate cli command
* Fixed typo
* Fixed failed tests
* Fixed deletion date label
* Update bigquery_etl/metadata/parse_metadata.py
Co-authored-by: Sean Rose <1994030+sean-rose@users.noreply.github.com>
* Fixed deletion date
* Fixed arguments optional
* Added return back
* Added invalid deletion date test
---------
Co-authored-by: Sean Rose <1994030+sean-rose@users.noreply.github.com>
2024-03-19 11:17:32 -07:00
8ec7516157
Issue 4135: Added publish metadata cli command ( #5011 )
...
* Added publish metadata cli command
* Removed publish metadata script
2024-02-12 11:12:14 -08:00
c1c73e690e
Make sure that metadata `friendly_name` and `description` are not None ( #4513 )
...
* Fill empty description
* Assign a friendly name if the table doesn't have one
* Update metadata tests
* Update bigquery_etl/metadata/parse_metadata.py
Co-authored-by: Alexander <anicholson@mozilla.com>
* update test again
---------
Co-authored-by: Alexander <anicholson@mozilla.com>
2023-11-17 11:48:11 -05:00
2e916eb856
DENG1381 - Add bqetl support for deprecation metadata ( #4213 )
...
* Support bq dataset deprecation process (metadata)
* Add bqetl metadata cli command
* Initial draft for adding deprecation support to bqetl
* Incorporate Anna's feedback
* Fix based on whd's feedback
* Fix ci issues
* Remove unnecessary logic from metadata.py
* Add dataset metadata yaml for ga_derived
* Ignore dirs that do not have dataset_metadata yaml
* Remove unwanted dataset metadata yamls
* Update bigquery_etl/cli/metadata.py
Co-authored-by: whd <whd@users.noreply.github.com>
---------
Co-authored-by: whd <whd@users.noreply.github.com>
2023-09-12 18:47:54 +00:00
1c3ba13b40
Skip non-emails in owner labels ( #3763 )
2023-05-11 17:02:46 -04:00
33a7ab0921
DENG-590 Added owner to labels metadata ( #3637 )
...
* Added owner to labels metadata
* Update bigquery_etl/metadata/parse_metadata.py
Co-authored-by: Alexander <anicholson@mozilla.com>
---------
Co-authored-by: Alexander <anicholson@mozilla.com>
2023-03-06 15:08:50 -08:00
45655229d3
Added sql_generators script to create schema.yaml files for derived views ( #2657 )
2022-01-13 15:46:06 -05:00
b3651eb338
Partition expiration in days
2021-12-02 08:56:56 -08:00
3e2e611ce6
Add tests
2021-05-19 12:51:11 -07:00
a190e18264
Automatically sort python imports ( #1840 )
2021-02-24 17:11:52 -05:00
3b2a672f78
Support python script query scheduling
2020-11-10 14:36:07 -08:00
89d48cd99e
Add multiple bug test
2020-10-28 09:01:43 -07:00
88b0e2066e
Listify review_bugs in tests and metadata files
2020-10-28 09:01:43 -07:00
2a1454c309
Update metadata validation logic (issue #924 ) ( #1463 )
...
* Validate metadata with attr
* Update and add tests
* Add check if file exists and update tests
* Format code and update validate metadata
* Revert changes to is_metadata_file()
* Remove format error: whitespaces
* Format test files
Co-authored-by: Anna Scholtz <anna@scholtzan.net>
2020-10-20 16:03:50 -07:00
87f1a4e19f
Update tests
2020-10-05 12:59:58 -07:00
bb2dbf176e
Alternate project support for CLI
2020-10-05 12:59:58 -07:00
72a60c3bb3
Fix tests
2020-05-28 14:12:24 -07:00
368020f37d
Generate Airflow code for tasks
2020-05-28 14:12:24 -07:00
e7bd2fb50c
Move all metadata related scripts to a metadata directory
2020-04-29 14:18:53 -07:00
Anna Scholtz
Winnie Chan
Linh Nguyen
Alekhya
Alexander
Daniel Thorn
jailang