de61beddca
Fix rebase conflicts
2020-02-07 09:48:23 -08:00
1d193726d3
main_summary use temporary UDFs
2020-02-07 09:48:23 -08:00
153d45d62f
Reformat SQL
2020-02-07 09:48:23 -08:00
ab9135f951
Publish persistent UDFs step in Circle CI
2020-02-07 09:48:23 -08:00
867543a660
Fix use of temporary UDFs
2020-02-07 09:48:23 -08:00
2f7de8683d
Enforce script/format_sql for all new sql files ( #656 )
2020-01-09 13:55:46 -08:00
b3dc8f3456
Enforce formatting on new udf
2020-01-09 09:28:55 -05:00
e0eab61b08
Remove unneeded docker in verify-generated-sql ( #645 )
...
and reduce repeated code
Co-authored-by: Jeff Klukas <jeff@klukas.net>
2020-01-08 09:19:13 -08:00
8ca73c2b60
Rewrite script/format_sql in python ( #640 )
2020-01-06 16:17:41 -08:00
48cfe3fff7
Upgrade to python 3.8 ( #564 )
2019-12-03 12:50:38 -08:00
469c03ec10
Add script to format sql ( #173 )
2019-09-18 17:48:53 -07:00
aaeeec8f99
Update deploy circleci workflow job to use restricted context ( #344 )
2019-09-09 17:43:17 -04:00
126e9fd3be
Don't redundantly run tests on deploy ( #313 )
...
because we don't want to modify prod resources in order to run deploy-time tests
2019-08-26 12:43:45 -07:00
9580029e20
UDF for unzipping gzipped bytes ( #272 )
...
* UDF for decompressing gzip data
* Update script for publishing UDFs to upload UDF dependency files
* Address review feedback for gunzip UDF
* Set default GCS bucket to moz-fx-data-prod-bigquery-etl
* Add function to upload UDF dependencies to GCS
* Set data-eng-circleci-tests context in CircleCI config
* Add approval step in CircleCI config
2019-08-26 10:53:06 -07:00
7a6f7aacf8
View generation fixes
2019-08-21 15:03:50 -07:00
7520de5092
Script for auto-generating views
2019-08-21 15:03:50 -07:00
351b42e84a
Dry-run each query in CircleCI against prod datasets ( #261 )
...
* Dry-run each query in CircleCI against prod datasets
* Apply suggestions from code review
* Update script/dryrun
2019-07-30 10:26:25 -07:00
b06acd389d
Fix generated SQL
2019-06-25 08:07:26 -07:00
7207a4e52f
Move SQL templates to templates/ and add generated SQL
2019-06-25 08:07:26 -07:00
fe7325dcb4
Run SQL generation script in when creating docker image
2019-06-25 08:07:26 -07:00
aa637154c5
Ensure that UDFs are added only once and in order when generating SQL files
2019-06-25 08:07:26 -07:00
a8edc5fff4
CircleCI config indentation fix
2019-06-25 08:07:26 -07:00
a6661c5896
Trigger SQL query generation in pytest and update CircleCI config
2019-06-25 08:07:26 -07:00
b62970f3a9
Makefile for generating sql and add newline breaks to new files
2019-06-25 08:07:26 -07:00
f2efcc0432
Adopt CircleCI script to generate SQL queries
2019-06-25 08:07:26 -07:00
606fec9c04
Set sane defaults for bq use in airflow ( #110 )
2019-05-01 08:24:57 -07:00
9381643175
Use CIRCLE_PROJECT_USERNAME ( #98 )
2019-04-19 13:16:46 -07:00
d02528ee5f
Fix issue with docker image name for deploy ( #96 )
2019-04-19 13:04:11 -07:00
52d10541d3
Create and publish docker image ( #95 )
...
* Create and publish docker image
* Update config.yml
2019-04-19 09:19:36 -07:00
5cf2ab6cae
Run tests in parallel ( #79 )
2019-04-10 13:39:38 -07:00
79070068ad
Add first test ( #9 )
2019-03-07 12:43:21 -08:00
Anna Scholtz
Daniel Thorn
Jeff Klukas
Jason Thomas
Allen Short