bigquery-etl/requirements.in

gcloud==0.18.3
google-cloud-bigquery==1.24.0
google-cloud-storage==1.26.0
Jinja2==2.11.1
pytest-black==0.3.8
pytest-docstyle==1.5.0
pytest-flake8==1.0.4
pytest-mypy==0.4.2
pytest-xdist==1.31.0
pytest-dependency==0.5.1
pytest==5.4.1
PyYAML==5.3
smart_open==1.10.0
sqlparse==0.3.1
mozilla_schema_generator==0.1.4
Use pip-compile instead of constraints.txt (#736) * Fix docstyle check * Use pip-compile instead of constraints.txt 2020-02-12 22:26:24 +03:00			`gcloud==0.18.3`
			`google-cloud-bigquery==1.24.0`
Update entrypoint and format ndjson to json 2020-03-19 23:59:01 +03:00			`google-cloud-storage==1.26.0`
Use pip-compile instead of constraints.txt (#736) * Fix docstyle check * Use pip-compile instead of constraints.txt 2020-02-12 22:26:24 +03:00			`Jinja2==2.11.1`
Bump pytest-black from 0.3.7 to 0.3.8 (#742) Bumps [pytest-black](https://github.com/shopkeep/pytest-black) from 0.3.7 to 0.3.8. - [Release notes](https://github.com/shopkeep/pytest-black/releases) - [Commits](https://github.com/shopkeep/pytest-black/compare/0.3.7...0.3.8) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: Anthony Miyaguchi <acmiyaguchi@gmail.com> 2020-02-14 00:42:36 +03:00			`pytest-black==0.3.8`
Use pip-compile instead of constraints.txt (#736) * Fix docstyle check * Use pip-compile instead of constraints.txt 2020-02-12 22:26:24 +03:00			`pytest-docstyle==1.5.0`
			`pytest-flake8==1.0.4`
			`pytest-mypy==0.4.2`
			`pytest-xdist==1.31.0`
Add tests for publishing json 2020-03-20 03:46:14 +03:00			`pytest-dependency==0.5.1`
Bump pytest from 5.3.5 to 5.4.1 Bumps [pytest](https://github.com/pytest-dev/pytest) from 5.3.5 to 5.4.1. - [Release notes](https://github.com/pytest-dev/pytest/releases) - [Changelog](https://github.com/pytest-dev/pytest/blob/master/CHANGELOG.rst) - [Commits](https://github.com/pytest-dev/pytest/compare/5.3.5...5.4.1) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> 2020-03-31 23:30:27 +03:00			`pytest==5.4.1`
Use pip-compile instead of constraints.txt (#736) * Fix docstyle check * Use pip-compile instead of constraints.txt 2020-02-12 22:26:24 +03:00			`PyYAML==5.3`
Use streaming for converting ndjson to json 2020-03-21 10:45:53 +03:00			`smart_open==1.10.0`
Bump sqlparse from 0.3.0 to 0.3.1 Bumps [sqlparse](https://github.com/andialbrecht/sqlparse) from 0.3.0 to 0.3.1. - [Release notes](https://github.com/andialbrecht/sqlparse/releases) - [Changelog](https://github.com/andialbrecht/sqlparse/blob/master/CHANGELOG) - [Commits](https://github.com/andialbrecht/sqlparse/compare/0.3.0...0.3.1) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> 2020-03-31 23:30:20 +03:00			`sqlparse==0.3.1`
Add histograms to fenix glam etl (#766) * Add initial template for histogram aggregates * Factor out common functions and get all distributions * Add viable query for histogram aggregates * Add more efficient aggregation * Update header and update comment * Add code to generate clients daily histograms * Add queries for generated sql * Return non-zero exit code when histograms not found * Delete empty queries to reduce data scanned * Add non-zero exit code for scalars if probes are not found * Sort histograms for stable output * Add view for histogram aggregates * Add initial sql for histogram aggregates * Format template scripts * Add mostly reformatted sql for aggregates * Update histogram aggregates before adding statements * Fix up details for daily aggregation * Add completed histograms template * Add code to generate clients histogram aggregates * Add init for clients histogram aggregates * Remove sample_id from set of attributes * Add sections to run generated sql * Add generated sql * Remove extra latest_version columns * Fix many small issues during first draft of sql * Fix clients histogram aggregates * Add initial modification to probe counts * Add histogram bucket counts * Add option to generate histogram probe counts * Update generated_fenix_sql for histograms * Add generated sql * Update run_fenix_sql * Fix bucket counts * Update source table for probe counts * Add missing ping_type to histograms * Add first,last,num buckets * Update probe counts so it succeeds * Add mozilla_schema_generator to dependencies * Add metadata from probe-info for custom distributions * Update probe counts with metadata for custom distributions * Add UDF for generating functional buckets * Add proper bucketing by including range_max of measures * Format histogram udfs * Add updated templates to skip * Add new queries to dryrun ignore * Add view to the publish ignore list * Fix python linting * Remove old comments from probe counts * Do not count metadata from custom distributions twice * Remove sum from histogram aggregates * Add generated SQL * Add sample_id to histograms earlier in pipeline * Add generated SQL * Add comments to functional bucketing for metrics 2020-03-18 23:53:28 +03:00			`mozilla_schema_generator==0.1.4`