зеркало из https://github.com/mozilla/docker-etl.git
25c6ebd34a
* Move bugzilla code to a submodule * Refactor argument handling Use `--bq-project` and `--bq-kb-dataset` as aliasses for `--bq_project_id` and `--bq_dataset_id`, but make the old values still work to avoid needing to update prod yet. Default to a test dataset for the kb datset. Move bugzilla-specific arguments to the bugzilla module. * Refactor to support running multiple ETL jobs Modules are just explicitly defined in a dictionary in main. Move creating the client to the main function, and pass it in to the main() function for each module. * Disallow untyped defs in mypy configuration * Add webcompat-kb job for updating CrUX data This updates our CrUX ranking data from the upstream tables. The upstream data is updated once a month with the data for the previous month, so we avoid running any updates unless we are missing data corresponding to the previous month. |
||
|---|---|---|
| .. | ||
| bq2sftp | ||
| broken-site-report-ml | ||
| client-regeneration | ||
| dap-collector | ||
| dap-collector-ppa-dev | ||
| dap-collector-ppa-prod | ||
| desktop-mobile-mau-2020 | ||
| eam-integrations | ||
| example_job | ||
| experiments-monitoring-data-export | ||
| fxci-taskcluster-export | ||
| influxdb-to-bigquery | ||
| kpi-forecasting | ||
| mozaggregator2bq | ||
| play-store-export | ||
| quicksuggest2bq | ||
| search-alert | ||
| search-term-data-validation-v2 | ||
| webcompat-kb | ||