mozilla
/
bigquery-etl
зеркало из https://github.com/mozilla/bigquery-etl.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
bigquery-etl/.gitignore

19 строки
192 B
Plaintext
Исходник Постоянная ссылка Обычный вид История

Add first test (#9)
2019-03-07 23:43:21 +03:00
*.pyc
*.swp
*.swo
Bug 1635906 Add bqetl support for scripts and script for AET lookup (#1323) * Bug 1635906 Add bqetl support for scripts and script for AET lookup There are some code changes here for DAG generation and for testing. * Apply suggestions from code review Co-authored-by: Anna Scholtz <anna@scholtzan.net> * DAG fixups Co-authored-by: Anna Scholtz <anna@scholtzan.net>
2020-09-23 22:28:25 +03:00
*.egg-info/
MDV2 client_probe_counts templates and queries.
2019-09-11 18:18:19 +03:00
.DS_Store
Add first test (#9)
2019-03-07 23:43:21 +03:00
.mypy_cache/
Remove .vscode settings and add to gitignore (#1929) .vscode's settings.json can get cluttered with installation-specific settings, which can lead to confusing pull requests. Instead, let's use the approach outlined here: https://stackoverflow.com/a/48387809 This provides a set of defaults that people can use, which we can extend over time.
2021-03-30 19:25:05 +03:00
.vscode/
Update bigquery-etl cookbooks (#2935) * Ignore .idea/ folder in pycharm * Make instructions to add field generic with example. Add recommendations to delete field. * Reformat numbered list for consistency. * Update instructions based on PR feedback. Co-authored-by: Lucia Vargas <lvargas@mozilla.com>
2022-05-04 12:10:34 +03:00
.idea/
Add first test (#9)
2019-03-07 23:43:21 +03:00
venv/
Use zetasql to find sql dependencies (#1802)
2021-02-17 22:48:40 +03:00
target/
Add links to metadata.yaml editor and source dictory (#1242) (#1618) * Add links to edit and source directory * Update docs/mkdocs.yml Co-authored-by: Anna Scholtz <anna@scholtzan.net> Co-authored-by: jailang <lynjailang@gmail.com> Co-authored-by: Anna Scholtz <anna@scholtzan.net>
2020-12-15 22:52:46 +03:00
feat(): Adding ETL for monitoring_airflow datasets (#3204) * added sql logic for monitoring_airflow * bqetl_monitoring_airflow added to dags.yaml * added .probe_cache/ to gitignore * generated bqetl_monitoring_airflow dag * added monitoring_airflow_derived to dryrun ignore as it fails to access fivetran data referenced in this dataset * moved airflow views and sql files to monitoring dataset * manually triggering fivetran load of airflow metadata as suggested by @ascholtzan in PR#3204 * added schemas as requested by @scholtzan in PR#3204 * added descriptions to airflow_monitoring datasets * fixed airflow_dag view folder name * corrected dryrun ignore for monitoring_derived/airflow*
2022-10-12 12:57:24 +03:00
.probe_cache/
Add links to metadata.yaml editor and source dictory (#1242) (#1618) * Add links to edit and source directory * Update docs/mkdocs.yml Co-authored-by: Anna Scholtz <anna@scholtzan.net> Co-authored-by: jailang <lynjailang@gmail.com> Co-authored-by: Anna Scholtz <anna@scholtzan.net>
2020-12-15 22:52:46 +03:00
# ignore locally generated docs
sql/**/docs
Generate summaries of derived tables (fixes #1589) (#1735) * Generate summaries of derived tables * Generate mozdata docs * Address requested changes
2021-02-05 00:05:26 +03:00
sql/**/mkdocs.yml
generated_docs/
Publish generated views and queries to a generated-sql branch (#1775) * Add CI task to push content to generated-sql branch Fixes #1742 The [`generated-sql`](https://github.com/mozilla/bigquery-etl/tree/generated-sql) branch now exists and you can browse the contents. See, for example, [telemetry.main](https://github.com/mozilla/bigquery-etl/tree/generated-sql/sql/moz-fx-data-shared-prod/telemetry/main) Follow-ups for which I'll file issues: - This doesn't currently publish the generated Glean baseline ETL queries and views; we'll need to update that logic to use probe-scraper metadata rather than listing tables in BigQuery (due to creds) to integrate it. - Docs publishing should reference this generated content rather
2021-02-10 17:42:58 +03:00
generated-sql/