* Revert "Revert "Path Filtering in CI (#4939)""
This reverts commit d6189a7641.
* Revert "Revert "Run SQL checks when requirements change (#5030)""
This reverts commit 3991a2574b.
* Revert "Revert "Add parameter to skip stage depoys in CI (#5035)""
This reverts commit c4c651d0c5.
* run-all CI workflow
* Use conditionals in jobs
* Add deploy parameter and use yaml references for conditions
* Add backfill validation
* Push tags for commits on generated-sql branch
* Update .circleci/config.yml
Co-authored-by: Alexander <anicholson@mozilla.com>
---------
Co-authored-by: Alexander <anicholson@mozilla.com>
* pyproject.toml for bqetl
* Correctly resolve SQL generators from package
* CircleCI config to publish tagged versions to PyPI
* Get version from git tags
* Verify the format of the original SQL, not the generated SQL.
The generated SQL gets reformatted by `bqetl query render`.
* Format all SQL.
* Quote column names containing Jinja expressions to prevent `bqetl format` causing invalid SQL.
* Adjust indentation of some comments to align with the formatted SQL.
* Refactor final `SELECT` in `telemetry_derived.clients_first_seen_v2` to work better with `bqetl format` SQL formatting.
* Fix trailing line comments breaking inline block formatting.
* Fix leading whitespace before Jinja comments not being preserved.
* Add `schema.yaml` for `firefox_ios_derived.baseline_clients_yearly_v1`.
So the `deploy-changes-to-stage` CI can work for the downstream `firefox_ios.baseline_clients_yearly` view.
* Add `schema.yaml` for `firefox_accounts_derived/fxa_users_services_daily_v1`.
So the `dry-run-sql` CI can work for the downstream `firefox_accounts_derived.fxa_users_services_last_seen_v1` ETL.
* Correct `schema.yaml` and `init.sql` for `firefox_accounts_derived.fxa_users_last_seen_v1`.
So the `dry-run-sql` CI can work for the downstream `firefox_accounts_derived.fxa_users_last_seen_v1` ETL.
* Fully qualify table reference in `init.sql` for `firefox_accounts_derived.fxa_users_last_seen_v1`.
So the table dependency will get detected by the `deploy-changes-to-stage` CI to deploy it so the `dry-run-sql` CI can work for the `init.sql` file.
* Improve `JinjaComment` inheritance and docstring.
* Implement `Line.ends_with_line_comment` property and refactor `inline_block_format()`.
* Minimize previous PR diff comments when CI posts a new diff comment.
* Update Node image to latest version available from CircleCI and pin Node packages.
* Add output_dir to command dag generate.
* output_dir to command dag generate.
* output_dir to command dag generate.
---------
Co-authored-by: Lucia Vargas <lvargas@mozilla.com>
* DENG-850 Retrieve FALSE instead of NULL in the in metadata when there isn't first_session or metrics ping.
* DENG-850 Unitest for no first session ping.
* DENG-850 syntax fix
* DENG-850 Tests for first session ping, and no baseline ping.
* DENG-850 Tests suite.
* DENG-850 YAML fixes.
* DENG-850 Adjustment to the case of reported first_session and metrics ping. The unitests are adjusted to get the value for reported pings.
* DENG-850 Add sample id to test.
---------
Co-authored-by: Lucia Vargas <lvargas@mozilla.com>
Anna Scholtz
Winnie Chan
Arkadiusz Komarzewski
whd
Sean Rose
Daniel Thorn
akkomar
Lucia
Mikaël Ducharme
Alekhya
Alexander