Граф коммитов

102 Коммитов

Автор SHA1 Сообщение Дата
Anna Scholtz 87f1a4e19f Update tests 2020-10-05 12:59:58 -07:00
Anna Scholtz 06233819ab Remove sql/ directory 2020-10-05 12:59:58 -07:00
Anna Scholtz 9827b725e0 Alternate project support for query scheduling 2020-10-05 12:59:58 -07:00
Frank Bertsch efb49cf738
Dryrun stored procedures (#1367)
* Dryrun stored procedures

* Reformat SQL

* Update tests for reformatted sql

* Fix doc format again

* Let black run past max-line-length

Black does not mandate line-length, it only tries to adhere to it.
For that reason, we can't have flake8 fail at too-long line length.

https://black.readthedocs.io/en/stable/the_black_code_style.html#line-length

* Why doesn't pydoctest run locally?

* Apply suggestions from code review

Co-authored-by: Anna Scholtz <anna@scholtzan.net>

Co-authored-by: Anna Scholtz <anna@scholtzan.net>
2020-10-01 16:48:28 -04:00
Frank Bertsch 3caa5eb382
Event analysis udfs (#1343)
* WIP: Event analysis UDFs

* WIP: Some stored procedures for working with events

* Add UDF descriptions && move datasets

* Add capabilities for testing procedures

* Add procedures for creating funnel views

* Dryrun stored procedures

* Add support for count queries to events view

* Remove legacy stored procedures

* Remove dryruns

* Add explicit count support

* Change SQL to work around sqlparse bug

See https://github.com/andialbrecht/sqlparse/issues/583

* Run black

* Reformat SQL

* Reformat assertion

* Fix doc issues

* Add stored procedure test file

* Flake8 issue

* Reformat last file

* Ignore pre-colon whitespace failure

* Also ignore line breaks before binary operators

* Apply suggestions from code review

Co-authored-by: Anna Scholtz <anna@scholtzan.net>

* Fix sql lint

Co-authored-by: Anna Scholtz <anna@scholtzan.net>
2020-09-29 16:33:38 -04:00
Anna Scholtz 268ea08e81 Add tests for UDF description publishing 2020-09-16 10:40:42 -07:00
Daniel Thorn 26c67c7ee8
Upgrade to pytest 6.0.1 (#1281)
Also upgrade and fix pytest plugins
2020-09-02 11:30:14 -07:00
Anna Scholtz 6c7ad57b55 Prefix test data UDFs with test_ 2020-09-02 10:24:38 -07:00
Anna Scholtz 3bdb418588 Add tests for parsing UDFs 2020-09-02 10:24:38 -07:00
Anna Scholtz 1d5483afb5 Update DAG generation tests 2020-08-21 11:10:58 -07:00
Anna Scholtz 9b8172eb1e Update integration tests for query scheduling 2020-08-18 12:31:38 -07:00
Anna Scholtz 36048c950d Update integration tests 2020-07-23 07:54:10 -07:00
Anna Scholtz 2500b1b3e3 Fix public data DAG 2020-07-13 09:24:25 -07:00
Anna Scholtz eef4adc913 Remove sensor pool for now 2020-07-09 13:08:17 -07:00
Anna Scholtz 4d43055bfb Update DAG tests 2020-07-09 13:08:17 -07:00
Jeff Klukas c806d2e730
Inject function names and descriptions into docs (#1129)
* Inject function names and descriptions into docs
2020-07-07 14:47:03 -04:00
Anna Scholtz ba001067c7 Add tests for validating doc examples 2020-07-06 13:55:19 -07:00
Anna Scholtz c5d727c336 DAG for daily experiments clients 2020-07-06 11:27:26 -07:00
Anna Scholtz b9f8ce078f Add multipart task tests 2020-07-06 11:27:26 -07:00
Anna Scholtz ea28f65eb7 Make use of mkdocs autogenerate feature 2020-07-02 13:37:38 -07:00
Anna Scholtz 85b078ac2e Update tests 2020-07-02 13:37:38 -07:00
Anna Scholtz eefc59f28c Sort dict in jinja 2020-07-02 13:37:38 -07:00
Anna Scholtz 22d2540e2f Fix test formatting 2020-07-02 13:37:38 -07:00
Anna Scholtz d802ae3810 Add doc generation tests 2020-07-02 13:37:38 -07:00
Anna Scholtz 63192b386c Fix DAG integration test for mode=reschedule 2020-06-09 10:05:39 -07:00
Anna Scholtz b370c4710d DAG for vrbrowser queries 2020-06-05 10:52:12 -07:00
Anna Scholtz 76e6a185b9 Add check_existence to ExternalTaskSensor 2020-06-05 10:52:12 -07:00
Anna Scholtz 2ddfb5343e Pass arguments as list to bigquery_etl_query in generated DAGs 2020-06-04 12:37:51 -07:00
Anna Scholtz 3a8d1ceb18 --append_table argument 2020-06-04 12:37:51 -07:00
Anna Scholtz 79e10b7ec2 Add tests for task arguments 2020-06-04 12:37:51 -07:00
Anna Scholtz 16ec4a9e22 Update DAG generation tests 2020-06-03 14:39:51 -07:00
Anna Scholtz 3bf1951ce2 Add tests for preventing duplicate dependencies 2020-06-03 10:06:32 -07:00
Anna Scholtz c7ccc32e0e Public data JSON DAG query file in template 2020-06-02 11:04:32 -07:00
Anna Scholtz 7f39c2ec66 Add tests for public data JSON DAG generation 2020-06-02 11:04:32 -07:00
Anna Scholtz 91464b933c Refactor tests 2020-06-02 11:04:32 -07:00
Anna Scholtz 3b58d1d546 Update DAG test expected output 2020-05-29 09:40:30 -04:00
Anna Scholtz 48e32ce765 Add tests 2020-05-28 14:12:24 -07:00
Anna Scholtz b7b5f1ebca Test generating DAG with dependencies 2020-05-28 14:12:24 -07:00
Anna Scholtz 72a60c3bb3 Fix tests 2020-05-28 14:12:24 -07:00
Anna Scholtz 368020f37d Generate Airflow code for tasks 2020-05-28 14:12:24 -07:00
Anna Scholtz 33183abff2 files_uri field in public metadata 2020-05-12 13:09:08 -07:00
Anna Scholtz 6a9a0ee601 Write files metadata to /files 2020-05-12 13:09:08 -07:00
Anna Scholtz daebf6d1e7 Remove .gz from exported JSON files 2020-05-01 10:48:01 -07:00
Anna Scholtz de36a0ddee Update integration tests 2020-04-29 14:18:53 -07:00
Anna Scholtz 082a0202ab Test DAG config parsing 2020-04-22 13:48:04 -07:00
Anna Scholtz e17a089672 Public endpoint URL 2020-04-16 17:08:55 -07:00
Anna Scholtz e2e749f6bb Add last_updated to GCS datasets metadata 2020-04-16 17:08:55 -07:00
Anna Scholtz 760b45b02a Metadata lowercase check 2020-04-16 11:38:59 -07:00
Anna Scholtz adfe1791ca Metadata mixed numbers and letters labels tests 2020-04-16 11:38:59 -07:00
Anna Scholtz 1b9af73379 Refactor public_data tests 2020-04-16 11:38:59 -07:00
Anna Scholtz 4ef377d521 Update tests 2020-04-16 11:38:59 -07:00
Anna Scholtz b67d430ba1 Add tests for parsing metadata 2020-04-16 11:38:59 -07:00