Anna Scholtz
87f1a4e19f
Update tests
2020-10-05 12:59:58 -07:00
Anna Scholtz
06233819ab
Remove sql/ directory
2020-10-05 12:59:58 -07:00
Anna Scholtz
9827b725e0
Alternate project support for query scheduling
2020-10-05 12:59:58 -07:00
Frank Bertsch
efb49cf738
Dryrun stored procedures ( #1367 )
...
* Dryrun stored procedures
* Reformat SQL
* Update tests for reformatted sql
* Fix doc format again
* Let black run past max-line-length
Black does not mandate line-length, it only tries to adhere to it.
For that reason, we can't have flake8 fail at too-long line length.
https://black.readthedocs.io/en/stable/the_black_code_style.html#line-length
* Why doesn't pydoctest run locally?
* Apply suggestions from code review
Co-authored-by: Anna Scholtz <anna@scholtzan.net>
Co-authored-by: Anna Scholtz <anna@scholtzan.net>
2020-10-01 16:48:28 -04:00
Frank Bertsch
3caa5eb382
Event analysis udfs ( #1343 )
...
* WIP: Event analysis UDFs
* WIP: Some stored procedures for working with events
* Add UDF descriptions && move datasets
* Add capabilities for testing procedures
* Add procedures for creating funnel views
* Dryrun stored procedures
* Add support for count queries to events view
* Remove legacy stored procedures
* Remove dryruns
* Add explicit count support
* Change SQL to work around sqlparse bug
See https://github.com/andialbrecht/sqlparse/issues/583
* Run black
* Reformat SQL
* Reformat assertion
* Fix doc issues
* Add stored procedure test file
* Flake8 issue
* Reformat last file
* Ignore pre-colon whitespace failure
* Also ignore line breaks before binary operators
* Apply suggestions from code review
Co-authored-by: Anna Scholtz <anna@scholtzan.net>
* Fix sql lint
Co-authored-by: Anna Scholtz <anna@scholtzan.net>
2020-09-29 16:33:38 -04:00
Anna Scholtz
268ea08e81
Add tests for UDF description publishing
2020-09-16 10:40:42 -07:00
Daniel Thorn
26c67c7ee8
Upgrade to pytest 6.0.1 ( #1281 )
...
Also upgrade and fix pytest plugins
2020-09-02 11:30:14 -07:00
Anna Scholtz
6c7ad57b55
Prefix test data UDFs with test_
2020-09-02 10:24:38 -07:00
Anna Scholtz
3bdb418588
Add tests for parsing UDFs
2020-09-02 10:24:38 -07:00
Anna Scholtz
1d5483afb5
Update DAG generation tests
2020-08-21 11:10:58 -07:00
Anna Scholtz
9b8172eb1e
Update integration tests for query scheduling
2020-08-18 12:31:38 -07:00
Anna Scholtz
36048c950d
Update integration tests
2020-07-23 07:54:10 -07:00
Anna Scholtz
2500b1b3e3
Fix public data DAG
2020-07-13 09:24:25 -07:00
Anna Scholtz
eef4adc913
Remove sensor pool for now
2020-07-09 13:08:17 -07:00
Anna Scholtz
4d43055bfb
Update DAG tests
2020-07-09 13:08:17 -07:00
Jeff Klukas
c806d2e730
Inject function names and descriptions into docs ( #1129 )
...
* Inject function names and descriptions into docs
2020-07-07 14:47:03 -04:00
Anna Scholtz
ba001067c7
Add tests for validating doc examples
2020-07-06 13:55:19 -07:00
Anna Scholtz
c5d727c336
DAG for daily experiments clients
2020-07-06 11:27:26 -07:00
Anna Scholtz
b9f8ce078f
Add multipart task tests
2020-07-06 11:27:26 -07:00
Anna Scholtz
ea28f65eb7
Make use of mkdocs autogenerate feature
2020-07-02 13:37:38 -07:00
Anna Scholtz
85b078ac2e
Update tests
2020-07-02 13:37:38 -07:00
Anna Scholtz
eefc59f28c
Sort dict in jinja
2020-07-02 13:37:38 -07:00
Anna Scholtz
22d2540e2f
Fix test formatting
2020-07-02 13:37:38 -07:00
Anna Scholtz
d802ae3810
Add doc generation tests
2020-07-02 13:37:38 -07:00
Anna Scholtz
63192b386c
Fix DAG integration test for mode=reschedule
2020-06-09 10:05:39 -07:00
Anna Scholtz
b370c4710d
DAG for vrbrowser queries
2020-06-05 10:52:12 -07:00
Anna Scholtz
76e6a185b9
Add check_existence to ExternalTaskSensor
2020-06-05 10:52:12 -07:00
Anna Scholtz
2ddfb5343e
Pass arguments as list to bigquery_etl_query in generated DAGs
2020-06-04 12:37:51 -07:00
Anna Scholtz
3a8d1ceb18
--append_table argument
2020-06-04 12:37:51 -07:00
Anna Scholtz
79e10b7ec2
Add tests for task arguments
2020-06-04 12:37:51 -07:00
Anna Scholtz
16ec4a9e22
Update DAG generation tests
2020-06-03 14:39:51 -07:00
Anna Scholtz
3bf1951ce2
Add tests for preventing duplicate dependencies
2020-06-03 10:06:32 -07:00
Anna Scholtz
c7ccc32e0e
Public data JSON DAG query file in template
2020-06-02 11:04:32 -07:00
Anna Scholtz
7f39c2ec66
Add tests for public data JSON DAG generation
2020-06-02 11:04:32 -07:00
Anna Scholtz
91464b933c
Refactor tests
2020-06-02 11:04:32 -07:00
Anna Scholtz
3b58d1d546
Update DAG test expected output
2020-05-29 09:40:30 -04:00
Anna Scholtz
48e32ce765
Add tests
2020-05-28 14:12:24 -07:00
Anna Scholtz
b7b5f1ebca
Test generating DAG with dependencies
2020-05-28 14:12:24 -07:00
Anna Scholtz
72a60c3bb3
Fix tests
2020-05-28 14:12:24 -07:00
Anna Scholtz
368020f37d
Generate Airflow code for tasks
2020-05-28 14:12:24 -07:00
Anna Scholtz
33183abff2
files_uri field in public metadata
2020-05-12 13:09:08 -07:00
Anna Scholtz
6a9a0ee601
Write files metadata to /files
2020-05-12 13:09:08 -07:00
Anna Scholtz
daebf6d1e7
Remove .gz from exported JSON files
2020-05-01 10:48:01 -07:00
Anna Scholtz
de36a0ddee
Update integration tests
2020-04-29 14:18:53 -07:00
Anna Scholtz
082a0202ab
Test DAG config parsing
2020-04-22 13:48:04 -07:00
Anna Scholtz
e17a089672
Public endpoint URL
2020-04-16 17:08:55 -07:00
Anna Scholtz
e2e749f6bb
Add last_updated to GCS datasets metadata
2020-04-16 17:08:55 -07:00
Anna Scholtz
760b45b02a
Metadata lowercase check
2020-04-16 11:38:59 -07:00
Anna Scholtz
adfe1791ca
Metadata mixed numbers and letters labels tests
2020-04-16 11:38:59 -07:00
Anna Scholtz
1b9af73379
Refactor public_data tests
2020-04-16 11:38:59 -07:00
Anna Scholtz
4ef377d521
Update tests
2020-04-16 11:38:59 -07:00
Anna Scholtz
b67d430ba1
Add tests for parsing metadata
2020-04-16 11:38:59 -07:00