Maxime
718ebb53d6
Detail
2015-01-30 00:21:33 +00:00
Maxime Beauchemin
ac8a15f3c4
Making sure DAGS_FOLDER is in the PYTHONPATH
2015-01-29 16:19:08 -08:00
Maxime Beauchemin
b24bce83b8
Minor fixes
2015-01-29 16:13:05 -08:00
Maxime Beauchemin
ca7fc9a849
Merge pull request #110 from mistercrunch/rendered
...
Massive refactor + adding rendered template to the UI
2015-01-29 15:13:40 -08:00
Maxime Beauchemin
62ebef26fc
Massive refactore + adding rendered template to the UI
2015-01-29 15:09:55 -08:00
Arthur Wiedmer
7dbcdb5555
Merge pull request #107 from mistercrunch/presto_interval_check
...
[Airflow] [IntervalCheck] Presto Interval Check op
2015-01-29 10:18:07 -08:00
Arthur Wiedmer
d506681dad
[PrestoHook] Change logging level to INFO
...
Simple modification to the logging level for the
PrestoHook
2015-01-29 18:00:57 +00:00
Arthur Wiedmer
c284b8baac
[Airflow] [IntervalCheck] Presto Interval Check op
...
This is an implementation of the PrestoIntervalCheck operator similar to
the one in the internal data-eng library at Airbnb. This operator will
allow to test if variations are within bounds over a period of time
on a week over week or YoY basis.
@mistercrunch
2015-01-29 18:00:29 +00:00
Maxime Beauchemin
e8818ee026
Merge pull request #109 from mistercrunch/adhoc
...
Dilling instead of pickling to allow for functions and modules
2015-01-28 22:15:17 -08:00
Maxime
af52646f0a
Dilling instead of pickling to allow for functions and modules
2015-01-29 06:14:32 +00:00
Maxime Beauchemin
e504c765b3
Merge pull request #108 from mistercrunch/adhoc
...
Task "adhoc" parameter
2015-01-28 21:40:02 -08:00
Maxime
39c1bf9dfe
Make tasks adhoc
2015-01-29 05:37:07 +00:00
Maxime
de6c115d84
Bug fix +v 0.2.3.4
2015-01-29 00:16:42 +00:00
Maxime Beauchemin
0bfcd1a19d
Merge pull request #106 from mistercrunch/template_hook
...
Version 0.2.3.3
2015-01-28 14:29:21 -08:00
Maxime
bb37b68ac3
Version 0.2.3.3
2015-01-28 22:28:22 +00:00
Maxime Beauchemin
178b31e7b3
Merge pull request #105 from mistercrunch/template_hook
...
A few changes around templating to make hivepp templates work
2015-01-28 14:20:54 -08:00
Maxime
45d14c15d8
A few changes around templating to make hivepp templates work
2015-01-28 22:19:06 +00:00
Maxime Beauchemin
e2e3d8e50a
[tree view] when expanding a node, other instances of this node collapses
2015-01-27 11:16:26 -08:00
Maxime
5aaf771657
Version 0.2.3.2
2015-01-27 17:10:08 +00:00
Maxime Beauchemin
dc86ce268e
Merge pull request #103 from mistercrunch/template_www
...
Fixing the "Task Details" page when template location isn't relative to DAG
2015-01-27 08:49:43 -08:00
Maxime Beauchemin
2623e7cac5
Fixing task page when template location isn't relative to DAG
2015-01-27 16:47:53 +00:00
Maxime Beauchemin
9917da8be1
Merge pull request #102 from mistercrunch/ti_key
...
Adding task_instance_key_str to default template macros
2015-01-26 21:32:06 -08:00
Maxime
28b3056192
Adding task_instance_key_str to default template macros
2015-01-26 17:42:30 -08:00
Maxime Beauchemin
e8f9d50c0e
Merge pull request #101 from mistercrunch/clear_kill
...
Clearing running jobs now kills them properly, regardless of the executor
2015-01-25 21:09:45 -08:00
Maxime Beauchemin
75fa6a8f16
Simplifying the approach
2015-01-26 04:41:11 +00:00
Maxime Beauchemin
1c634cfc2d
Kill running jobs when cleared
2015-01-24 21:05:42 -08:00
Maxime
4bdcf7d857
Version 0.2.3.1 for airenv (internal, not pypi)
2015-01-24 16:18:07 +00:00
Arthur Wiedmer
0e24c2d89d
Merge pull request #98 from mistercrunch/closest_ds
...
Closest ds
2015-01-23 15:49:05 -08:00
Arthur Wiedmer
a56d83ea13
Merge pull request #99 from mistercrunch/change_presto_check_fail_condition
...
[presto_check] Changed the failure condition for presto_check
2015-01-23 15:48:56 -08:00
Arthur Wiedmer
78ee12f42b
[presto_check] Changed the return for presto_check
...
I think this make more sense. It will fail if any cell evaluates to
False or on empty records.
2015-01-23 23:36:30 +00:00
Maxime Beauchemin
830e257e35
Version 0.2.3
2015-01-23 13:53:19 -08:00
Maxime Beauchemin
7eee0892e9
Merge pull request #100 from mistercrunch/fix_templating
...
Fixing bug around templating
2015-01-23 13:51:51 -08:00
Maxime
3d5a649bd2
Fixing bug around templating
2015-01-23 21:50:25 +00:00
Maxime
450049ba43
Version 0.2.2
2015-01-23 18:27:45 +00:00
Maxime
40849b8efb
Improving the examples dags a little
2015-01-23 18:26:26 +00:00
Maxime Beauchemin
680b1ca97b
Importing airflow in setup.py wan't a good idea, rolling back
2015-01-22 21:31:57 -08:00
Arthur Wiedmer
53e350f137
[closest_ds macro] linting
...
Following flake8 recs + changing return type of helper function
2015-01-23 01:30:43 +00:00
Arthur Wiedmer
69e298ddd7
[macros] added macro closest_ds_partition
...
Added a hive macro to get the closest ds partition. It can get the
closest right before, the closest after, or either way.
@mistercrunch
2015-01-22 23:19:35 +00:00
Arthur Wiedmer
0ca2df2c18
fixed indent + return obj for get_partitions
2015-01-22 23:19:35 +00:00
Arthur Wiedmer
03b2189df5
closest partition macro
2015-01-22 23:19:35 +00:00
Maxime Beauchemin
53c3e55bd8
Packaging 0.2.1 for Pypi
2015-01-22 10:51:43 -08:00
Maxime Beauchemin
62f06fc8ba
Merge pull request #97 from mistercrunch/template_searchpath
...
Adding template_searchpath attribute to DAG object
2015-01-22 10:21:07 -08:00
Maxime Beauchemin
7c786fd1cc
Adding template_searchpath attribute to DAG object
2015-01-22 10:20:23 -08:00
Maxime Beauchemin
689853a797
Merge pull request #96 from mistercrunch/async_ti_job
...
New RunTaskJob that runs async, implements kill signal
2015-01-21 22:13:01 -08:00
Maxime Beauchemin
4a12bd5838
Adding --local option to run command
2015-01-21 22:04:36 -08:00
Maxime Beauchemin
100198983e
New RunTaskJob that runs async, implements kill signal
2015-01-21 18:14:58 -08:00
Maxime
c67bb2245e
Fixing Text type issue
2015-01-21 06:25:26 +00:00
Maxime
0775b894a4
Specifying version numbers in deps in setup.py
2015-01-21 06:25:26 +00:00
Maxime Beauchemin
e1eb4a8731
Version 0.2
2015-01-20 09:14:59 -08:00
Maxime Beauchemin
7f469ce332
Altering TODO.md
2015-01-20 08:52:17 -08:00