Граф коммитов

10044 Коммитов

Автор SHA1 Сообщение Дата
Maxime 718ebb53d6 Detail 2015-01-30 00:21:33 +00:00
Maxime Beauchemin ac8a15f3c4 Making sure DAGS_FOLDER is in the PYTHONPATH 2015-01-29 16:19:08 -08:00
Maxime Beauchemin b24bce83b8 Minor fixes 2015-01-29 16:13:05 -08:00
Maxime Beauchemin ca7fc9a849 Merge pull request #110 from mistercrunch/rendered
Massive refactor + adding rendered template to the UI
2015-01-29 15:13:40 -08:00
Maxime Beauchemin 62ebef26fc Massive refactore + adding rendered template to the UI 2015-01-29 15:09:55 -08:00
Arthur Wiedmer 7dbcdb5555 Merge pull request #107 from mistercrunch/presto_interval_check
[Airflow] [IntervalCheck] Presto Interval Check op
2015-01-29 10:18:07 -08:00
Arthur Wiedmer d506681dad [PrestoHook] Change logging level to INFO
Simple modification to the logging level for the
PrestoHook
2015-01-29 18:00:57 +00:00
Arthur Wiedmer c284b8baac [Airflow] [IntervalCheck] Presto Interval Check op
This is an implementation of the PrestoIntervalCheck operator similar to
the one in the internal data-eng library at Airbnb. This operator will
allow to test if variations are within bounds over a period of time
on a week over week or YoY basis.

@mistercrunch
2015-01-29 18:00:29 +00:00
Maxime Beauchemin e8818ee026 Merge pull request #109 from mistercrunch/adhoc
Dilling instead of pickling to allow for functions and modules
2015-01-28 22:15:17 -08:00
Maxime af52646f0a Dilling instead of pickling to allow for functions and modules 2015-01-29 06:14:32 +00:00
Maxime Beauchemin e504c765b3 Merge pull request #108 from mistercrunch/adhoc
Task "adhoc" parameter
2015-01-28 21:40:02 -08:00
Maxime 39c1bf9dfe Make tasks adhoc 2015-01-29 05:37:07 +00:00
Maxime de6c115d84 Bug fix +v 0.2.3.4 2015-01-29 00:16:42 +00:00
Maxime Beauchemin 0bfcd1a19d Merge pull request #106 from mistercrunch/template_hook
Version 0.2.3.3
2015-01-28 14:29:21 -08:00
Maxime bb37b68ac3 Version 0.2.3.3 2015-01-28 22:28:22 +00:00
Maxime Beauchemin 178b31e7b3 Merge pull request #105 from mistercrunch/template_hook
A few changes around templating to make hivepp templates work
2015-01-28 14:20:54 -08:00
Maxime 45d14c15d8 A few changes around templating to make hivepp templates work 2015-01-28 22:19:06 +00:00
Maxime Beauchemin e2e3d8e50a [tree view] when expanding a node, other instances of this node collapses 2015-01-27 11:16:26 -08:00
Maxime 5aaf771657 Version 0.2.3.2 2015-01-27 17:10:08 +00:00
Maxime Beauchemin dc86ce268e Merge pull request #103 from mistercrunch/template_www
Fixing the "Task Details" page when template location isn't relative to DAG
2015-01-27 08:49:43 -08:00
Maxime Beauchemin 2623e7cac5 Fixing task page when template location isn't relative to DAG 2015-01-27 16:47:53 +00:00
Maxime Beauchemin 9917da8be1 Merge pull request #102 from mistercrunch/ti_key
Adding task_instance_key_str to default template macros
2015-01-26 21:32:06 -08:00
Maxime 28b3056192 Adding task_instance_key_str to default template macros 2015-01-26 17:42:30 -08:00
Maxime Beauchemin e8f9d50c0e Merge pull request #101 from mistercrunch/clear_kill
Clearing running jobs now kills them properly, regardless of the executor
2015-01-25 21:09:45 -08:00
Maxime Beauchemin 75fa6a8f16 Simplifying the approach 2015-01-26 04:41:11 +00:00
Maxime Beauchemin 1c634cfc2d Kill running jobs when cleared 2015-01-24 21:05:42 -08:00
Maxime 4bdcf7d857 Version 0.2.3.1 for airenv (internal, not pypi) 2015-01-24 16:18:07 +00:00
Arthur Wiedmer 0e24c2d89d Merge pull request #98 from mistercrunch/closest_ds
Closest ds
2015-01-23 15:49:05 -08:00
Arthur Wiedmer a56d83ea13 Merge pull request #99 from mistercrunch/change_presto_check_fail_condition
[presto_check] Changed the failure condition for presto_check
2015-01-23 15:48:56 -08:00
Arthur Wiedmer 78ee12f42b [presto_check] Changed the return for presto_check
I think this make more sense. It will fail if any cell evaluates to
False or on empty records.
2015-01-23 23:36:30 +00:00
Maxime Beauchemin 830e257e35 Version 0.2.3 2015-01-23 13:53:19 -08:00
Maxime Beauchemin 7eee0892e9 Merge pull request #100 from mistercrunch/fix_templating
Fixing bug around templating
2015-01-23 13:51:51 -08:00
Maxime 3d5a649bd2 Fixing bug around templating 2015-01-23 21:50:25 +00:00
Maxime 450049ba43 Version 0.2.2 2015-01-23 18:27:45 +00:00
Maxime 40849b8efb Improving the examples dags a little 2015-01-23 18:26:26 +00:00
Maxime Beauchemin 680b1ca97b Importing airflow in setup.py wan't a good idea, rolling back 2015-01-22 21:31:57 -08:00
Arthur Wiedmer 53e350f137 [closest_ds macro] linting
Following flake8 recs + changing return type of helper function
2015-01-23 01:30:43 +00:00
Arthur Wiedmer 69e298ddd7 [macros] added macro closest_ds_partition
Added a hive macro to get the closest ds partition. It can get the
closest right before, the closest after, or either way.

@mistercrunch
2015-01-22 23:19:35 +00:00
Arthur Wiedmer 0ca2df2c18 fixed indent + return obj for get_partitions 2015-01-22 23:19:35 +00:00
Arthur Wiedmer 03b2189df5 closest partition macro 2015-01-22 23:19:35 +00:00
Maxime Beauchemin 53c3e55bd8 Packaging 0.2.1 for Pypi 2015-01-22 10:51:43 -08:00
Maxime Beauchemin 62f06fc8ba Merge pull request #97 from mistercrunch/template_searchpath
Adding template_searchpath attribute to DAG object
2015-01-22 10:21:07 -08:00
Maxime Beauchemin 7c786fd1cc Adding template_searchpath attribute to DAG object 2015-01-22 10:20:23 -08:00
Maxime Beauchemin 689853a797 Merge pull request #96 from mistercrunch/async_ti_job
New RunTaskJob that runs async, implements kill signal
2015-01-21 22:13:01 -08:00
Maxime Beauchemin 4a12bd5838 Adding --local option to run command 2015-01-21 22:04:36 -08:00
Maxime Beauchemin 100198983e New RunTaskJob that runs async, implements kill signal 2015-01-21 18:14:58 -08:00
Maxime c67bb2245e Fixing Text type issue 2015-01-21 06:25:26 +00:00
Maxime 0775b894a4 Specifying version numbers in deps in setup.py 2015-01-21 06:25:26 +00:00
Maxime Beauchemin e1eb4a8731 Version 0.2 2015-01-20 09:14:59 -08:00
Maxime Beauchemin 7f469ce332 Altering TODO.md 2015-01-20 08:52:17 -08:00