2014-10-07 02:08:35 +04:00
|
|
|
TODO
|
|
|
|
|
-----
|
|
|
|
|
#### UI
|
|
|
|
|
* Backfill wizard
|
2014-10-11 23:57:43 +04:00
|
|
|
|
2014-10-07 02:08:35 +04:00
|
|
|
#### Write unittests
|
|
|
|
|
* For each existing operator
|
2014-10-11 23:57:43 +04:00
|
|
|
|
2015-01-08 22:26:49 +03:00
|
|
|
#### Command line
|
|
|
|
|
* `airflow task_state dag_id task_id YYYY-MM-DD`
|
|
|
|
|
|
2014-10-07 02:08:35 +04:00
|
|
|
#### More Operators!
|
2015-02-03 02:23:42 +03:00
|
|
|
* Sandbox BashOperator
|
2015-01-19 09:39:38 +03:00
|
|
|
* S3Sensor
|
2014-10-07 02:08:35 +04:00
|
|
|
* BaseDataTransferOperator
|
|
|
|
|
* File2MySqlOperator
|
|
|
|
|
* PythonOperator
|
|
|
|
|
* DagTaskSensor for cross dag dependencies
|
|
|
|
|
* PIG
|
2014-10-11 23:57:43 +04:00
|
|
|
|
2014-10-07 02:08:35 +04:00
|
|
|
#### Macros
|
|
|
|
|
* Previous execution timestamp
|
2015-02-07 20:43:59 +03:00
|
|
|
* Previous ds
|
2014-10-07 02:08:35 +04:00
|
|
|
* ...
|
2014-10-11 23:57:43 +04:00
|
|
|
|
2015-02-07 20:43:59 +03:00
|
|
|
#### Frontend
|
|
|
|
|
* Graph view: color coding by operator + legend
|
|
|
|
|
|
2014-10-07 02:08:35 +04:00
|
|
|
#### Backend
|
2015-02-07 20:43:59 +03:00
|
|
|
* Callbacks
|
|
|
|
|
* Set default args at the DAG level?
|
|
|
|
|
* Prevent timezone chagne on import
|
2015-01-13 19:29:47 +03:00
|
|
|
* Add decorator to timeout imports on master process [lib](https://github.com/pnpnpn/timeout-decorator)
|
2015-01-09 00:50:11 +03:00
|
|
|
* Mysql port should carry through (using default now)
|
2015-01-20 19:52:17 +03:00
|
|
|
* Make authentication universal
|
2014-10-11 23:57:43 +04:00
|
|
|
|
2014-10-07 02:08:35 +04:00
|
|
|
#### Misc
|
|
|
|
|
* Write an hypervisor, looks for dead jobs without a heartbeat and kills
|
|
|
|
|
|
|
|
|
|
#### Wishlist
|
|
|
|
|
* Support for cron like synthax (0 * * * ) using croniter library
|
