incubator-airflow/TODO.md

TODO

UI

• User login / security
• Tree view: remove dummy root node
• Backfill wizard

Write unittests

• For each existing operator

Command line

• airflow task_state dag_id task_id YYYY-MM-DD

More Operators!

• HIVE
• BaseDataTransferOperator
• File2MySqlOperator
• PythonOperator
• DagTaskSensor for cross dag dependencies
• PIG

Macros

• Previous execution timestamp
• ...

Backend

• CeleryExecutor
• Clear should kill running jobs
• Mysql port should carry through (using default now)

Misc

• Write an hypervisor, looks for dead jobs without a heartbeat and kills
• Authentication with Flask-Login and Flask-Principal
• email_on_retry
• Naming for the DatabaseConnection model was shortsighted, the same model can be used for any external connections (FTP, samba, ...), rename the model to Connection.

Wishlist

• Support for cron like synthax (0 * * * ) using croniter library