incubator-airflow/TODO.md

TODO

UI

• Backfill wizard

Write unittests

• For each existing operator

Command line

• airflow task_state dag_id task_id YYYY-MM-DD

More Operators!

• Sandbox the BashOperator
• S3Sensor
• BaseDataTransferOperator
• File2MySqlOperator
• PythonOperator
• DagTaskSensor for cross dag dependencies
• PIG

Macros

• Previous execution timestamp
• Previous ds
• ...

Frontend

Backend

• Callbacks
• Set default args at the DAG level?
• Prevent timezone chagne on import
• Add decorator to timeout imports on master process lib
• Mysql port should carry through (using default now)
• Make authentication universal

Misc

• Write an hypervisor, looks for dead jobs without a heartbeat and kills

Wishlist

• Support for cron like synthax (0 * * * ) using croniter library