incubator-airflow/TODO.md

#### Roadmap items

* UI page answering "Why isn't this task instance running?"
* Attempt removing DagBag caching for the web server
* Distributed scheduler (supervisors)
  * Get the supervisors to run sensors (as opposed to each sensor taking a slot)
  * Improve DagBag differential refresh
  * Pickle all the THINGS! supervisors maintains fresh, versioned pickles in the database as they monitor for change
* Pre-prod running off of master
* Containment / YarnExecutor / Docker?
* Get s3 logs
* Test and migrate to use beeline instead of the Hive CLI
* Run Hive / Hadoop / HDFS tests in Travis-CI

#### UI

* Backfill form
* Better task filtering int duration and landing time charts (operator toggle, task regex, uncheck all button)
* Add templating to adhoc queries

#### Backend

* Add a run_only_latest flag to BaseOperator, runs only most recent task instance where deps are met
* Raise errors when setting dependencies on task in foreign DAGs
* Add an is_test flag to the run context

#### Wishlist

* Pause flag at the task level
* Increase unit test coverage
* Stats logging interface with support for stats and sqlalchemy to collect detailed information from the scheduler and dag processing times

#### Other

* Deprecate TimeSensor
Updating TODO.md 2016-01-06 05:09:37 +03:00			`#### Roadmap items`
[AIRFLOW-2832] Lint and resolve inconsistencies in Markdown files (#3670) Clean up the Markdown files and make the formatting consistent 2018-08-01 10:50:23 +03:00
[hotfix] fixing subdag not refreshing properly 2016-01-13 21:41:46 +03:00			`* UI page answering "Why isn't this task instance running?"`
			`* Attempt removing DagBag caching for the web server`
Updating TODO.md 2016-01-06 05:09:37 +03:00			`* Distributed scheduler (supervisors)`
[AIRFLOW-2832] Lint and resolve inconsistencies in Markdown files (#3670) Clean up the Markdown files and make the formatting consistent 2018-08-01 10:50:23 +03:00			`* Get the supervisors to run sensors (as opposed to each sensor taking a slot)`
			`* Improve DagBag differential refresh`
			`* Pickle all the THINGS! supervisors maintains fresh, versioned pickles in the database as they monitor for change`
Updating TODO.md 2016-01-06 05:09:37 +03:00			`* Pre-prod running off of master`
			`* Containment / YarnExecutor / Docker?`
			`* Get s3 logs`
			`* Test and migrate to use beeline instead of the Hive CLI`
			`* Run Hive / Hadoop / HDFS tests in Travis-CI`

Moving TODO list out of README.md 2014-10-07 02:08:35 +04:00			`#### UI`
[AIRFLOW-2832] Lint and resolve inconsistencies in Markdown files (#3670) Clean up the Markdown files and make the formatting consistent 2018-08-01 10:50:23 +03:00
Adding a doc entry for Connections 2015-06-03 02:47:46 +03:00			`* Backfill form`
Editing TODO 2015-07-11 18:16:37 +03:00			`* Better task filtering int duration and landing time charts (operator toggle, task regex, uncheck all button)`
Updating TODO list 2015-04-24 17:35:54 +03:00			`* Add templating to adhoc queries`
First stab at the sphinx documentation 2014-10-11 23:57:43 +04:00
Moving TODO list out of README.md 2014-10-07 02:08:35 +04:00			`#### Backend`
[AIRFLOW-2832] Lint and resolve inconsistencies in Markdown files (#3670) Clean up the Markdown files and make the formatting consistent 2018-08-01 10:50:23 +03:00
Fix 2 ongoing issues 2015-05-15 02:33:13 +03:00			`* Add a run_only_latest flag to BaseOperator, runs only most recent task instance where deps are met`
Adding item to TODO 2015-05-27 16:28:53 +03:00			`* Raise errors when setting dependencies on task in foreign DAGs`
v1.0.0\! 2015-06-04 06:28:56 +03:00			`* Add an is_test flag to the run context`
Moving TODO list out of README.md 2014-10-07 02:08:35 +04:00
			`#### Wishlist`
[AIRFLOW-2832] Lint and resolve inconsistencies in Markdown files (#3670) Clean up the Markdown files and make the formatting consistent 2018-08-01 10:50:23 +03:00
Changing default delimiter value for HiveCliHook.load_file to a comma 2015-04-06 18:36:55 +03:00			`* Pause flag at the task level`
Updating TODO list 2015-04-24 17:35:54 +03:00			`* Increase unit test coverage`
Adding visibility as to which dag is pickleable 2016-01-07 00:00:17 +03:00			`* Stats logging interface with support for stats and sqlalchemy to collect detailed information from the scheduler and dag processing times`
Adding plugins_folder to sys.path 2015-10-01 02:52:13 +03:00
Removing done items from TODO.md 2015-11-14 03:29:00 +03:00			`#### Other`
[AIRFLOW-2832] Lint and resolve inconsistencies in Markdown files (#3670) Clean up the Markdown files and make the formatting consistent 2018-08-01 10:50:23 +03:00
			`* Deprecate TimeSensor`