gecko-dev/taskcluster/docs
Gregory Szorc 0e12f1cc60 Bug 1318200 - Introduce task graph filtering; r=dustin
Previously, we ran a single "target task" function to mutate the full
task graph into a subset based on input parameters (try syntax,
repository being built for, etc). This concept is useful. But
the implementation was limiting because we could only have a single
"target tasks" function.

This commit introduces the concept of "filters." They conceptually
do the same thing as "target tasks methods" but you can run more than
1 of them.

Filters are simply functions that examine an input graph+parameters
and emit nodes that should be retained. Filters, like target tasks
methods, are defined via decorated functions in a module.

TaskGraphGenerator has been converted to use filters. The list of
defined filters can be defined in the parameters dict passed into
TaskGraphGenerator. A default filter list is provided in decision.py.

The intent is to eventually convert target tasks to filters. Until
that happens, we always run the registered target tasks method via
a filter proxy function.

No new tests have been added because we don't yet have any
functionality relying explicitly on filters. Tests will be added in
a subsequent commit once we add a new filter.

While I was here, I also snuck in some logging on the size of the
graphs.

MozReview-Commit-ID: ERn2hIYbMRp

--HG--
extra : rebase_source : 36b8e86aa64b2f52b03b31b5497759b0009fb921
2016-11-17 15:53:30 -08:00
..
attributes.rst Bug 1305242 - Disable linux64-jsdcov and linux64-ccov from running on try with '-u all'. r=dustin 2016-09-24 14:31:25 -04:00
caches.rst Bug 1312475 - Add a version parameter to checkouts cache; r=dustin 2016-10-24 09:58:01 -07:00
docker-images.rst Bug 1288567 - Add special Dockerfile syntax to add arbitrary files to context; r=dustin 2016-07-21 16:51:30 -07:00
how-tos.rst Bug 1275774 - Fix taskcluster how-to docs example command r=dustin 2016-09-16 13:46:03 -07:00
index.rst Bug 1307571: more detail on loading tasks and transforms; r=kmoir 2016-10-04 21:06:17 +00:00
kinds.rst Bug 1306641 - Remove TaskCluster automation related to b2g; r=dustin 2016-09-30 09:21:09 -07:00
loading.rst Bug 1307571: more detail on loading tasks and transforms; r=kmoir 2016-10-04 21:06:17 +00:00
parameters.rst Bug 1318200 - Introduce task graph filtering; r=dustin 2016-11-17 15:53:30 -08:00
reference.rst Bug 1307571: move reference docs to a sub-TOC; r=mshal 2016-10-04 19:59:05 +00:00
taskgraph.rst Bug 1318200 - Introduce task graph filtering; r=dustin 2016-11-17 15:53:30 -08:00
transforms.rst Bug 1307571: more detail on loading tasks and transforms; r=kmoir 2016-10-04 21:06:17 +00:00
yaml-templates.rst Bug 1307571: dissuade use of templates; r=Callek 2016-10-04 21:05:43 +00:00