gecko-dev/taskcluster/docs
Gregory Szorc b547239226 Bug 1312475 - Add a version parameter to checkouts cache; r=dustin
ff5a4bab0813 (bug 1311791) and 332a08725ed0 (bug 1292071) changed
behavior of the VCS caches. First, the store cache / path was merged
into the checkouts cache. Then the path of the Mercurial shared store
was moved within the cache to always be rooted at the cache root.

Caches are shared across tasks. Tasks can execute on any revision
configured to use a cache. So, when interacting with caches, it is
important to consider how every revision configured to use that
cache will interact with it.

Take this scenario for example.

A worker executes a task where the hg shared store is rooted at
/home/worker/checkouts/src/hg-shared. Then the worker executes a
task where the hg shared store is rooted at
/home/worker/checkouts/hg-store. `hg robustcheckout` will see the
checkout from the first task. But then it sees that the store
it is pointing to is at an unexpected location
(checkouts/src/hg-shared instead of checkouts/hg-store). `hg
robustcheckout` aggressively normalizes state to ensure
consistency. So when it sees this mismatch, it blows away the
checkout and creates one from checkouts/hg-store to replace it.
That's a lot of overhead. And this cycle can repeat itself if
the right combination of revisions run on the worker!

A solution to this problem is to create a clean break from caches
when cache semantics change. In TaskCluster, that means using a
different cache.

This commit introduces a "version" component to the checkouts
cache name. By doing so, we create a clean break from all previous
caches, ensuring all revisions this point forward won't encounter
an hg shared store at an unexpected location. This also paves the
road for easily making additional clean breaks in the future.

MozReview-Commit-ID: JT8yuULKpch

--HG--
extra : rebase_source : 2e5d321e4314ff7543423d3c7837b770b7c8a3a3
2016-10-24 09:58:01 -07:00
..
attributes.rst Bug 1305242 - Disable linux64-jsdcov and linux64-ccov from running on try with '-u all'. r=dustin 2016-09-24 14:31:25 -04:00
caches.rst Bug 1312475 - Add a version parameter to checkouts cache; r=dustin 2016-10-24 09:58:01 -07:00
docker-images.rst Bug 1288567 - Add special Dockerfile syntax to add arbitrary files to context; r=dustin 2016-07-21 16:51:30 -07:00
how-tos.rst Bug 1275774 - Fix taskcluster how-to docs example command r=dustin 2016-09-16 13:46:03 -07:00
index.rst Bug 1307571: more detail on loading tasks and transforms; r=kmoir 2016-10-04 21:06:17 +00:00
kinds.rst Bug 1306641 - Remove TaskCluster automation related to b2g; r=dustin 2016-09-30 09:21:09 -07:00
loading.rst Bug 1307571: more detail on loading tasks and transforms; r=kmoir 2016-10-04 21:06:17 +00:00
parameters.rst Backed out changeset fc1ed3fd8584 (bug 1291473) on suspicion of breaking decision tasks 2016-08-08 13:15:37 -07:00
reference.rst Bug 1307571: move reference docs to a sub-TOC; r=mshal 2016-10-04 19:59:05 +00:00
taskgraph.rst Bug 1307571: fix lost action-tasks docs; r=martianwars 2016-10-04 19:48:31 +00:00
transforms.rst Bug 1307571: more detail on loading tasks and transforms; r=kmoir 2016-10-04 21:06:17 +00:00
yaml-templates.rst Bug 1307571: dissuade use of templates; r=Callek 2016-10-04 21:05:43 +00:00