Граф коммитов

70 Коммитов

Автор SHA1 Сообщение Дата
Tom Prince b8f29771e0 Bug 1469610: [taskgraph] Use `action.taskGroupId` to set `ACTION_TASK_GROUP_ID`; r=dustin
This makes it consistent with everywhere else in `.taskcluster.yml` where we
refer to the action task group.

Differential Revision: https://phabricator.services.mozilla.com/D1707

--HG--
extra : moz-landing-system : lando
2018-09-07 17:30:12 +00:00
Cosmin Sabou 5daea4b632 Backed out changeset 3db3193ec938 (bug 1486970) for braking the nightlies with signing issues. a=backout 2018-08-30 03:49:42 +03:00
Justin Wood 32546f18c2 Bug 1486970 - Create revision and pushlog-id index routes for cron decision tasks. r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D4501

--HG--
extra : moz-landing-system : lando
2018-08-29 15:40:37 +00:00
Dustin J. Mitchell 91f4fe8c61 Bug 1398277: special-case retriggering of tasks not in the taskgraph; r=bstack
This will apply to cron tasks, action tasks, and decision tasks.  It is a
distinct retrigger implementation because (a) we do not want to follow
dependencies, and (b) it takes a lot of scopes to create a decision task, so we
need to limit access to this action.

MozReview-Commit-ID: 21DVSiagcrO

--HG--
extra : rebase_source : 6f027e349e245e4aa4dbed81145a0a5d75218cb1
extra : histedit_source : eff99aee5a0e7496b0734748b29739480eb0e3fb
2018-07-04 02:46:59 +00:00
Dustin J. Mitchell 9b317841af Bug 1470886 - only produce tasks for recognized tasks_for; r=tomprince
This carefully maintains tasks as an array by putting the conditional inside of
that array.  Note that `[{$if: 'false', then: 1}]` returns `[]` in JSON-e --
the missing `else` branch is treated as a missing array element.

MozReview-Commit-ID: 9ARIxW3gfWo

--HG--
extra : rebase_source : 304ce14ccc9abc9f4f48f3179adb981b5fe55a0e
2018-07-03 18:07:42 +00:00
Brindusan Cristian df2e2473fb Backed out changeset 66956b121b93 (bug 1470886) for signin exceptions. CLOSED TREE 2018-07-03 21:39:52 +03:00
Dustin J. Mitchell af478ed758 Bug 1470886 - only produce tasks for recognized tasks_for r=tomprince
This also updates actions to "see through" the conditional.  Soon we won't be
using kind=task, so this hack will be less important.

MozReview-Commit-ID: Aa6g9ZqoPMa

--HG--
extra : rebase_source : 7434f2047c48ff0d1fa6de9e3419fb4e0bf0bb72
2018-06-25 18:21:03 +00:00
Coroiu Cristina 54208e7808 Backed out changeset 63a6f0d75b74 (bug 1470886) for failing Geko decision task on a CLOSED TREE 2018-07-02 17:55:30 +03:00
Dustin J. Mitchell 087a4c8924 Bug 1470886 - only produce tasks for recognized tasks_for r=tomprince
MozReview-Commit-ID: Aa6g9ZqoPMa

--HG--
extra : rebase_source : e7df4e66ee2d8ca1feadb845163a0d3c8544537f
2018-06-25 18:21:03 +00:00
Dustin J. Mitchell af304cf4c7 Bug 1437958 - notify taskcluster-notifications@ on action task failure; r=bstack
MozReview-Commit-ID: Fe3gUUmJkny

--HG--
extra : rebase_source : 563dba25c2fbd2b10ebd3ffc78572deaa414cdf6
2018-06-11 15:20:37 +00:00
Aki Sasaki 2f37d56e67 bug 1432364 - remove comment about docker sha allowlists. r=gps
In bug 1328719, we added support for rebuilding the decision/action task definition via json-e.
In bug 1459705, we're killing support for cot v1, which relied on docker sha allowlists and decision task command parsing. Because we no longer use the docker sha allowlists, let's remove this comment.

MozReview-Commit-ID: HntXmoSzUij

--HG--
extra : rebase_source : 3869737cc8b2cce75965235657c2a3bc427952df
2018-05-29 12:45:21 -07:00
Dustin J. Mitchell 2ed7526fb7 Bug 1415868 - change ACTION_TASK_GROUP_ID to be the taskGroupId of the target task; r=aki
MozReview-Commit-ID: 8Hkga4MmmtG

--HG--
extra : rebase_source : 6512a6c2188affdf9cf13e795f36eebbeefee2ef
2018-05-18 22:16:43 +00:00
Dustin J. Mitchell aeb0a55c25 Bug 1415868 - remove ACTION_TASK r=jonasfj,tomprince
For kind=hook, the spec doesn't include this value as it's untrustworthy.

For kind=task, it's still untrustworthy, but there is no privilege escalation
so that's not important. Still, it dramatically expands the size of the task
definition.

MozReview-Commit-ID: 6scQ2ZwxP10

--HG--
extra : rebase_source : 4dc34390a510091ddc26023755992995fe358e47
2018-04-27 22:24:42 +00:00
Dustin J. Mitchell edbae96f0c Bug 1415868 - include in-tree:hook-action:..{level}-* in decision task scopes; r=jonasfj,tomprince
The inclusion of this scope limits the actions initiated within this decision
task's task group.

MozReview-Commit-ID: E5gP9UR3pdu

--HG--
extra : rebase_source : 335a4f3bb15bdf3a9bd9c75a692fabb1417a5461
2018-04-25 21:41:54 +00:00
Gregory Szorc 0eb25614c9 Bug 1456326 - Use latest decision image for decision task; r=dustin
As part of this we also change the cache name to ensure that
the new image uses a separate cache from the old image.

MozReview-Commit-ID: J4DmgupnyS

--HG--
extra : rebase_source : 44c0ee3de8b9a7a4854c462e2796662c998c02b0
2018-04-23 18:01:22 -07:00
Tom Prince 0de4a5fd3d Bug 1455448: Don't include `firefox` in the decision task index; r=dustin,mshal,rail,Callek a=release
The decision task is used for everything built as part of a push (for
mozilla-central, this is firefox, devedition and fennec, as well as tasks that
aren't strictly part of any product). Thus, having `firefox` encoded as part of
the decision task doesn't make sense.

This changes the route from
    index.gecko.v2.${repository.project}.latest.firefox.decision
to
    index.gecko.v2.${repository.project}.latest.taskgraph.decision
while leaving the latter for backwards compatability with tools that expect it.

Differential Revision: https://phabricator.services.mozilla.com/D996

--HG--
extra : rebase_source : c4c4691bb4633225e5e37b21982b916f76353e27
extra : source : 6ef1607a3e63250eefbda5333d61fd338c23311d
2018-04-19 15:32:02 -06:00
arthur.iakab 188ae77a0e Backed out changeset 3ff8ce674396 (bug 1447460) on request of tomprince a=backout 2018-04-03 18:30:58 +03:00
Tom Prince d100cc9fd9 Bug 1447460: Don't create a dummy `pushlog-id` index for cron tasks; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D812

--HG--
extra : rebase_source : 8c8f7fb56128c55df436b380cdb78cf3600510f0
2018-02-23 11:34:23 -07:00
Dustin J. Mitchell 56f55d44fc Bug 1437562: only use ..:branch:default role, not :*; r=bstack
MozReview-Commit-ID: FzZpVvYPU5a

--HG--
extra : rebase_source : c84b68800bb252cc356f8fa82214d38423faea57
2018-02-12 18:58:05 +00:00
Aki Sasaki b926a4ca04 bug 1328719 - task.extra.cron + task.payload.env.ACTION_TASK_GROUP_ID. r=bstack r=dustin 2018-01-12 22:17:39 -08:00
Aki Sasaki 81c122ddd6 bug 1328719 - add task.extra.tasks_for to help rebuild the decision task. r=dustin
MozReview-Commit-ID: K5ABhc3AKHK

--HG--
extra : rebase_source : 387e9744488c405619adec5b18c3b31537975845
extra : source : 9182d9f9eb70a31c0777ddd7f82182ed646fd210
2018-01-03 16:16:41 -08:00
Tom Prince d6bdc5ded0 Bug 1424138: Stop sending pulse message to treeherder staging routes; r=camd,dustin
MozReview-Commit-ID: 1F3ekltLgY0

--HG--
extra : rebase_source : 9f363df469fd9c76ae38733d65ee2494fc3abffc
2017-12-07 21:19:00 -07:00
Rail Aliiev 484847938d Bug 1420469 - action task routes use literal "$ownTaskId" r=bstack
MozReview-Commit-ID: CsCtSpvDIip

--HG--
extra : rebase_source : 822c33e424218c3601a92a056a96f2c5c0431a49
extra : source : d951d9282368ea82c8111680a713ea6ebd737426
2017-11-24 12:56:24 -05:00
Rail Aliiev 87f83a95a1 Bug 1409577 - Add static indexes to decision task r=dustin 2017-10-18 11:55:01 -04:00
Mike Hommey 9f15f7d6b2 Bug 1409260 - Remove base-repository exception in .taskcluster.yml. r=dustin,gps
Per the comments in .taskcluster.yml, the exception is there because
some jobs were still using tc-vcs, but they aren't anymore, per bug
1383973.

--HG--
extra : rebase_source : dc81fd5c0ff4299712206edd272cdc33095bdcde
2017-10-17 14:59:53 +09:00
Brian Stack d3a8b56012 Bug 1406209 - Use .taskcluster.yml for action tasks templates r=dustin,jonasfj
MozReview-Commit-ID: 8I8lIouV6KF

--HG--
extra : rebase_source : 6961105d1a232e93cf2f73db9ca88f8b08278dc0
2017-10-09 18:39:00 -07:00
Dustin J. Mitchell 16488779cd Bug 1394883: use /builds/worker in decision images; r=wcosta
MozReview-Commit-ID: 29cnSAr3zCW

--HG--
extra : rebase_source : dab573ee114729822c5ad9bd2674062f7ee24502
2017-08-30 15:55:35 +00:00
Phil Ringnalda 2c559035f7 Backed out 4 changesets (bug 1394883) for Windows signing chain-of-trust failures
CLOSED TREE

Backed out changeset e3f42eca51c1 (bug 1394883)
Backed out changeset 081f830cf285 (bug 1394883)
Backed out changeset 9426705a05af (bug 1394883)
Backed out changeset 3a579a5054ef (bug 1394883)

MozReview-Commit-ID: 2viO8A8arHd
2017-08-31 20:02:34 -07:00
Dustin J. Mitchell aafeb9d9fd Bug 1394883: use /builds/worker in decision images; r=wcosta
MozReview-Commit-ID: 29cnSAr3zCW

--HG--
extra : rebase_source : dab573ee114729822c5ad9bd2674062f7ee24502
2017-08-30 15:55:35 +00:00
Gregory Szorc 6bf25db065 Bug 1390700 - Use sparse checkouts for decision task; r=dustin
The updated Docker image contains robustcheckout and run-task support
for sparse checkouts, which are obvious prerequisites.

We change the cache name so sparse and non-sparse checkouts don't
use the same working directory. If we didn't do this, tasks running
from images with old Mercurial clients or without a sparse aware
robustcheckout would fail.

The effect of using a sparse checkout is that we reduce the number
of files in the checkout from ~234,000 to ~3,600. This reduces time
for a fresh checkout from several dozen seconds to under 2s.

MozReview-Commit-ID: IJz794g8ZKH

--HG--
extra : source : 9923fffd4f64a1aa9d762e6027e0e2424a19c49c
2017-08-23 12:09:00 -07:00
Gregory Szorc a22927dbb3 Backed out changeset 9923fffd4f64 (bug 1390700) for somehow breaking chain of trust on some Windows builds
CLOSED TREE

--HG--
extra : amend_source : e039e6840e52ee3186f4c8c0ae20d75cdccdee5a
2017-08-24 21:42:18 -07:00
Gregory Szorc d4da1b9397 Bug 1390700 - Use sparse checkouts for decision task; r=dustin
The updated Docker image contains robustcheckout and run-task support
for sparse checkouts, which are obvious prerequisites.

We change the cache name so sparse and non-sparse checkouts don't
use the same working directory. If we didn't do this, tasks running
from images with old Mercurial clients or without a sparse aware
robustcheckout would fail.

The effect of using a sparse checkout is that we reduce the number
of files in the checkout from ~234,000 to ~3,600. This reduces time
for a fresh checkout from several dozen seconds to under 2s.

MozReview-Commit-ID: IJz794g8ZKH

--HG--
extra : rebase_source : d262c8314381a136cf5cdc5c33669c8c61818d1d
2017-08-23 12:09:00 -07:00
Gregory Arndt 85a855ffff Bug 1391288 - Rebuild decision task image with new robustcheckout r=dustin,gps
MozReview-Commit-ID: J53XXqBQsJw

--HG--
extra : rebase_source : bca5f697f049a6a3f85168aaa667ae7509e60243
2017-08-17 14:32:42 -05:00
Dustin J. Mitchell b17efe62bb Bug 1389850: use per-level decision and image workers; r=bstack
MozReview-Commit-ID: BoUuPRUgGnm

--HG--
extra : rebase_source : 93b3fa521acd08e2ef91b47e80fbba42a94bb154
2017-08-16 13:23:13 +00:00
Dustin J. Mitchell b5bdf8d825 Bug 1328727: revert to --base-repository=https://hg.mozilla.org/mozilla-central; r=gps
MozReview-Commit-ID: BMCVrtyooKV
2017-07-25 01:26:41 +00:00
Dustin J. Mitchell b910cd6125 Bug 1328727: use json-e for cron decision tasks too; r=aki,jonasfj
Changes to cron decision tasks:
 - drops some unnecessary routes
 - drops tags.createdForUser: nobody@..
 - more use of environment variables within the command line

MozReview-Commit-ID: 9zoqFvwrBRs

--HG--
extra : rebase_source : 77e17089b67e5d72360d5ecb617887b7a71457fe
2017-07-21 18:08:06 +00:00
Dustin J. Mitchell 268e98b0cb Bug 1328727: use a version-1 .taskcluster.yml; r=aki,jonasfj
This makes a slight change to the resulting decision task, by putting the
comment in an environment variable. This avoids the need to perform shell
quoting (which mozilla-taskcluster was doing a poor job of anyway).

MozReview-Commit-ID: 4MRhJKDIZkk

--HG--
extra : rebase_source : 7fd4a55c574d7542825a9a2a6f37aba0b4fbec1d
2017-07-21 16:05:52 +00:00
Brian Stack 6b7f0bdd44 Bug 1380391 - Index decision tasks under pushlog_id r=dustin
MozReview-Commit-ID: 9q3iHqJ0OSb

--HG--
extra : rebase_source : 231cad344c879636b270ceef20638712c3af4134
2017-07-12 10:56:02 -07:00
Brian Stack bce402d182 Bug 591688 - Notify when decision task fails r=dustin,gps
This uses the email provided by mozilla-taskcluster to find who to
email about failed decision tasks. It also adds some validation of
the try syntax that we've previously ignored.

Any platforms or build types specified in try sytax that don't exist
in the full task graph will throw an error.


MozReview-Commit-ID: JOKkLle7hEe

--HG--
extra : rebase_source : 65299c95c60bcb3c6a295b1f8f2f18477c2852db
2017-04-12 21:01:46 -07:00
Aki Sasaki 171f7116e8 bug 1350045 - add warning to decision docker image line. r=philor 2017-03-25 12:10:32 -07:00
Dustin J. Mitchell 5b87de297b Bug 1350045: rebuild the decision image to use the newest run-task; r=jonasfj
MozReview-Commit-ID: DeRoLfDjquc

--HG--
extra : rebase_source : 9a1f4ff66d784be38dee0c8483e239856c0fe0f4
2017-03-23 19:48:32 +00:00
Dustin J. Mitchell 05dcbf1e9f Bug 1334810: temporarily revert {{owner}}; r=garndt
MozReview-Commit-ID: FhwatSpSxDe

--HG--
extra : rebase_source : f6583854df2bfe20c1b351752a78d3c76ac040e0
2017-02-07 16:18:19 +00:00
Dustin J. Mitchell b8d8f8a712 Bug 1252948: support for periodic taskgraphs; r=Callek,jonasfj,kmoir
This adds `.cron.yml` and a new mach command to interpret it.  While
functionality is limited to nightlies right now, there is room to expand to
more diverse periodic tasks.  Let your imagination run wild!

MozReview-Commit-ID: KxQkaUbsjQs

--HG--
extra : rebase_source : ddf0a1eadae5a1169c0ead7bcb7b9ce61b255fbf
2017-01-18 19:45:53 +00:00
Dustin J. Mitchell 17794b1e7d Bug 1252948: remove unused --revision-hash; r=garndt
MozReview-Commit-ID: CN6RNDaERJ2

--HG--
extra : rebase_source : 6c22b989813266a5014db61c9982ce682b70fbb7
2016-12-21 20:54:17 +00:00
Dustin J. Mitchell a9383c1d2c Bug 1269443: remove now-unnecessary scopes; r=bstack
MozReview-Commit-ID: Bbk1MPKZIPW

--HG--
extra : rebase_source : 88a9e6e432262dffda698961b250f840fe8cfc19
2016-09-27 15:57:51 +00:00
Jonas Finnemann Jensen 127e057f26 Bug 1324413 - Lock image content hash for decision task; r=dustin
This will make harder to falsify a decision task.
Notably our validation code only needs to verify that the definition of the
decision task as given here matches what is used in the task definition in
the Chain-Of-Trust artifact, in order to prove that the decision task is
a result of what ran in the tree.

MozReview-Commit-ID: 4SRO7G1nyyL

--HG--
extra : rebase_source : a3b062c5adfa3c2c96a220adf9bd5d2f50d294aa
2016-12-15 17:16:14 -08:00
Jonas Finnemann Jensen 2cd49e189e Bug 1316183 - Compress docker images with zstd. r=dustin
* Compress docker images with zstd
 * Removed need for context.tar from decision task
 * Index images by level rather than project

MozReview-Commit-ID: 4RL4QXNWmpd

--HG--
extra : rebase_source : 677d8030a15af3288866a70fc648a10b22c396a3
2016-11-07 11:26:27 -08:00
Gregory Szorc 1deb8dd0e5 Bug 1311791 - Explicitly declare path to shared hg store; r=dustin
332a08725ed0 changed the store path logic in a quick and crude manner.
The code could lead to multiple shared stores existing on a cache
if checkouts were in different parent directories.

This commit refactors the code to explicitly declare a path to the
shared hg store. This restores the behavior of ensuring there is only
a single shared store per cache.

MozReview-Commit-ID: 19Aa1QVrVQ8

--HG--
extra : rebase_source : f74c0ab9cba2bf18e335f24c86dd095335961723
2016-10-20 12:56:43 -07:00
Aki Sasaki 608368610f bug 1298553 - enable chain of trust generation in the decision task. r=dustin
MozReview-Commit-ID: 7lmGt8weVgd

--HG--
extra : rebase_source : 231ff3fa94ef245399cd251b4684d2c8b1379642
2016-09-27 12:45:22 -07:00
Chris Manchester 2c2a464982 Bug 1252235 - Make try syntax available to mozharness from TaskCluster through an environment variable. r=armenzg
MozReview-Commit-ID: HIVIXPQXnQs

--HG--
extra : rebase_source : aa6ed39fdaa5bec568fabc562319f3a2ed4f4c47
2016-08-29 16:33:24 -07:00