Граф коммитов

22 Коммитов

Автор SHA1 Сообщение Дата
Ricky Stewart d259591a1c Bug 1569059 - Run 'mach bootstrap' with Python 3 r=firefox-build-system-reviewers,mshal,Callek
Differential Revision: https://phabricator.services.mozilla.com/D60898

--HG--
extra : moz-landing-system : lando
2020-02-07 18:12:23 +00:00
Tom Prince d490d292f2 Bug 1507860: [taskgraph] Move most classes to use attrs; r=dustin
This moves most of the low-hanging fruit to use attrs.

Differential Revision: https://phabricator.services.mozilla.com/D1141

--HG--
extra : moz-landing-system : lando
2018-11-21 23:50:04 +00:00
Tom Prince 8d4b163999 Backed out changeset d1d4e3bf3945 (Bug 1507860) for causing decision task failures a=backout
--HG--
extra : amend_source : 8217e2126eb8a3be15bef2761001140be9c3f1d0
2018-11-20 21:30:33 -07:00
Tom Prince d1c904d968 Bug 1507860: [taskgraph] Move most clases to use attrs; r=dustin
This moves most of the low-hanging fruit to use attrs.

Differential Revision: https://phabricator.services.mozilla.com/D1141

--HG--
extra : moz-landing-system : lando
2018-11-20 21:52:24 +00:00
Dustin J. Mitchell 91f4fe8c61 Bug 1398277: special-case retriggering of tasks not in the taskgraph; r=bstack
This will apply to cron tasks, action tasks, and decision tasks.  It is a
distinct retrigger implementation because (a) we do not want to follow
dependencies, and (b) it takes a lot of scopes to create a decision task, so we
need to limit access to this action.

MozReview-Commit-ID: 21DVSiagcrO

--HG--
extra : rebase_source : 6f027e349e245e4aa4dbed81145a0a5d75218cb1
extra : histedit_source : eff99aee5a0e7496b0734748b29739480eb0e3fb
2018-07-04 02:46:59 +00:00
Brian Stack a455ebaa63 Bug 1434959 - Copy taskgraph before optimizing in actions r=dustin
MozReview-Commit-ID: 7uPM7X4vS3F

--HG--
extra : rebase_source : ca34daf158196ab38fe0f45f83ed6914fe5f2a51
2018-02-05 11:15:44 -08:00
Dustin J. Mitchell 449d528cf3 Bug 1333255: rename taskgraph.task to taskgraph.loader; r=jonasfj
MozReview-Commit-ID: 6aPdGbxn0D1

--HG--
rename : taskcluster/taskgraph/task/__init__.py => taskcluster/taskgraph/loader/__init__.py
rename : taskcluster/taskgraph/task/balrog.py => taskcluster/taskgraph/loader/balrog.py
rename : taskcluster/taskgraph/task/beetmover.py => taskcluster/taskgraph/loader/beetmover.py
rename : taskcluster/taskgraph/task/beetmover_checksums.py => taskcluster/taskgraph/loader/beetmover_checksums.py
rename : taskcluster/taskgraph/task/checksums_signing.py => taskcluster/taskgraph/loader/checksums_signing.py
rename : taskcluster/taskgraph/task/post_build.py => taskcluster/taskgraph/loader/post_build.py
rename : taskcluster/taskgraph/task/repacks.py => taskcluster/taskgraph/loader/repacks.py
rename : taskcluster/taskgraph/task/signing.py => taskcluster/taskgraph/loader/signing.py
rename : taskcluster/taskgraph/task/test.py => taskcluster/taskgraph/loader/test.py
rename : taskcluster/taskgraph/task/transform.py => taskcluster/taskgraph/loader/transform.py
rename : taskcluster/taskgraph/task/base.py => taskcluster/taskgraph/task.py
extra : rebase_source : 42a183bae9aedfa04876d99a59119fd08bbf7d73
2017-03-09 19:00:49 -05:00
Dustin J. Mitchell d46264d259 Bug 1333255: and then there was only one Task class; r=jonasfj
Note that the to_json method prefers the taskgraph's dependencies information
(edges) to that from the task.dependencies entries. At a few points in
task-graph generation, these values differ, although that is expected (for
example, the full task set contains no edges, but that information is still in
task.dependencies). Unifying that representation leads to some difficulty with
task transforms that reach into the dependency tree (beetmover), so the
different representations are left as-is.

MozReview-Commit-ID: GeW8HNwFA9Z

--HG--
extra : rebase_source : 549773e05e18371a399612d9bceccffc29be8cf2
2017-03-09 23:14:30 -05:00
Mike Hommey 3854c3f71d Bug 1341214 - Add a small API to handle taskcluster queue and index requests. r=dustin
Various modules under taskcluster are doing ad-hoc url formatting or
requests to taskcluster services. While we could use the taskcluster
client python module, it's kind of overkill for the simple requests done
here. So instead of vendoring that module, create a smaller one with
a limited set of functions we need.

This changes the behavior of the get_artifact function to return a
file-like object when the file is neither a json nor a yaml, but that
branch was never used (and was actually returning an unassigned
variable, so it was broken anyways).

At the same time, make the function that does HTTP requests more
error-resistant, using urllib3's Retry with a backoff factor.

Also add a function that retrieves the list of artifacts, that while
currently unused, will be used by `mach artifact` shortly.

--HG--
extra : rebase_source : d7ef633e8e5041dc8450f3ff2f3751c85f144cdc
2017-02-17 12:04:48 +09:00
Mike Hommey 28cdcbdebb Bug 1341214 - Define GECKO in a single location. r=dustin
Instead of every file trying to get the top source directory having an
ad-hoc definition that gets wrong if the files gets moved around for
some reason, define it in a more central location.

--HG--
extra : rebase_source : 1a0cbea267193f6b388b88b36166353e20ac8569
2017-02-17 11:56:12 +09:00
Carsten "Tomcat" Book 197fbb6eb9 Backed out changeset d8122277e9fd (bug 1341214) for causing on m-c problems in vp tc tasks 2017-02-22 15:33:42 +01:00
Carsten "Tomcat" Book 42bc96ae3d Backed out changeset 5ffd6c7264ce (bug 1341214) 2017-02-22 15:33:17 +01:00
Mike Hommey 3e79befa4b Bug 1341214 - Add a small API to handle taskcluster queue and index requests. r=dustin
Various modules under taskcluster are doing ad-hoc url formatting or
requests to taskcluster services. While we could use the taskcluster
client python module, it's kind of overkill for the simple requests done
here. So instead of vendoring that module, create a smaller one with
a limited set of functions we need.

This changes the behavior of the get_artifact function to return a
file-like object when the file is neither a json nor a yaml, but that
branch was never used (and was actually returning an unassigned
variable, so it was broken anyways).

At the same time, make the function that does HTTP requests more
error-resistant, using urllib3's Retry with a backoff factor.

Also add a function that retrieves the list of artifacts, that while
currently unused, will be used by `mach artifact` shortly.

--HG--
extra : rebase_source : 06777dea62e884f546a5b951baad80fd8aec1f1e
2017-02-17 12:04:48 +09:00
Mike Hommey f99718e272 Bug 1341214 - Define GECKO in a single location. r=dustin
Instead of every file trying to get the top source directory having an
ad-hoc definition that gets wrong if the files gets moved around for
some reason, define it in a more central location.

--HG--
extra : rebase_source : 06fa06d47732223e19b0201f8791fdbffdc9ee03
2017-02-17 11:56:12 +09:00
Hammad Akhtar 1964df62df Bug 1323633 - Ensure that task graphs do not contain duplicate Treeherder symbols, also consider treeherder.collection.keys(); r=dustin
MozReview-Commit-ID: 3F0BHQQmSOg

--HG--
extra : rebase_source : 52ba5d93d689e5ca64cee04dd013dcd79919049d
2016-12-13 11:51:53 +05:30
Phil Ringnalda 4aef1bde99 Backed out changeset 6034929c3e4a (bug 1302802) for decision task bustage
CLOSED TREE
2016-12-13 10:01:05 -08:00
Hammad Akhtar b92e9673e7 Bug 1302802 - Ensure that task graphs do not contain duplicate Treeherder symbols; r=dustin
MozReview-Commit-ID: LO2fEbxzZH2

--HG--
extra : rebase_source : 0949a6ff585401fd6f7197b5aca1fe95c96f8a10
2016-12-13 11:51:53 +05:30
Kalpesh Krishna df3e5c70ed Bug 1304428 - Adding a from_json test in decision task. r=jlund
MozReview-Commit-ID: 7QgfSutjoFZ

--HG--
extra : rebase_source : 5a84e2bf54135e615ba2ed365abef3c60be99bae
2016-09-23 19:26:39 +05:30
Kalpesh Krishna e5474c6adb Bug 1285755 - Adding a from_json function to TaskGraph and each Task subclass. r=dustin
MozReview-Commit-ID: 8fmALSP8nDs

--HG--
extra : rebase_source : 52729a77206498ca32e716ae3774e21f6329f805
2016-07-11 22:39:04 +05:30
Dustin J. Mitchell c6a548be78 Bug 1280231: rename types.py to taskgraph.py; r=Callek
MozReview-Commit-ID: Jf6CVyFCGMI

--HG--
rename : taskcluster/taskgraph/types.py => taskcluster/taskgraph/taskgraph.py
extra : rebase_source : 12e30313eb1fd4062c0be9d869460644ae949019
extra : intermediate-source : 4b1d94901b4d09c13031982c28eec6a48f938c71
extra : source : e85765be39d61d7c0df9831e16930328effad554
2016-06-20 19:11:52 +00:00
Wes Kocher c9059e6a53 Backed out 3 changesets (bug 1280231) for decision task failures CLOSED TREE
Backed out changeset 4b1d94901b4d (bug 1280231)
Backed out changeset 7898d1ab1afc (bug 1280231)
Backed out changeset ba5cbf4e06a5 (bug 1280231)

--HG--
rename : taskcluster/taskgraph/taskgraph.py => taskcluster/taskgraph/types.py
2016-06-27 15:45:44 -07:00
Dustin J. Mitchell 1a1a14c19c Bug 1280231: rename types.py to taskgraph.py; r=Callek
MozReview-Commit-ID: Jf6CVyFCGMI

--HG--
rename : taskcluster/taskgraph/types.py => taskcluster/taskgraph/taskgraph.py
extra : source : e85765be39d61d7c0df9831e16930328effad554
extra : histedit_source : 732dc9a6b9206be1bb2a3e4f1d507d0001588f6c
2016-06-20 19:11:52 +00:00