Sebastian Hengst
16d37c8635
Backed out changeset 0d71c0be62de (bug 1342392) for bustage in partial update generator for docker images: recompress.sh not found. r=backout
...
--HG--
rename : taskcluster/docker/partial-update-generator/Dockerfile => taskcluster/docker/funsize-update-generator/Dockerfile
rename : taskcluster/docker/partial-update-generator/Makefile => taskcluster/docker/funsize-update-generator/Makefile
rename : taskcluster/docker/partial-update-generator/README => taskcluster/docker/funsize-update-generator/README
rename : taskcluster/docker/partial-update-generator/dep.pubkey => taskcluster/docker/funsize-update-generator/dep.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha1.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha384.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha1.pubkey => taskcluster/docker/funsize-update-generator/release_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha384.pubkey => taskcluster/docker/funsize-update-generator/release_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/requirements.txt => taskcluster/docker/funsize-update-generator/requirements.txt
rename : taskcluster/docker/partial-update-generator/runme.sh => taskcluster/docker/funsize-update-generator/runme.sh
rename : taskcluster/docker/partial-update-generator/scripts/funsize.py => taskcluster/docker/funsize-update-generator/scripts/funsize.py
rename : taskcluster/docker/partial-update-generator/scripts/mbsdiff_hook.sh => taskcluster/docker/funsize-update-generator/scripts/mbsdiff_hook.sh
2017-09-18 14:15:42 +02:00
Simon Fraser
29f566fbfb
Bug 1342392 Migrate partial update generation in-tree r=rail
...
MozReview-Commit-ID: 84fP48sMYhS
--HG--
rename : taskcluster/docker/funsize-update-generator/Dockerfile => taskcluster/docker/partial-update-generator/Dockerfile
rename : taskcluster/docker/funsize-update-generator/Makefile => taskcluster/docker/partial-update-generator/Makefile
rename : taskcluster/docker/funsize-update-generator/README => taskcluster/docker/partial-update-generator/README
rename : taskcluster/docker/funsize-update-generator/dep.pubkey => taskcluster/docker/partial-update-generator/dep.pubkey
rename : taskcluster/docker/funsize-update-generator/nightly_sha1.pubkey => taskcluster/docker/partial-update-generator/nightly_sha1.pubkey
rename : taskcluster/docker/funsize-update-generator/nightly_sha384.pubkey => taskcluster/docker/partial-update-generator/nightly_sha384.pubkey
rename : taskcluster/docker/funsize-update-generator/release_sha1.pubkey => taskcluster/docker/partial-update-generator/release_sha1.pubkey
rename : taskcluster/docker/funsize-update-generator/release_sha384.pubkey => taskcluster/docker/partial-update-generator/release_sha384.pubkey
rename : taskcluster/docker/funsize-update-generator/requirements.txt => taskcluster/docker/partial-update-generator/requirements.txt
rename : taskcluster/docker/funsize-update-generator/runme.sh => taskcluster/docker/partial-update-generator/runme.sh
rename : taskcluster/docker/funsize-update-generator/scripts/funsize.py => taskcluster/docker/partial-update-generator/scripts/funsize.py
rename : taskcluster/docker/funsize-update-generator/scripts/mbsdiff_hook.sh => taskcluster/docker/partial-update-generator/scripts/mbsdiff_hook.sh
extra : rebase_source : e5a6cc3aafccde8c9e8cd175aafc7e641ca17031
2017-09-15 11:04:35 +01:00
Sebastian Hengst
027402394e
Backed out changeset a43387ee65d7 (bug 1342392) for failing flake8 and py-compat jobs. r=backout
...
--HG--
rename : taskcluster/docker/partial-update-generator/Dockerfile => taskcluster/docker/funsize-update-generator/Dockerfile
rename : taskcluster/docker/partial-update-generator/Makefile => taskcluster/docker/funsize-update-generator/Makefile
rename : taskcluster/docker/partial-update-generator/README => taskcluster/docker/funsize-update-generator/README
rename : taskcluster/docker/partial-update-generator/dep.pubkey => taskcluster/docker/funsize-update-generator/dep.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha1.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha384.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/recompress.sh => taskcluster/docker/funsize-update-generator/recompress.sh
rename : taskcluster/docker/partial-update-generator/release_sha1.pubkey => taskcluster/docker/funsize-update-generator/release_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha384.pubkey => taskcluster/docker/funsize-update-generator/release_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/requirements.txt => taskcluster/docker/funsize-update-generator/requirements.txt
rename : taskcluster/docker/partial-update-generator/runme.sh => taskcluster/docker/funsize-update-generator/runme.sh
rename : taskcluster/docker/partial-update-generator/scripts/funsize.py => taskcluster/docker/funsize-update-generator/scripts/funsize.py
rename : taskcluster/docker/partial-update-generator/scripts/mbsdiff_hook.sh => taskcluster/docker/funsize-update-generator/scripts/mbsdiff_hook.sh
rename : taskcluster/docker/partial-update-generator/scripts/recompress.py => taskcluster/docker/funsize-update-generator/scripts/recompress.py
2017-09-18 13:50:16 +02:00
Simon Fraser
9ba847f43d
Bug 1342392 Migrate partial update generation in-tree r=rail
...
MozReview-Commit-ID: 84fP48sMYhS
--HG--
rename : taskcluster/docker/funsize-update-generator/Dockerfile => taskcluster/docker/partial-update-generator/Dockerfile
rename : taskcluster/docker/funsize-update-generator/Makefile => taskcluster/docker/partial-update-generator/Makefile
rename : taskcluster/docker/funsize-update-generator/README => taskcluster/docker/partial-update-generator/README
rename : taskcluster/docker/funsize-update-generator/dep.pubkey => taskcluster/docker/partial-update-generator/dep.pubkey
rename : taskcluster/docker/funsize-update-generator/nightly_sha1.pubkey => taskcluster/docker/partial-update-generator/nightly_sha1.pubkey
rename : taskcluster/docker/funsize-update-generator/nightly_sha384.pubkey => taskcluster/docker/partial-update-generator/nightly_sha384.pubkey
rename : taskcluster/docker/funsize-update-generator/recompress.sh => taskcluster/docker/partial-update-generator/recompress.sh
rename : taskcluster/docker/funsize-update-generator/release_sha1.pubkey => taskcluster/docker/partial-update-generator/release_sha1.pubkey
rename : taskcluster/docker/funsize-update-generator/release_sha384.pubkey => taskcluster/docker/partial-update-generator/release_sha384.pubkey
rename : taskcluster/docker/funsize-update-generator/requirements.txt => taskcluster/docker/partial-update-generator/requirements.txt
rename : taskcluster/docker/funsize-update-generator/runme.sh => taskcluster/docker/partial-update-generator/runme.sh
rename : taskcluster/docker/funsize-update-generator/scripts/funsize.py => taskcluster/docker/partial-update-generator/scripts/funsize.py
rename : taskcluster/docker/funsize-update-generator/scripts/mbsdiff_hook.sh => taskcluster/docker/partial-update-generator/scripts/mbsdiff_hook.sh
rename : taskcluster/docker/funsize-update-generator/scripts/recompress.py => taskcluster/docker/partial-update-generator/scripts/recompress.py
extra : rebase_source : 5c6e1e909339f58ada48285294d97f3a4de46c28
2017-09-15 11:04:35 +01:00
Wes Kocher
e0340aa82f
Backed out 2 changesets (bug 1342392) for bustage a=backout
...
Backed out changeset b0e86286b173 (bug 1342392)
Backed out changeset 01bf0c29331e (bug 1342392)
MozReview-Commit-ID: 71fcOZ2RgEp
--HG--
rename : taskcluster/docker/partial-update-generator/Dockerfile => taskcluster/docker/funsize-update-generator/Dockerfile
rename : taskcluster/docker/partial-update-generator/Makefile => taskcluster/docker/funsize-update-generator/Makefile
rename : taskcluster/docker/partial-update-generator/README => taskcluster/docker/funsize-update-generator/README
rename : taskcluster/docker/partial-update-generator/dep.pubkey => taskcluster/docker/funsize-update-generator/dep.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha1.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha384.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha1.pubkey => taskcluster/docker/funsize-update-generator/release_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha384.pubkey => taskcluster/docker/funsize-update-generator/release_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/requirements.txt => taskcluster/docker/funsize-update-generator/requirements.txt
rename : taskcluster/docker/partial-update-generator/runme.sh => taskcluster/docker/funsize-update-generator/runme.sh
rename : taskcluster/docker/partial-update-generator/scripts/funsize.py => taskcluster/docker/funsize-update-generator/scripts/funsize.py
rename : taskcluster/docker/partial-update-generator/scripts/mbsdiff_hook.sh => taskcluster/docker/funsize-update-generator/scripts/mbsdiff_hook.sh
2017-09-11 17:35:09 -07:00
Simon Fraser
e47fe41362
Bug 1342392 Move partial update generation in-tree r=dustin,jlorenzo
...
--HG--
rename : taskcluster/docker/funsize-update-generator/Dockerfile => taskcluster/docker/partial-update-generator/Dockerfile
rename : taskcluster/docker/funsize-update-generator/Makefile => taskcluster/docker/partial-update-generator/Makefile
rename : taskcluster/docker/funsize-update-generator/README => taskcluster/docker/partial-update-generator/README
rename : taskcluster/docker/funsize-update-generator/dep.pubkey => taskcluster/docker/partial-update-generator/dep.pubkey
rename : taskcluster/docker/funsize-update-generator/nightly_sha1.pubkey => taskcluster/docker/partial-update-generator/nightly_sha1.pubkey
rename : taskcluster/docker/funsize-update-generator/nightly_sha384.pubkey => taskcluster/docker/partial-update-generator/nightly_sha384.pubkey
rename : taskcluster/docker/funsize-update-generator/release_sha1.pubkey => taskcluster/docker/partial-update-generator/release_sha1.pubkey
rename : taskcluster/docker/funsize-update-generator/release_sha384.pubkey => taskcluster/docker/partial-update-generator/release_sha384.pubkey
rename : taskcluster/docker/funsize-update-generator/requirements.txt => taskcluster/docker/partial-update-generator/requirements.txt
rename : taskcluster/docker/funsize-update-generator/runme.sh => taskcluster/docker/partial-update-generator/runme.sh
rename : taskcluster/docker/funsize-update-generator/scripts/funsize.py => taskcluster/docker/partial-update-generator/scripts/funsize.py
rename : taskcluster/docker/funsize-update-generator/scripts/mbsdiff_hook.sh => taskcluster/docker/partial-update-generator/scripts/mbsdiff_hook.sh
2017-09-11 09:55:52 +01:00
Sebastian Hengst
21826b4be4
Backed out 2 changesets (bug 1342392) for adding .orig file and flake lint failures. r=backout on a CLOSED TREE
...
Backed out changeset bf0bcdc7482e (bug 1342392)
Backed out changeset 7f5ae5ff1181 (bug 1342392)
--HG--
rename : taskcluster/docker/partial-update-generator/Dockerfile => taskcluster/docker/funsize-update-generator/Dockerfile
rename : taskcluster/docker/partial-update-generator/Makefile => taskcluster/docker/funsize-update-generator/Makefile
rename : taskcluster/docker/partial-update-generator/README => taskcluster/docker/funsize-update-generator/README
rename : taskcluster/docker/partial-update-generator/dep.pubkey => taskcluster/docker/funsize-update-generator/dep.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha1.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha384.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha1.pubkey => taskcluster/docker/funsize-update-generator/release_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha384.pubkey => taskcluster/docker/funsize-update-generator/release_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/requirements.txt => taskcluster/docker/funsize-update-generator/requirements.txt
rename : taskcluster/docker/partial-update-generator/runme.sh => taskcluster/docker/funsize-update-generator/runme.sh
rename : taskcluster/docker/partial-update-generator/scripts/funsize.py => taskcluster/docker/funsize-update-generator/scripts/funsize.py
rename : taskcluster/docker/partial-update-generator/scripts/mbsdiff_hook.sh => taskcluster/docker/funsize-update-generator/scripts/mbsdiff_hook.sh
2017-09-11 10:38:08 +02:00
Simon Fraser
71165165c4
Bug 1342392 Move partial update generation in-tree r=dustin,jlorenzo
2017-09-11 09:24:10 +01:00
Brian Stack
257aa1c23c
Bug 1384729 - Move actions into taskgraph dir r=dustin
...
MozReview-Commit-ID: HK5MR8Xw3On
--HG--
rename : taskcluster/actions/__init__.py => taskcluster/taskgraph/actions/__init__.py
rename : taskcluster/actions/add-new-jobs.py => taskcluster/taskgraph/actions/add-new-jobs.py
rename : taskcluster/actions/hello-action.py => taskcluster/taskgraph/actions/hello-action.py
rename : taskcluster/actions/registry.py => taskcluster/taskgraph/actions/registry.py
rename : taskcluster/actions/retrigger.py => taskcluster/taskgraph/actions/retrigger.py
rename : taskcluster/actions/run_missing_tests.py => taskcluster/taskgraph/actions/run_missing_tests.py
rename : taskcluster/actions/test-retrigger-action.py => taskcluster/taskgraph/actions/test-retrigger-action.py
rename : taskcluster/actions/util.py => taskcluster/taskgraph/actions/util.py
extra : source : 9368bd8045136706950cde7cf718fda5492499e8
extra : histedit_source : f52597f12cb247124ee6080241ac9c741fc53e49
2017-07-27 10:47:37 -07:00
Dustin J. Mitchell
cf34f7579a
Bug 1382707: fix typo 'tsak_id'; r=bstack
...
MozReview-Commit-ID: 2PhnJojQK8I
--HG--
extra : rebase_source : 21d752f5630286979cded265f7e5bf046e71c81d
2017-07-20 19:47:32 +00:00
Dustin J. Mitchell
6386989138
Bug 1382707: add ./mach taskgraph test-action-callback; r=bstack
...
MozReview-Commit-ID: 64kBJGLarY3
--HG--
extra : rebase_source : 95d55e94e792e7477810ab9fd68701d4452e6320
2017-07-20 17:11:28 +00:00
Andrew Halberstadt
ce93f45e61
Bug 1380338 - Convert taskgraph unit tests to the |mach python-test| framework, r=dustin
...
These tests can now be run with:
./mach python-test taskcluster/taskgraph
or:
./mach python-test taskcluster
They can now run in parallel by passing in -j.
MozReview-Commit-ID: JXeZV8B04Sf
--HG--
extra : rebase_source : 7427f96facaf75e6b6fcca532027c68fb6c1a1a3
2017-07-12 10:47:14 -04:00
Sebastian Hengst
3174048fe9
Backed out changeset 54e4545b0fe0 (bug 1380338) for breaking spidermonkey pkg due to failing to process taskgraph/test/python.ini. r=backout
2017-07-12 19:18:46 +02:00
Andrew Halberstadt
7ec26c47a2
Bug 1380338 - Convert taskgraph unit tests to the |mach python-test| framework, r=dustin
...
These tests can now be run with:
./mach python-test taskcluster/taskgraph
or:
./mach python-test taskcluster
They can now run in parallel by passing in -j.
MozReview-Commit-ID: JXeZV8B04Sf
--HG--
extra : rebase_source : a8bb8c21d4c9722bf630c426a780f856fffc8cdb
2017-07-12 10:47:14 -04:00
Andrew Halberstadt
7ac6ca27c6
Bug 1378212 - Default to grabbing 'parameters.yml' file from latest mozilla-central decision task, r=dustin
...
MozReview-Commit-ID: 1993ISgb1Dn
--HG--
extra : rebase_source : cac58e5129fc05b702a1724b50082e0a2f1c87ee
2017-07-04 16:10:05 -04:00
Dustin J. Mitchell
76cf6b7b0f
Bug 1351011: remove unused triggered_by property; r=Callek
...
The purpose of this parameter has been superseded by the `include_nightly`
property.
MozReview-Commit-ID: 4iXQsv9Drqg
--HG--
extra : rebase_source : c94142282909a88c29fe6809d87721bef1f198c2
2017-03-27 20:10:08 +00:00
Dustin J. Mitchell
335fa26ed0
Bug 1333255: introduce graph morphs, use them to make index tasks; r=jonasfj
...
Graph morphs modify the graph after optimization, without changing its meaning.
In this case, that means adding index tasks that will insert paths into the
index beyond the relatively limited number afforded in task.routes.
MozReview-Commit-ID: AJy4exX7q2v
--HG--
extra : rebase_source : d61e7462defd41e7112739fb057edb493f495430
extra : source : c580568ed47c1ed2af40d98b47fbb0d136e63060
2017-03-07 20:39:27 +00:00
Mike Hommey
3854c3f71d
Bug 1341214 - Add a small API to handle taskcluster queue and index requests. r=dustin
...
Various modules under taskcluster are doing ad-hoc url formatting or
requests to taskcluster services. While we could use the taskcluster
client python module, it's kind of overkill for the simple requests done
here. So instead of vendoring that module, create a smaller one with
a limited set of functions we need.
This changes the behavior of the get_artifact function to return a
file-like object when the file is neither a json nor a yaml, but that
branch was never used (and was actually returning an unassigned
variable, so it was broken anyways).
At the same time, make the function that does HTTP requests more
error-resistant, using urllib3's Retry with a backoff factor.
Also add a function that retrieves the list of artifacts, that while
currently unused, will be used by `mach artifact` shortly.
--HG--
extra : rebase_source : d7ef633e8e5041dc8450f3ff2f3751c85f144cdc
2017-02-17 12:04:48 +09:00
Jonas Finnemann Jensen
b77f334748
Bug 1341727 - Setup logging in ./mach taskgraph action-callback. r=dustin,wlach
...
MozReview-Commit-ID: LLSU87IofRh
--HG--
extra : rebase_source : 81450062c2b7fa37708d6cdba05a91db91018db9
2017-02-23 18:33:38 -08:00
Carsten "Tomcat" Book
42bc96ae3d
Backed out changeset 5ffd6c7264ce (bug 1341214)
2017-02-22 15:33:17 +01:00
Mike Hommey
3e79befa4b
Bug 1341214 - Add a small API to handle taskcluster queue and index requests. r=dustin
...
Various modules under taskcluster are doing ad-hoc url formatting or
requests to taskcluster services. While we could use the taskcluster
client python module, it's kind of overkill for the simple requests done
here. So instead of vendoring that module, create a smaller one with
a limited set of functions we need.
This changes the behavior of the get_artifact function to return a
file-like object when the file is neither a json nor a yaml, but that
branch was never used (and was actually returning an unassigned
variable, so it was broken anyways).
At the same time, make the function that does HTTP requests more
error-resistant, using urllib3's Retry with a backoff factor.
Also add a function that retrieves the list of artifacts, that while
currently unused, will be used by `mach artifact` shortly.
--HG--
extra : rebase_source : 06777dea62e884f546a5b951baad80fd8aec1f1e
2017-02-17 12:04:48 +09:00
Jonas Finnemann Jensen
24c8b38973
Bug 1332506 - Treeherder actions defined in-tree. r=dustin
...
Framework for defining actions in-tree that can be displayed
and triggered from Treeherder.
MozReview-Commit-ID: 3rvwgy2i4xu
--HG--
extra : rebase_source : beca394f4337aae4ab149e4db810352f57ec4988
2017-01-31 15:34:05 -08:00
Brian Stack
d572c9e41f
Bug 1289824 - Add "add-talos" taskgraph action r=jmaher
...
MozReview-Commit-ID: A5KVIgAZccV
--HG--
extra : rebase_source : 9801af1f0652d39a2e75b6c60261c0cea8137f80
2017-01-11 11:13:19 -05:00
Dustin J. Mitchell
b8d8f8a712
Bug 1252948: support for periodic taskgraphs; r=Callek,jonasfj,kmoir
...
This adds `.cron.yml` and a new mach command to interpret it. While
functionality is limited to nightlies right now, there is room to expand to
more diverse periodic tasks. Let your imagination run wild!
MozReview-Commit-ID: KxQkaUbsjQs
--HG--
extra : rebase_source : ddf0a1eadae5a1169c0ead7bcb7b9ce61b255fbf
2017-01-18 19:45:53 +00:00
Dustin J. Mitchell
17794b1e7d
Bug 1252948: remove unused --revision-hash; r=garndt
...
MozReview-Commit-ID: CN6RNDaERJ2
--HG--
extra : rebase_source : 6c22b989813266a5014db61c9982ce682b70fbb7
2016-12-21 20:54:17 +00:00
Brian Stack
aa3683d105
Bug 1289823 - Add backfilling as an action-task r=armenzg,dustin
...
MozReview-Commit-ID: HALwE6Q0Lch
--HG--
extra : rebase_source : de9329c46bb9d50e44d29181095577326e039b73
2016-12-07 13:33:20 -10:00
Gregory Szorc
bd86442e13
Bug 1318200 - Obtain target tasks method from parameters; r=dustin
...
Previously, all callers outside of tests that passed
"target_tasks_method" to TaskGraphGenerator all used the same pattern
of looking for a key in the parameters and calling a function in
the target_tasks module.
Future commits will refactor how target tasks graph work. To
make the transition easier, we move the logic for obtaining the
target tasks method into TaskGraphGenerator.
MozReview-Commit-ID: 3QU09iGhoXh
--HG--
extra : rebase_source : fbcc31d705c4b0e148aa3709ddcb18ad99953231
2016-11-17 16:29:51 -08:00
Dustin J. Mitchell
b5ab76194d
Bug 1302786: add help message for mach taskgraph --tasks-regex r=me
...
MozReview-Commit-ID: EK4GqfMhUA4
2016-11-17 23:46:25 +00:00
Hammad Akhtar
688be53397
Bug 1302786 - Support filtering output from task-graph generation; r=dustin
...
MozReview-Commit-ID: 7efKKRgvX3r
--HG--
extra : rebase_source : c4a4ad8793c7ea63f42fb1f1e3a69089211adf31
extra : source : c4def8be4e01e4dc9de0a7fc24678de963b8aefd
2016-11-18 04:38:28 +05:30
Jonas Finnemann Jensen
d83197756c
Bug 1316446 - Improve mach taskcluster-load-image r=gps
...
MozReview-Commit-ID: 3Y8fI5WXP1Y
--HG--
extra : rebase_source : a6411fd161bc9222e4a6c788f077d7d9b1fada35
2016-11-10 18:05:52 -08:00
Jonas Finnemann Jensen
2cd49e189e
Bug 1316183 - Compress docker images with zstd. r=dustin
...
* Compress docker images with zstd
* Removed need for context.tar from decision task
* Index images by level rather than project
MozReview-Commit-ID: 4RL4QXNWmpd
--HG--
extra : rebase_source : 677d8030a15af3288866a70fc648a10b22c396a3
2016-11-07 11:26:27 -08:00
Dustin J. Mitchell
aaabbac964
Bug 1296842: check parameters; r=jmaher
...
MozReview-Commit-ID: 1JCpufowNHD
--HG--
extra : rebase_source : 3409f417070751615d799cbda3f99d8e9029dda3
2016-11-07 19:13:40 +00:00
Jordan Lund
a5114317a5
Bug 1277595 - Add a --triggered-by=nightly flag to taskgraph, r=dustin
...
MozReview-Commit-ID: 3ipPgeFTWFu
--HG--
extra : rebase_source : 7908cf9138b924e32dd1e72fe2af43eba0366179
2016-09-02 10:29:07 -07:00
Jordan Lund
0a3dc9bf3a
backed out Bug 1277595, revs d5d26aa0f369, 42ab74605817, c1aa2a15b4eb, 32a569f4df06, dee2532bdc95, 5809a56922ed CLOSED TREE
...
* backed out Bug 1277595 - rev: d5d26aa0f369
* backed out Bug 1277595 - rev: 42ab74605817
* backed out Bug 1277595 - rev: c1aa2a15b4eb
* backed out Bug 1277595 - rev: 32a569f4df06
* backed out Bug 1277595 - rev: dee2532bdc95
* backed out Bug 1277595 - rev: 5809a56922ed
--HG--
extra : rebase_source : 06eb6b59fcf558ed67d7db707d27b8fbd6137c7b
extra : amend_source : 0ca4e52b486b73e82127077595fb83e77aaaa55f
2016-09-01 09:56:54 -07:00
amiyaguchi@mozilla.com
c503809166
Bug 1277595 - Add a --triggered-by=nightly flag to taskgraph, r=dustin
...
MozReview-Commit-ID: DztkFP8nCwc
--HG--
extra : rebase_source : 35bf7740541674614459574e44e70cbd258fa7a1
2016-09-01 09:20:51 -07:00
Dustin J. Mitchell
f7a9bbac26
Bug 1293733: accept pushdate from command line; r=garndt
...
MozReview-Commit-ID: BrGiowlMVCa
--HG--
extra : rebase_source : e47b9e18b9dbc9e617f9bad165318a74c4e96e36
extra : source : fc1ed3fd8584161ae4693bd1c956e8254368b6bc
2016-07-13 18:50:50 +00:00
Dustin J. Mitchell
e91ee0ef70
Bug 1293397: fix fake to make tests pass? r=armenzg
...
MozReview-Commit-ID: AuQBk2w8Ka1
2016-08-08 21:03:38 +00:00
Gregory Szorc
e2deca67fe
Bug 1290620 - Make `mach taskgraph` honor mach logging settings; r=dustin
...
Before, it ignored mach logging settings passed via command line
arguments.
MozReview-Commit-ID: CNckQHrOdX9
--HG--
extra : rebase_source : b4b190e8e2d073e8932799c8d8bedf49b5f3cfd8
2016-07-29 20:37:42 -07:00
Gregory Szorc
d880926e5a
Bug 1290531 - Add mach taskcluster-build-image command; r=dustin
...
Docker image building will soon need to use Python in order to produce
the image build context archive.
As the first step towards this, we introduce a Python function that
calls out to build.sh. We also implement a mach command that calls it
so we can test the functionality.
I'm not keen about introducing a new mach command. I'd prefer to have
a sub-command instead. I'm not sure what all uses
`mach taskcluster-load-image`. Perhaps we could make a `taskcluster`
top-level command. Or perhaps we could fold these image commands into
`mach taskgraph`? Either way, the mach side of this isn't terribly
important to the commit series: most of the code will live inside a
Python module outside of mach.
MozReview-Commit-ID: AI8p6H4psNh
--HG--
extra : rebase_source : a3a18cbeb05152ab65f2bf152fd2517bbcd8981e
2016-07-29 12:45:25 -07:00
Kalpesh Krishna
7eccb69c1c
Bug 1281062 - Create Action Tasks to schedule new jobs. r=dustin
...
MozReview-Commit-ID: 5MvqLfGrlLC
--HG--
extra : rebase_source : dd954acce8ef9ed2f3b9aa7c5c2cbd916a82f1f1
2016-07-11 22:43:58 +05:30
Dustin J. Mitchell
5c1233316f
Bug 1229178: modify --json output to contain a single object r=mshal
...
MozReview-Commit-ID: DNlxPfQh3o0
--HG--
extra : rebase_source : 0f3f9e73e37efcc53df0e475b8f9cbea21b4de32
2016-06-09 11:15:23 -05:00
Justin Wood
15b23fced1
Bug 1280956 - Use in-tree linter job to flake8 test taskcluster directory. r=dustin
...
MozReview-Commit-ID: FsWmAnnycZ2
--HG--
extra : rebase_source : 04a32cea2de133cb75472092cffb8a215f7dc603
2016-06-20 21:06:55 -04:00
Dustin J. Mitchell
ac6f514b7f
Bug 1277413: add a task to run taskgraph unit tests; r=Callek
...
MozReview-Commit-ID: n8122F3ocx
--HG--
extra : rebase_source : ea16077da878e9ba7385d021559a8e4341fdc867
2016-06-13 03:37:23 +01:00
Dustin J. Mitchell
271fc2bc85
Bug 1275409: remove taskcluster_graph.image_builder; r=wcosta
...
MozReview-Commit-ID: 21HBtcDVPXC
--HG--
extra : rebase_source : 985d158fdd3c326f422ce6feea1a59c688d48b01
2016-06-06 18:55:10 +00:00
Dustin J. Mitchell
8e8b2fa3df
Bug 1275409: remove testing/taskcluster/mach_commands.py, except 'mach taskcluster-load-image'; r=wcosta
...
MozReview-Commit-ID: BrhXVWT5r8D
--HG--
extra : rebase_source : a6f6296405ed88cb2fda8cb96c229992830d4374
2016-06-04 19:40:35 +00:00
Dustin J. Mitchell
6ea3546a3e
Bug 1277417: output task information in JSON or just labels; r=ahal
...
The JSON output is suitable for processing with `jq` to extract features of
interest.
MozReview-Commit-ID: 5wpV7sXlOz3
--HG--
extra : rebase_source : 4ffb78ab7a85b32e64d10218a4a8841c22e689f8
2016-06-07 03:09:48 +00:00
Dustin J. Mitchell
722b95f979
Bug 1274611: Implement task-graph optimization; r=gps
...
* Implement & document optimization (although legacy kind doesn't do much of it)
* Introduce `optimize_target_tasks` parameter to control whether tasks in the
target set can be optimized (no for try, yes for most other branches)
* Refactor to include resolved taskIds in the optimized task graph
* Include a `label-to-taskid.json` artifact.
* Introduce {'task-reference': '... <dependency-name> ...'} for referring to
parent tasks' taskId.
MozReview-Commit-ID: LWvlWNz49U5
--HG--
extra : rebase_source : 780e0e23d24b268ade33ecdcbccb5081f32aac48
2016-06-05 19:49:41 +00:00
Dustin J. Mitchell
120576c2a9
Bug 1273673: use Python logging for taskgraph generation; r=gps
...
MozReview-Commit-ID: EYI6hGFUWP8
--HG--
extra : rebase_source : 06095357cec152790c6025184e4c7c49e5d03835
2016-05-18 18:02:51 +00:00
Dustin J. Mitchell
05ef600e1c
Bug 1258497: wrap mach Commands in try/except; r=gps
...
MozReview-Commit-ID: FTPDTjw4gR
--HG--
extra : rebase_source : a922f03418d9c03f4018940554a23ed341a4e807
extra : histedit_source : 439fda8e499696cca39dff7e1b436f74541d17bb
2016-05-16 17:44:24 +00:00
Dustin J. Mitchell
cea2249ca3
Bug 1258497: Implement a new taskgraph generation system; r=gps
...
The `taskgraph` package generates TaskCluster task graphs based on collections
of task "kinds". Initially, there is only one kind, the "legacy" kind, which
reads the YAML files from `testing/taskcluster/tasks` to generate the task
graph.
Try syntax is implemented by filtering the tasks in the taskgraph after it has
been created, then extending the result to include any prerequisite tasks.
A collection of `mach taskgraph` subcommands are provided for developers to
extend or debug the task-graph generation process.
MozReview-Commit-ID: 1TJCns4XxZ8
--HG--
rename : testing/taskcluster/docs/index.rst => taskcluster/docs/index.rst
extra : rebase_source : 7b9125281d66044db9bd8e4a1fade16136f384b9
extra : histedit_source : 47640d27080acda0279270babbcf33f5badb0d1c
2016-05-16 22:53:22 +00:00