Граф коммитов

83 Коммитов

Автор SHA1 Сообщение Дата
Tom Prince 4ecf218463 Bug 1525736: [taskgraph] Allow looking up parameters by project for trust-domains other than `gecko`; r=dustin
Previously, this code looked parameters under `gecko.v2`, but that doesn't work
for projects using the out-of-tree taskgraph code, or Thunderbird. This moves
the parameter loading slightly later to vary the index used based on trust domain.

Differential Revision: https://phabricator.services.mozilla.com/D19028

--HG--
extra : moz-landing-system : lando
2019-02-14 21:34:49 +00:00
Tom Prince 9fff567bdd Bug 1524639: [taskgraph] Force yaml to be loaded as unicode; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D18375

--HG--
extra : moz-landing-system : lando
2019-02-04 22:18:57 +00:00
Dustin J. Mitchell c8fe0990f8 Bug 1524358 - get commit message locally, rather than from task parameters r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D18288

--HG--
extra : moz-landing-system : lando
2019-02-01 23:27:48 +00:00
Tom Prince bce106f4b1 Bug 1514087: [taskgraph] Add an option to not optimize target tasks in cron graphs; r=dustin
This allows the target tasks to include cached tasks, which by default, get
optimized out of the graph on on-`try` branches.

Differential Revision: https://phabricator.services.mozilla.com/D15278

--HG--
extra : moz-landing-system : lando
2018-12-26 14:43:34 +00:00
Sebastian Hengst 767c971623 Backed out 21 changesets (bug 1492664) for breaking cron task for nightlies. a=backout
Backed out changeset a7d50dbb2c8e (bug 1492664)
Backed out changeset 2d876c4ece8b (bug 1492664)
Backed out changeset c82285d253de (bug 1492664)
Backed out changeset bf6d089640eb (bug 1492664)
Backed out changeset d9a7f2ce49c3 (bug 1492664)
Backed out changeset 06c466ab4323 (bug 1492664)
Backed out changeset c1ea4a10cc8d (bug 1492664)
Backed out changeset 4c63a04fdd47 (bug 1492664)
Backed out changeset 742b038bb1dd (bug 1492664)
Backed out changeset 911b4b0fb683 (bug 1492664)
Backed out changeset 870c8cec99e5 (bug 1492664)
Backed out changeset 77699b51336b (bug 1492664)
Backed out changeset 29f33f22fd8b (bug 1492664)
Backed out changeset e7f305408708 (bug 1492664)
Backed out changeset 335a92b1f424 (bug 1492664)
Backed out changeset c566f1c8dcdf (bug 1492664)
Backed out changeset c77ae59aba41 (bug 1492664)
Backed out changeset 9c35dd209c6b (bug 1492664)
Backed out changeset a972d6b4434e (bug 1492664)
Backed out changeset 5ea6f03f845e (bug 1492664)
Backed out changeset 0699d3873e44 (bug 1492664)

--HG--
extra : histedit_source : 5cb1f7e50f25d4a875c1a58c86b7dce902e1a89c%2C20f1ab1a843b612cfcc67cf5c6ff745d65abf076
2018-12-20 12:43:22 +02:00
Dustin J. Mitchell 4a0a6eae05 Bug 1492664 - set TASKCLUSTER_ROOT_URL and TASKCLUSTER_PROXY_URL; r=tomprince,glandium
Eventually, workers will provide these variables directly
(https://bugzilla.mozilla.org/show_bug.cgi?id=1460015).  But for now, this
ensures that TASKCLUSTER_ROOT_URL is set everywhere, and TASKCLUSTER_PROXY_URL
is set wherever the proxy is active.

The setup for the mach commands defaults to https://taskcluster.net for user
convenience.  When the production instance's URL changes, we can simply change
that default.

This changes the docker build process propagate TASKCLUSTER_ROOT_URL into the
docker images where necessary (using %ARG), specifically to create URLs for
debian repo paths.

--HG--
extra : rebase_source : 0626ebdb66a9f4078cb75ab71be256c334297363
2018-09-25 20:18:19 +00:00
Margareta Eliza Balazs 2e5e28f518 Backed out 16 changesets (bug 1492664) for breaking developer artifact builds, requested by standard8 a=backout
Backed out changeset 31e500489665 (bug 1492664)
Backed out changeset f4945658d45f (bug 1492664)
Backed out changeset 6d17291b8b92 (bug 1492664)
Backed out changeset 90f3faa36137 (bug 1492664)
Backed out changeset 0b229b00818a (bug 1492664)
Backed out changeset 5eb2c77d70a9 (bug 1492664)
Backed out changeset e1ebad5d89c5 (bug 1492664)
Backed out changeset 3017e5890739 (bug 1492664)
Backed out changeset c8b7e620eabf (bug 1492664)
Backed out changeset d3dfbd848236 (bug 1492664)
Backed out changeset 5c92bb5ac895 (bug 1492664)
Backed out changeset fb7cfca6ebc3 (bug 1492664)
Backed out changeset 0c4101230d4d (bug 1492664)
Backed out changeset b93a0fcc86f3 (bug 1492664)
Backed out changeset 6dc9522ee0bf (bug 1492664)
Backed out changeset 85d7f8b330eb (bug 1492664)
2018-12-19 11:45:29 +02:00
Dustin J. Mitchell 211a6cf5e3 Bug 1492664 - set TASKCLUSTER_ROOT_URL and TASKCLUSTER_PROXY_URL; r=tomprince,glandium
Eventually, workers will provide these variables directly
(https://bugzilla.mozilla.org/show_bug.cgi?id=1460015).  But for now, this
ensures that TASKCLUSTER_ROOT_URL is set everywhere, and TASKCLUSTER_PROXY_URL
is set wherever the proxy is active.

The setup for the mach commands defaults to https://taskcluster.net for user
convenience.  When the production instance's URL changes, we can simply change
that default.

This changes the docker build process to propagate TASKCLUSTER_ROOT_URL into
the docker images, and for good measure includes some code to use that value to
generate debian repo paths.

Differential Revision: https://phabricator.services.mozilla.com/D14196

--HG--
extra : moz-landing-system : lando
2018-12-18 05:37:41 +00:00
Tom Prince 8c933de83a Bug 1397847: Add supported API to get tasks of a given kind from a taskgraph; r=dustin
`mach artifact toolchain` gets task definitions from taskgraph, to get the
index path to find the artifacts at. Now that these index paths depend on the
digests of fetch tasks, those kinds need to be loaded as well. This adds a
supported API to get task definitions for a given kind, which loads all the
kind dependencies.

Differential Revision: https://phabricator.services.mozilla.com/D12161

--HG--
extra : moz-landing-system : lando
2018-11-28 17:55:35 +00:00
Kartikaya Gupta 7a4b1d8a07 Bug 1509900 - Improve documentation for taskcluster-load-image. r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D12932

--HG--
extra : moz-landing-system : lando
2018-11-26 18:24:43 +00:00
Dustin J. Mitchell 37fd25c3c6 Bug 1473636: clarify arguments to action callbacks; r=tomprince
MozReview-Commit-ID: j3OiNkjngD

--HG--
extra : rebase_source : c1c169f5c1295628fe3ea5608407bd85cec34a00
2018-07-05 17:07:40 +00:00
Nick Thomas 95c9aa6874 Bug 1415868 - fix test-action-callback after rev e2931d904975, r=dustin
MozReview-Commit-ID: LlUQHanvVng

--HG--
extra : rebase_source : 170b5baaa018a00e2cffd13ecc0b0e92165379a9
2018-06-21 16:15:46 +12:00
Brian Stack 3ba851c889 Bug 1465117 - Take two at updating backfill task. Use modifier this time. r=dustin,jmaher
MozReview-Commit-ID: CAs0WRb839r

--HG--
extra : rebase_source : 5da88d38315f8b6795aa6d5a97de63883eda1ab0
2018-06-08 12:08:34 -07:00
Ciure Andrei e0538d334b Backed out 1 changesets (bug 1465117) for fix_task_dependencies not working as expected a=backout
Backed out changeset 3d3fe54d0cb6 (bug 1465117)
2018-06-08 00:00:20 +03:00
Brian Stack 3672e158f8 Bug 1465117 - Add additional options to backfilling action task r=dustin,jmaher
MozReview-Commit-ID: FMGjhQbg4im

--HG--
extra : rebase_source : a03e351836c7356c6912af85be9108921e50aabd
2018-06-01 16:44:16 -07:00
Dustin J. Mitchell aeb0a55c25 Bug 1415868 - remove ACTION_TASK r=jonasfj,tomprince
For kind=hook, the spec doesn't include this value as it's untrustworthy.

For kind=task, it's still untrustworthy, but there is no privilege escalation
so that's not important. Still, it dramatically expands the size of the task
definition.

MozReview-Commit-ID: 6scQ2ZwxP10

--HG--
extra : rebase_source : 4dc34390a510091ddc26023755992995fe358e47
2018-04-27 22:24:42 +00:00
Dustin J. Mitchell 1faeb13c08 Bug 1415868 - add 'mach taskgraph actions'; r=jonasfj,tomprince
MozReview-Commit-ID: ExVRgcD02GK

--HG--
extra : rebase_source : e823a8646655394f1644ed0010033a8cdf96ae0c
2018-04-23 21:14:14 +00:00
Gregory Szorc a3113a2560 Bug 1460475 - Install zstandard 0.9.0 in mach; r=dustin
The latest python-zstandard uses a newer zstandard that is faster.
It also has wheels available, which means installation doesn't require
Python development headers, etc.

MozReview-Commit-ID: 5gRq81KYmX4

--HG--
extra : rebase_source : 96ccc64e9707c6b4815c1bfa5c1a98b9a428b387
2018-05-09 20:13:28 -07:00
Tom Prince 8ae52f6885 Bug 1456379: Remove references to `date` branch; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1028

--HG--
extra : rebase_source : d25e21bd7c0140392efdecf01fa3bd879a8a9779
2018-01-23 14:48:27 -07:00
Tom Prince 82818118aa Bug 1418058: [taskcluster] Load graph configuration for the correct project when running actions; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D914

--HG--
extra : rebase_source : f2e6591f3ac126b16070549789975fae58c0b3bc
2018-04-11 12:02:19 -06:00
Tom Prince 1f286055e2 Bug 1447460: Teach `mach taskgraph cron` to handle configuration in sub-repositories; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D815

--HG--
extra : rebase_source : f0153c78bf4ffe0dbf520e0fb4d0683c82173f8b
2018-03-28 11:34:20 -07:00
Tom Prince 74bcf37b60 Bug 1447460: Mark some obsolete `mach taskgraph cron` parameters as ignored; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D814

--HG--
extra : rebase_source : c50bd800ca9cd09bf0cd1ec9f7eb19f20d1b0866
2018-03-27 10:30:02 -07:00
Dustin J. Mitchell 23bfb18da8 Bug 1437710: fix spelling of zstd; r=gps
MozReview-Commit-ID: 8bSU61Lvh0T

--HG--
extra : rebase_source : 4fabfadcde7c51f483c6612e2b3a4c0d2c2efd92
2018-02-12 23:32:11 +00:00
Mike Hommey fd6ffda3c8 Bug 1432390 - Make `mach taskcluster-build-image` talk directly to the docker socket in the image builder. r=dustin
Now that `mach taskcluster-build-image` can, we can avoid all the manual
handling based on curl and jq in the image builder.

An additional advantage on relying on `mach taskcluster-build-image`
doing more is that less changes to the build-image.sh script will be
necessary, and thus less updates of the image builder docker image.

--HG--
extra : rebase_source : dd174d60675e41e4391894f28235c674c1840829
2018-01-25 13:36:47 +09:00
Mike Hommey 16c5f4c5f4 Bug 1432390 - Use zstandard and requests modules instead of spawning curl | zstd in docker.load_image. r=dustin
The zstd command we spawn, if available at all, might be the wrong
version: zstd changed its stream format in an incompatible way at some
point, and the version shipped in e.g. Ubuntu 16.04 uses the old format,
while the version taskcluster relies on uses the new format.

Relying on gps's zstandard library allows to ensure we use the right
version. Another advantage is that we can trivially pip install it in a
virtualenv if it isn't available on the system running the command.

If we're ridding ourselves of the subprocess spawning for zstd, we might
as well cover curl as well. Especially considering the error handling
when subprocesses are involved is not trivial, such that the current
error handling code is actually broken and leads to dead-lock
conditions, when, for example, curl is still waiting for the python side
to read data, but the python side is not reading data anymore because
an exception was thrown in the tar reading loop.

--HG--
extra : rebase_source : 054c37cfaa68bf475b37545ebaa99144584b93d4
2018-01-24 11:18:13 +09:00
Mike Hommey 49e7b07ecc Bug 1419638 - Allow to pass arguments to docker when building docker-images. r=dustin
Ideally, we'd simply use the --build-arg docker argument along with ARG
in the Dockerfile, but that's only supported from Docker API 1.21, and
we're stuck on 1.18 for the moment.

So we add another hack to how we handle the Dockerfile, by adding a
commented syntax that allows to declare arguments to the Dockerfile.

The arguments can be defined in the docker images kind.yml file through
the `args` keyword. Under the hood, they are passed down to the docker
image task through the environment. The mach taskcluster-build-image
command then uses the corresponding values from the environment to
generate a "preprocessed" Dockerfile for its context.

--HG--
extra : rebase_source : 26a43dd680c1ab97b1a4689a23c55594a3b21b67
2017-12-24 07:51:29 +09:00
Chris AtLee 7bdb7826e2 Bug 1420449: Add mach taskgraph -F/--fast r=ahal
Initially this will skip toolchain task optimizations, which avoids hashing
local directory contents and speeds up taskgraph generation by about 25%.

MozReview-Commit-ID: B4LB5BV86nw

--HG--
extra : rebase_source : c41e4d838e8920b865cd62bb8de38e64b85b2d84
2017-11-30 12:07:02 -05:00
Tom Prince 506636cd2d Bug 1421036: Display task labels by default when running `mach taskgraph optimized`; r=dustin
MozReview-Commit-ID: 4sMl5a02NCE

--HG--
extra : rebase_source : 024a49a82a3ea39fccf745ba33356b39d734c8ea
2017-11-27 13:26:14 -07:00
Tom Prince 3890179b24 Bug 1421002: Add an option to control where to find the try_task_config. r=dustin
MozReview-Commit-ID: ntC1fJOidr

--HG--
extra : rebase_source : 7bd3ace5b127fca978b9e5ec6a2d0670ff931af9
extra : source : 43903d5d0cfdf57cc39c643dc1d1f577a6fc8901
2017-11-21 11:26:56 -07:00
Aki Sasaki f6e2f73426 bug 1397552 - add a release promotion action. r=bstack
Add a release promotion custom action for releng's TC release promotion migration work.

This action generates a graph dependent on previously built tasks. To track these, we add the `do_not_optimize` and `existing_tasks` parameters. The `do_not_optimize` parameter specifies tasks that we want to explicitly exclude from taskgraph optimization. The `existing_tasks` parameter specifies a label-to-taskid map for tasks from previous graphs.

MozReview-Commit-ID: 1vKrNUavM4V

--HG--
extra : rebase_source : b8ba95d270aafe1464c2b3bfc318b9568500a7a1
2017-10-24 15:28:19 -07:00
Tom Prince 688b333cd7 Bug 1385055 - Add some taskgraph parameters for dealing with comm-central and related repositories. r=dustin
MozReview-Commit-ID: 4tdxfJcx8Fz

--HG--
extra : rebase_source : 9e4002a409b9d2a4134cd8ef745e9ca874d1730a
2017-07-27 12:26:48 -06:00
Brian Stack 08374b825e Bug 1406177 - Remove action.yml now that it is unused r=garndt
MozReview-Commit-ID: IIX125xFoMx

--HG--
extra : rebase_source : 1b90ae1c04bdbb156ce6fef2a6bbadd443f1416a
2017-10-05 14:47:15 -07:00
Simon Fraser 8ad84443f2 Bug 1342392 Migrate partial update generation in-tree r=rail
MozReview-Commit-ID: G6EFXY0UzSa

--HG--
extra : rebase_source : dbea33ec8d96cc9a0e016e4828f9f989fca7131b
2017-09-18 13:36:36 +01:00
Sebastian Hengst 16d37c8635 Backed out changeset 0d71c0be62de (bug 1342392) for bustage in partial update generator for docker images: recompress.sh not found. r=backout
--HG--
rename : taskcluster/docker/partial-update-generator/Dockerfile => taskcluster/docker/funsize-update-generator/Dockerfile
rename : taskcluster/docker/partial-update-generator/Makefile => taskcluster/docker/funsize-update-generator/Makefile
rename : taskcluster/docker/partial-update-generator/README => taskcluster/docker/funsize-update-generator/README
rename : taskcluster/docker/partial-update-generator/dep.pubkey => taskcluster/docker/funsize-update-generator/dep.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha1.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha384.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha1.pubkey => taskcluster/docker/funsize-update-generator/release_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha384.pubkey => taskcluster/docker/funsize-update-generator/release_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/requirements.txt => taskcluster/docker/funsize-update-generator/requirements.txt
rename : taskcluster/docker/partial-update-generator/runme.sh => taskcluster/docker/funsize-update-generator/runme.sh
rename : taskcluster/docker/partial-update-generator/scripts/funsize.py => taskcluster/docker/funsize-update-generator/scripts/funsize.py
rename : taskcluster/docker/partial-update-generator/scripts/mbsdiff_hook.sh => taskcluster/docker/funsize-update-generator/scripts/mbsdiff_hook.sh
2017-09-18 14:15:42 +02:00
Simon Fraser 29f566fbfb Bug 1342392 Migrate partial update generation in-tree r=rail
MozReview-Commit-ID: 84fP48sMYhS

--HG--
rename : taskcluster/docker/funsize-update-generator/Dockerfile => taskcluster/docker/partial-update-generator/Dockerfile
rename : taskcluster/docker/funsize-update-generator/Makefile => taskcluster/docker/partial-update-generator/Makefile
rename : taskcluster/docker/funsize-update-generator/README => taskcluster/docker/partial-update-generator/README
rename : taskcluster/docker/funsize-update-generator/dep.pubkey => taskcluster/docker/partial-update-generator/dep.pubkey
rename : taskcluster/docker/funsize-update-generator/nightly_sha1.pubkey => taskcluster/docker/partial-update-generator/nightly_sha1.pubkey
rename : taskcluster/docker/funsize-update-generator/nightly_sha384.pubkey => taskcluster/docker/partial-update-generator/nightly_sha384.pubkey
rename : taskcluster/docker/funsize-update-generator/release_sha1.pubkey => taskcluster/docker/partial-update-generator/release_sha1.pubkey
rename : taskcluster/docker/funsize-update-generator/release_sha384.pubkey => taskcluster/docker/partial-update-generator/release_sha384.pubkey
rename : taskcluster/docker/funsize-update-generator/requirements.txt => taskcluster/docker/partial-update-generator/requirements.txt
rename : taskcluster/docker/funsize-update-generator/runme.sh => taskcluster/docker/partial-update-generator/runme.sh
rename : taskcluster/docker/funsize-update-generator/scripts/funsize.py => taskcluster/docker/partial-update-generator/scripts/funsize.py
rename : taskcluster/docker/funsize-update-generator/scripts/mbsdiff_hook.sh => taskcluster/docker/partial-update-generator/scripts/mbsdiff_hook.sh
extra : rebase_source : e5a6cc3aafccde8c9e8cd175aafc7e641ca17031
2017-09-15 11:04:35 +01:00
Sebastian Hengst 027402394e Backed out changeset a43387ee65d7 (bug 1342392) for failing flake8 and py-compat jobs. r=backout
--HG--
rename : taskcluster/docker/partial-update-generator/Dockerfile => taskcluster/docker/funsize-update-generator/Dockerfile
rename : taskcluster/docker/partial-update-generator/Makefile => taskcluster/docker/funsize-update-generator/Makefile
rename : taskcluster/docker/partial-update-generator/README => taskcluster/docker/funsize-update-generator/README
rename : taskcluster/docker/partial-update-generator/dep.pubkey => taskcluster/docker/funsize-update-generator/dep.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha1.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha384.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/recompress.sh => taskcluster/docker/funsize-update-generator/recompress.sh
rename : taskcluster/docker/partial-update-generator/release_sha1.pubkey => taskcluster/docker/funsize-update-generator/release_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha384.pubkey => taskcluster/docker/funsize-update-generator/release_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/requirements.txt => taskcluster/docker/funsize-update-generator/requirements.txt
rename : taskcluster/docker/partial-update-generator/runme.sh => taskcluster/docker/funsize-update-generator/runme.sh
rename : taskcluster/docker/partial-update-generator/scripts/funsize.py => taskcluster/docker/funsize-update-generator/scripts/funsize.py
rename : taskcluster/docker/partial-update-generator/scripts/mbsdiff_hook.sh => taskcluster/docker/funsize-update-generator/scripts/mbsdiff_hook.sh
rename : taskcluster/docker/partial-update-generator/scripts/recompress.py => taskcluster/docker/funsize-update-generator/scripts/recompress.py
2017-09-18 13:50:16 +02:00
Simon Fraser 9ba847f43d Bug 1342392 Migrate partial update generation in-tree r=rail
MozReview-Commit-ID: 84fP48sMYhS

--HG--
rename : taskcluster/docker/funsize-update-generator/Dockerfile => taskcluster/docker/partial-update-generator/Dockerfile
rename : taskcluster/docker/funsize-update-generator/Makefile => taskcluster/docker/partial-update-generator/Makefile
rename : taskcluster/docker/funsize-update-generator/README => taskcluster/docker/partial-update-generator/README
rename : taskcluster/docker/funsize-update-generator/dep.pubkey => taskcluster/docker/partial-update-generator/dep.pubkey
rename : taskcluster/docker/funsize-update-generator/nightly_sha1.pubkey => taskcluster/docker/partial-update-generator/nightly_sha1.pubkey
rename : taskcluster/docker/funsize-update-generator/nightly_sha384.pubkey => taskcluster/docker/partial-update-generator/nightly_sha384.pubkey
rename : taskcluster/docker/funsize-update-generator/recompress.sh => taskcluster/docker/partial-update-generator/recompress.sh
rename : taskcluster/docker/funsize-update-generator/release_sha1.pubkey => taskcluster/docker/partial-update-generator/release_sha1.pubkey
rename : taskcluster/docker/funsize-update-generator/release_sha384.pubkey => taskcluster/docker/partial-update-generator/release_sha384.pubkey
rename : taskcluster/docker/funsize-update-generator/requirements.txt => taskcluster/docker/partial-update-generator/requirements.txt
rename : taskcluster/docker/funsize-update-generator/runme.sh => taskcluster/docker/partial-update-generator/runme.sh
rename : taskcluster/docker/funsize-update-generator/scripts/funsize.py => taskcluster/docker/partial-update-generator/scripts/funsize.py
rename : taskcluster/docker/funsize-update-generator/scripts/mbsdiff_hook.sh => taskcluster/docker/partial-update-generator/scripts/mbsdiff_hook.sh
rename : taskcluster/docker/funsize-update-generator/scripts/recompress.py => taskcluster/docker/partial-update-generator/scripts/recompress.py
extra : rebase_source : 5c6e1e909339f58ada48285294d97f3a4de46c28
2017-09-15 11:04:35 +01:00
Wes Kocher e0340aa82f Backed out 2 changesets (bug 1342392) for bustage a=backout
Backed out changeset b0e86286b173 (bug 1342392)
Backed out changeset 01bf0c29331e (bug 1342392)

MozReview-Commit-ID: 71fcOZ2RgEp

--HG--
rename : taskcluster/docker/partial-update-generator/Dockerfile => taskcluster/docker/funsize-update-generator/Dockerfile
rename : taskcluster/docker/partial-update-generator/Makefile => taskcluster/docker/funsize-update-generator/Makefile
rename : taskcluster/docker/partial-update-generator/README => taskcluster/docker/funsize-update-generator/README
rename : taskcluster/docker/partial-update-generator/dep.pubkey => taskcluster/docker/funsize-update-generator/dep.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha1.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha384.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha1.pubkey => taskcluster/docker/funsize-update-generator/release_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha384.pubkey => taskcluster/docker/funsize-update-generator/release_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/requirements.txt => taskcluster/docker/funsize-update-generator/requirements.txt
rename : taskcluster/docker/partial-update-generator/runme.sh => taskcluster/docker/funsize-update-generator/runme.sh
rename : taskcluster/docker/partial-update-generator/scripts/funsize.py => taskcluster/docker/funsize-update-generator/scripts/funsize.py
rename : taskcluster/docker/partial-update-generator/scripts/mbsdiff_hook.sh => taskcluster/docker/funsize-update-generator/scripts/mbsdiff_hook.sh
2017-09-11 17:35:09 -07:00
Simon Fraser e47fe41362 Bug 1342392 Move partial update generation in-tree r=dustin,jlorenzo
--HG--
rename : taskcluster/docker/funsize-update-generator/Dockerfile => taskcluster/docker/partial-update-generator/Dockerfile
rename : taskcluster/docker/funsize-update-generator/Makefile => taskcluster/docker/partial-update-generator/Makefile
rename : taskcluster/docker/funsize-update-generator/README => taskcluster/docker/partial-update-generator/README
rename : taskcluster/docker/funsize-update-generator/dep.pubkey => taskcluster/docker/partial-update-generator/dep.pubkey
rename : taskcluster/docker/funsize-update-generator/nightly_sha1.pubkey => taskcluster/docker/partial-update-generator/nightly_sha1.pubkey
rename : taskcluster/docker/funsize-update-generator/nightly_sha384.pubkey => taskcluster/docker/partial-update-generator/nightly_sha384.pubkey
rename : taskcluster/docker/funsize-update-generator/release_sha1.pubkey => taskcluster/docker/partial-update-generator/release_sha1.pubkey
rename : taskcluster/docker/funsize-update-generator/release_sha384.pubkey => taskcluster/docker/partial-update-generator/release_sha384.pubkey
rename : taskcluster/docker/funsize-update-generator/requirements.txt => taskcluster/docker/partial-update-generator/requirements.txt
rename : taskcluster/docker/funsize-update-generator/runme.sh => taskcluster/docker/partial-update-generator/runme.sh
rename : taskcluster/docker/funsize-update-generator/scripts/funsize.py => taskcluster/docker/partial-update-generator/scripts/funsize.py
rename : taskcluster/docker/funsize-update-generator/scripts/mbsdiff_hook.sh => taskcluster/docker/partial-update-generator/scripts/mbsdiff_hook.sh
2017-09-11 09:55:52 +01:00
Sebastian Hengst 21826b4be4 Backed out 2 changesets (bug 1342392) for adding .orig file and flake lint failures. r=backout on a CLOSED TREE
Backed out changeset bf0bcdc7482e (bug 1342392)
Backed out changeset 7f5ae5ff1181 (bug 1342392)

--HG--
rename : taskcluster/docker/partial-update-generator/Dockerfile => taskcluster/docker/funsize-update-generator/Dockerfile
rename : taskcluster/docker/partial-update-generator/Makefile => taskcluster/docker/funsize-update-generator/Makefile
rename : taskcluster/docker/partial-update-generator/README => taskcluster/docker/funsize-update-generator/README
rename : taskcluster/docker/partial-update-generator/dep.pubkey => taskcluster/docker/funsize-update-generator/dep.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha1.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha384.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha1.pubkey => taskcluster/docker/funsize-update-generator/release_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha384.pubkey => taskcluster/docker/funsize-update-generator/release_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/requirements.txt => taskcluster/docker/funsize-update-generator/requirements.txt
rename : taskcluster/docker/partial-update-generator/runme.sh => taskcluster/docker/funsize-update-generator/runme.sh
rename : taskcluster/docker/partial-update-generator/scripts/funsize.py => taskcluster/docker/funsize-update-generator/scripts/funsize.py
rename : taskcluster/docker/partial-update-generator/scripts/mbsdiff_hook.sh => taskcluster/docker/funsize-update-generator/scripts/mbsdiff_hook.sh
2017-09-11 10:38:08 +02:00
Simon Fraser 71165165c4 Bug 1342392 Move partial update generation in-tree r=dustin,jlorenzo 2017-09-11 09:24:10 +01:00
Brian Stack 257aa1c23c Bug 1384729 - Move actions into taskgraph dir r=dustin
MozReview-Commit-ID: HK5MR8Xw3On

--HG--
rename : taskcluster/actions/__init__.py => taskcluster/taskgraph/actions/__init__.py
rename : taskcluster/actions/add-new-jobs.py => taskcluster/taskgraph/actions/add-new-jobs.py
rename : taskcluster/actions/hello-action.py => taskcluster/taskgraph/actions/hello-action.py
rename : taskcluster/actions/registry.py => taskcluster/taskgraph/actions/registry.py
rename : taskcluster/actions/retrigger.py => taskcluster/taskgraph/actions/retrigger.py
rename : taskcluster/actions/run_missing_tests.py => taskcluster/taskgraph/actions/run_missing_tests.py
rename : taskcluster/actions/test-retrigger-action.py => taskcluster/taskgraph/actions/test-retrigger-action.py
rename : taskcluster/actions/util.py => taskcluster/taskgraph/actions/util.py
extra : source : 9368bd8045136706950cde7cf718fda5492499e8
extra : histedit_source : f52597f12cb247124ee6080241ac9c741fc53e49
2017-07-27 10:47:37 -07:00
Dustin J. Mitchell cf34f7579a Bug 1382707: fix typo 'tsak_id'; r=bstack
MozReview-Commit-ID: 2PhnJojQK8I

--HG--
extra : rebase_source : 21d752f5630286979cded265f7e5bf046e71c81d
2017-07-20 19:47:32 +00:00
Dustin J. Mitchell 6386989138 Bug 1382707: add ./mach taskgraph test-action-callback; r=bstack
MozReview-Commit-ID: 64kBJGLarY3

--HG--
extra : rebase_source : 95d55e94e792e7477810ab9fd68701d4452e6320
2017-07-20 17:11:28 +00:00
Andrew Halberstadt ce93f45e61 Bug 1380338 - Convert taskgraph unit tests to the |mach python-test| framework, r=dustin
These tests can now be run with:
./mach python-test taskcluster/taskgraph

or:
./mach python-test taskcluster

They can now run in parallel by passing in -j.

MozReview-Commit-ID: JXeZV8B04Sf

--HG--
extra : rebase_source : 7427f96facaf75e6b6fcca532027c68fb6c1a1a3
2017-07-12 10:47:14 -04:00
Sebastian Hengst 3174048fe9 Backed out changeset 54e4545b0fe0 (bug 1380338) for breaking spidermonkey pkg due to failing to process taskgraph/test/python.ini. r=backout 2017-07-12 19:18:46 +02:00
Andrew Halberstadt 7ec26c47a2 Bug 1380338 - Convert taskgraph unit tests to the |mach python-test| framework, r=dustin
These tests can now be run with:
./mach python-test taskcluster/taskgraph

or:
./mach python-test taskcluster

They can now run in parallel by passing in -j.

MozReview-Commit-ID: JXeZV8B04Sf

--HG--
extra : rebase_source : a8bb8c21d4c9722bf630c426a780f856fffc8cdb
2017-07-12 10:47:14 -04:00
Andrew Halberstadt 7ac6ca27c6 Bug 1378212 - Default to grabbing 'parameters.yml' file from latest mozilla-central decision task, r=dustin
MozReview-Commit-ID: 1993ISgb1Dn

--HG--
extra : rebase_source : cac58e5129fc05b702a1724b50082e0a2f1c87ee
2017-07-04 16:10:05 -04:00
Dustin J. Mitchell 76cf6b7b0f Bug 1351011: remove unused triggered_by property; r=Callek
The purpose of this parameter has been superseded by the `include_nightly`
property.

MozReview-Commit-ID: 4iXQsv9Drqg

--HG--
extra : rebase_source : c94142282909a88c29fe6809d87721bef1f198c2
2017-03-27 20:10:08 +00:00
Dustin J. Mitchell 335fa26ed0 Bug 1333255: introduce graph morphs, use them to make index tasks; r=jonasfj
Graph morphs modify the graph after optimization, without changing its meaning.
In this case, that means adding index tasks that will insert paths into the
index beyond the relatively limited number afforded in task.routes.

MozReview-Commit-ID: AJy4exX7q2v

--HG--
extra : rebase_source : d61e7462defd41e7112739fb057edb493f495430
extra : source : c580568ed47c1ed2af40d98b47fbb0d136e63060
2017-03-07 20:39:27 +00:00