Граф коммитов

6503 Коммитов

Автор SHA1 Сообщение Дата
alexandru.ionescu e229cae98e Bug 1564242 Split raptor.yml taskcluster test configs into smaller files: part 2 (fennec) r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D42272

--HG--
extra : moz-landing-system : lando
2019-08-19 06:20:38 +00:00
Jeff Muizelaar 0815909698 Bug 1571969. Stop running all the QR tests as virtual-with-gpu. r=jmaher
This uses the layers.d3d11.enable-blacklist pref to allow running WebRender on WARP.

Differential Revision: https://phabricator.services.mozilla.com/D42255

--HG--
extra : moz-landing-system : lando
2019-08-18 12:59:49 +00:00
Narcis Beleuzu e2803d7c18 Backed out changeset 67be750311a1 (bug 1571969) for raptor failures on tests.py . CLOSED TREE 2019-08-18 06:22:48 +03:00
Jeff Muizelaar 5da9e3a7b5 Bug 1571969. Stop running all the QR tests as virtual-with-gpu. r=jmaher
This uses the layers.d3d11.enable-blacklist pref to allow running WebRender on WARP.

Differential Revision: https://phabricator.services.mozilla.com/D42255

--HG--
extra : moz-landing-system : lando
2019-08-16 22:43:48 +00:00
Razvan Maries cff855aa9c Backed out changeset 91eca815c9fc (bug 1562686) for build bustages. CLOSED TREE 2019-08-16 22:38:19 +03:00
Razvan Maries 129bdaf0d0 Backed out changeset 4f8a94072fa6 (bug 1571969) as per Jeff's request. CLOSED TREE 2019-08-16 22:07:15 +03:00
Jeff Muizelaar ecf25e83b1 Bug 1571969. Stop running all the QR tests as virtual-with-gpu. r=jmaher
This uses the layers.d3d11.enable-blacklist pref to allow running WebRender on WARP.

Differential Revision: https://phabricator.services.mozilla.com/D42255

--HG--
extra : moz-landing-system : lando
2019-08-16 17:32:45 +00:00
Dustin J. Mitchell ad85abed68 Bug 1562686 - use AWS_IAM_CREDENTIALS_URL for all S3 sccache invocations r=chmanchester
Differential Revision: https://phabricator.services.mozilla.com/D41454

--HG--
extra : moz-landing-system : lando
2019-08-16 17:17:02 +00:00
Aaron Amanuel 3e2b89118e Bug 1574243 - Duplicate bouncerscript submission task to point at Nazgul. r=mtabara
Duplicating the old bouncer submission task and having it point to Nazgul in both stage and prod.

Differential Revision: https://phabricator.services.mozilla.com/D42171

--HG--
extra : moz-landing-system : lando
2019-08-16 15:45:24 +00:00
Dorel Luca f97e939824 Backed out changeset 10a056f52e49 (bug 1571969) for cpp failure. CLOSED TREE 2019-08-16 19:02:56 +03:00
Andrew Halberstadt 4eac89c065 Bug 1568277 - [ci] Add an experimental SETA optimize strategy and task to run it r=tomprince
These "shadow scheduler" tasks will generate artifacts per-push on autoland.
Basically, given the scheduling algorithms defined in
TASKGRAPH_OPTIMIZE_STRATEGIES, which tasks *would* have been scheduled on this
push.

This will allow us to download the artifacts and run comparisons against the
baseline to see whether things like code coverage or machine learning are
making the situation better or worse.

Differential Revision: https://phabricator.services.mozilla.com/D40427

--HG--
extra : moz-landing-system : lando
2019-08-16 14:46:40 +00:00
Andrew Halberstadt fa8c3bb64c Bug 1568277 - [taskgraph] Add ability to redirect |mach taskgraph|'s output to a file, r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D42172

--HG--
extra : moz-landing-system : lando
2019-08-16 14:27:14 +00:00
Andrew Halberstadt ced1bc5442 Bug 1568277 - [taskgraph] Merge SETA implementation with optimization strategy r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D41012

--HG--
rename : taskcluster/taskgraph/util/seta.py => taskcluster/taskgraph/optimize/seta.py
extra : moz-landing-system : lando
2019-08-16 14:27:12 +00:00
Andrew Halberstadt edd90ef680 Bug 1568277 - [taskgraph] Pass push and time intervals into SETA.is_low_value_task r=tomprince
This will allow us to easily tweak these values from the optimization strategy.

Differential Revision: https://phabricator.services.mozilla.com/D40206

--HG--
extra : moz-landing-system : lando
2019-08-16 14:27:08 +00:00
Andrew Halberstadt 4a606dff00 Bug 1568277 - [taskgraph] Ensure user specified optimization strategies update instead of replace the default ones r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D40205

--HG--
extra : moz-landing-system : lando
2019-08-16 14:26:08 +00:00
Andrew Halberstadt 7828bae0b4 Bug 1568277 - [taskgraph] Create optimize strategy aliases for the 'test' kind r=tomprince
This allows test tasks to declare a static optimization name, which can then be
swapped in and out from the optimize code without needing to update the
transforms. This will make it easier to change optimization strategies or run
experimental ones.

Differential Revision: https://phabricator.services.mozilla.com/D40204

--HG--
extra : moz-landing-system : lando
2019-08-16 14:26:01 +00:00
Andrew Halberstadt 91d4452d2e Bug 1568277 - [taskgraph] Split optimize strategies out into a separate file r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D40203

--HG--
rename : taskcluster/taskgraph/optimize.py => taskcluster/taskgraph/optimize/__init__.py
extra : moz-landing-system : lando
2019-08-16 14:25:47 +00:00
Andrew Halberstadt 83e584f864 Bug 1568277 - [taskgraph] Move 'taskgraph.transforms.job.import_all' to a utility function r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D41011

--HG--
extra : moz-landing-system : lando
2019-08-16 14:25:40 +00:00
Andrew Halberstadt a8971c3b49 Bug 1568277 - [taskgraph] Use a 'register_strategy' decorator in optimize.py r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D40202

--HG--
extra : moz-landing-system : lando
2019-08-16 14:25:28 +00:00
Andrew Halberstadt 18543d0ff5 Bug 1568277 - [taskgraph] Remove some dead code in optimize.py r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D40201

--HG--
extra : moz-landing-system : lando
2019-08-16 14:25:21 +00:00
Jeff Muizelaar 82fe69f5d0 Bug 1571969. Stop running all the QR tests as virtual-with-gpu. r=jmaher
This uses the layers.d3d11.enable-blacklist pref to allow running WebRender on WARP.

Differential Revision: https://phabricator.services.mozilla.com/D42255

--HG--
extra : moz-landing-system : lando
2019-08-16 14:34:00 +00:00
Andreas Tolfsen a7e5e01481 bug 1540655: ci: add test job for Puppeteer tests; r=ahal
This adds a "remote(pup)" TaskCluster job for running the Google
Puppeteer tests against the new Firefox remote agent.

Earlier in this patchset we added a "./mach puppeteer-test" command
that wraps npm, and this being a source-test with access to the
full checkout, invokes this command directly instead of going
through mozharness.

Differential Revision: https://phabricator.services.mozilla.com/D37015

--HG--
extra : moz-landing-system : lando
2019-08-16 12:58:24 +00:00
Sebastian Hengst 741204a688 Backed out 10 changesets (bug 1568277) for breaking ./mach bootstrap. a=backout
Backed out changeset 056d9515483c (bug 1568277)
Backed out changeset 632d943c947b (bug 1568277)
Backed out changeset d7e8f80e2c85 (bug 1568277)
Backed out changeset 7b59ed5d703d (bug 1568277)
Backed out changeset f8b41cbaaf8e (bug 1568277)
Backed out changeset 391a90f3f02b (bug 1568277)
Backed out changeset d2b1d6c0a732 (bug 1568277)
Backed out changeset cb35fd836621 (bug 1568277)
Backed out changeset c8f797a19731 (bug 1568277)
Backed out changeset 9b89f970d46b (bug 1568277)

--HG--
rename : taskcluster/taskgraph/optimize/__init__.py => taskcluster/taskgraph/optimize.py
rename : taskcluster/taskgraph/optimize/seta.py => taskcluster/taskgraph/util/seta.py
2019-08-16 11:19:54 +02:00
Chris Manchester 8eddcea9e1 Bug 1574027 - Bump sccache used in tree to 0.2.10 release. r=nalexander,froydnj
Differential Revision: https://phabricator.services.mozilla.com/D42188

--HG--
extra : moz-landing-system : lando
2019-08-15 20:30:27 +00:00
Andrew Halberstadt 9b4853268f Bug 1568277 - [ci] Add an experimental SETA optimize strategy and task to run it r=tomprince
These "shadow scheduler" tasks will generate artifacts per-push on autoland.
Basically, given the scheduling algorithms defined in
TASKGRAPH_OPTIMIZE_STRATEGIES, which tasks *would* have been scheduled on this
push.

This will allow us to download the artifacts and run comparisons against the
baseline to see whether things like code coverage or machine learning are
making the situation better or worse.

Differential Revision: https://phabricator.services.mozilla.com/D40427

--HG--
extra : moz-landing-system : lando
2019-08-15 19:36:35 +00:00
Andrew Halberstadt 699de357f9 Bug 1568277 - [tasgraph] Add ability to redirect |mach taskgraph|'s output to a file, r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D42172

--HG--
extra : moz-landing-system : lando
2019-08-15 19:36:15 +00:00
Andrew Halberstadt 60fe63b86d Bug 1568277 - [taskgraph] Merge SETA implementation with optimization strategy r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D41012

--HG--
rename : taskcluster/taskgraph/util/seta.py => taskcluster/taskgraph/optimize/seta.py
extra : moz-landing-system : lando
2019-08-15 18:54:18 +00:00
Andrew Halberstadt 1d274ca26c Bug 1568277 - [taskgraph] Pass push and time intervals into SETA.is_low_value_task r=tomprince
This will allow us to easily tweak these values from the optimization strategy.

Differential Revision: https://phabricator.services.mozilla.com/D40206

--HG--
extra : moz-landing-system : lando
2019-08-15 18:49:10 +00:00
Andrew Halberstadt 41c8305e98 Bug 1568277 - [taskgraph] Ensure user specified optimization strategies update instead of replace the default ones r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D40205

--HG--
extra : moz-landing-system : lando
2019-08-15 18:49:01 +00:00
Andrew Halberstadt acd1f7b8f7 Bug 1568277 - [taskgraph] Create optimize strategy aliases for the 'test' kind r=tomprince
This allows test tasks to declare a static optimization name, which can then be
swapped in and out from the optimize code without needing to update the
transforms. This will make it easier to change optimization strategies or run
experimental ones.

Differential Revision: https://phabricator.services.mozilla.com/D40204

--HG--
extra : moz-landing-system : lando
2019-08-15 18:48:54 +00:00
Andrew Halberstadt c8af64def2 Bug 1568277 - [taskgraph] Split optimize strategies out into a separate file r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D40203

--HG--
rename : taskcluster/taskgraph/optimize.py => taskcluster/taskgraph/optimize/__init__.py
extra : moz-landing-system : lando
2019-08-15 18:48:38 +00:00
Andrew Halberstadt 069aed0ec8 Bug 1568277 - [taskgraph] Move 'taskgraph.transforms.job.import_all' to a utility function r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D41011

--HG--
extra : moz-landing-system : lando
2019-08-15 18:48:30 +00:00
Andrew Halberstadt db1d13cfab Bug 1568277 - [taskgraph] Use a 'register_strategy' decorator in optimize.py r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D40202

--HG--
extra : moz-landing-system : lando
2019-08-15 18:48:21 +00:00
Andrew Halberstadt 524a190c6b Bug 1568277 - [taskgraph] Remove some dead code in optimize.py r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D40201

--HG--
extra : moz-landing-system : lando
2019-08-15 18:48:07 +00:00
Csoregi Natalia 7d39932994 Merge mozilla-central to autoland. CLOSED TREE 2019-08-15 22:38:37 +03:00
Csoregi Natalia 07cae55cd2 Merge inbound to mozilla-central. a=merge 2019-08-15 22:34:31 +03:00
Mike Hommey 515ab2e11d Bug 1574128 - Fixup for bug 1573435 to unbust webrender-windows jobs. r=me
MANUAL PUSH: Fix bustage on inbound.
2019-08-15 20:09:27 +09:00
Brindusan Cristian 3a61fb322f Merge inbound to mozilla-central. a=merge 2019-08-15 12:45:55 +03:00
Mike Hommey 9d82f15c67 Bug 1573435 - Followup not to drop sccache usage from the switch to fetches. r=me
This is a straightforward translation of the code formerly in
use_toolchains.py.

MANUAL PUSH: Followup a landing on inbound.
2019-08-15 15:15:47 +09:00
Mike Hommey 8d5dc26045 No bug - Bustage fix for Windows gn builds. r=me
MANUAL PUSH: This fixes bustage on inbound on a CLOSED TREE.
2019-08-15 12:25:32 +09:00
Mike Hommey ace4568daa Bug 1573435 - Use toolchain fetches for all remaining toolchain uses, part 2. r=nalexander
This part removes the use_toolchains transform, and adjusts all task
definitions accordingly.

Differential Revision: https://phabricator.services.mozilla.com/D41891

MANUAL PUSH: avoid closing autoland while docker images and toolchains
are rebuilt.
2019-08-15 11:22:23 +09:00
Mike Hommey c173540215 Bug 1573435 - Use toolchain fetches for all remaining toolchain uses. r=nalexander
The remaining uses all need adjustements to in-tree mozconfigs, so they
all need to be done at once.

However, to make things slightly more intelligible, we do this in two
steps. This is step 1: we modify the use_toolchain transform to take care of
the transformation, while keeping the task definitions intact, so that
we only deal with mozconfig and build script adjustements here.

Differential Revision: https://phabricator.services.mozilla.com/D41890
2019-08-15 11:21:52 +09:00
Mike Hommey 57a88cbf46 Bug 1573435 - Use toolchain fetches for source-test builds. r=nalexander
While here, use GECKO_PATH instead of $HOME/checkouts/gecko.

Differential Revision: https://phabricator.services.mozilla.com/D41889
2019-08-15 11:21:51 +09:00
Mike Hommey 6257ba9912 Bug 1573435 - Use toolchain fetches for spidermonkey builds. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D41739
2019-08-15 11:21:50 +09:00
Mike Hommey 9b57b7f93c Bug 1573435 - Use toolchain fetches for hazard builds. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D41738
2019-08-15 11:21:49 +09:00
Mike Hommey 8cd0a0666a Bug 1573435 - Use toolchain fetches for openh264 tasks. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D41737
2019-08-15 11:21:48 +09:00
Mike Hommey 06bb7968b8 Bug 1573435 - Use toolchain fetches for diffoscope tasks. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D41736
2019-08-15 11:21:47 +09:00
Mike Hommey f614b1329d Bug 1469697 - Use run-task transform for hazard tasks. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D41726
2019-08-15 11:21:46 +09:00
Mike Hommey ab2269d011 Bug 1469697 - s/GECKO_DIR/GECKO_PATH/ for hazard build scripts. r=nalexander
Most other tasks use GECKO_PATH, as that's what run-task uses.

Differential Revision: https://phabricator.services.mozilla.com/D41725
2019-08-15 11:21:45 +09:00
Mike Hommey fb26d1619a Bug 1469697 - Use run-task transform for spidermonkey tasks. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D41724
2019-08-15 11:21:44 +09:00