2019-05-11 00:19:48 +03:00
|
|
|
# This Source Code Form is subject to the terms of the Mozilla Public
|
|
|
|
|
# License, v. 2.0. If a copy of the MPL was not distributed with this
|
|
|
|
|
# file, You can obtain one at http://mozilla.org/MPL/2.0/.
|
|
|
|
|
---
|
2017-03-10 03:00:49 +03:00
|
|
|
loader: taskgraph.loader.test:loader
|
Bug 1281004: Specify test tasks more flexibly; r=gps; r=gbrown
This introduces a completely new way of specifying test task in-tree,
completely replacing the old spider-web of YAML files.
The high-level view is this:
- some configuration files are used to determine which test suites to run
for each test platform, and against which build platforms
- each test suite is then represented by a dictionary, and modified by a
sequence of transforms, duplicating as necessary (e.g., chunks), until
it becomes a task definition
The transforms allow sufficient generality to support just about any desired
configuration, with the advantage that common configurations are "easy" while
unusual configurations are supported but notable for their oddness (they
require a custom transform).
As of this commit, this system produces the same set of test graphs as the
existing YAML, modulo:
- extra.treeherder.groupName -- this was not consistent in the YAML
- extra.treeherder.build -- this is ignored by taskcluster-treeherder anyway
- mozharness command argument order
- boolean True values for environment variables are now the string "true"
- metadata -- this is now much more consistent, with task name being the label
Testing of this commit demonstrates that it produces the same set of test tasks for
the following projects (those which had special cases defined in the YAML):
- autoland
- ash (*)
- willow
- mozilla-inbound
- mozilla-central
- try:
-b do -p all -t all -u all
-b d -p linux64,linux64-asan -u reftest -t none
-b d -p linux64,linux64-asan -u reftest[x64] -t none[x64]
(*) this patch omits the linux64/debug tc-M-e10s(dt) test, which is enabled on
ash; ash will require a small changeset to re-enable this test.
IGNORE BAD COMMIT MESSAGES (because the hook flags try syntax!)
MozReview-Commit-ID: G34dg9f17Hq
--HG--
rename : taskcluster/taskgraph/kind/base.py => taskcluster/taskgraph/task/base.py
rename : taskcluster/taskgraph/kind/docker_image.py => taskcluster/taskgraph/task/docker_image.py
rename : taskcluster/taskgraph/kind/legacy.py => taskcluster/taskgraph/task/legacy.py
extra : rebase_source : 03e70902c2d3a297eb9e3ce852f8737c2550d5a6
extra : histedit_source : d4d9f4b192605af21f41d83495fc3c923759c3cb
2016-07-12 02:27:14 +03:00
|
|
|
|
|
|
|
|
kind-dependencies:
|
2016-09-12 21:34:06 +03:00
|
|
|
- build
|
2017-06-29 23:50:13 +03:00
|
|
|
- build-signing
|
2021-07-26 16:16:25 +03:00
|
|
|
- repackage
|
2018-07-02 18:55:56 +03:00
|
|
|
- fetch
|
2018-09-20 17:03:42 +03:00
|
|
|
- toolchain
|
Bug 1281004: Specify test tasks more flexibly; r=gps; r=gbrown
This introduces a completely new way of specifying test task in-tree,
completely replacing the old spider-web of YAML files.
The high-level view is this:
- some configuration files are used to determine which test suites to run
for each test platform, and against which build platforms
- each test suite is then represented by a dictionary, and modified by a
sequence of transforms, duplicating as necessary (e.g., chunks), until
it becomes a task definition
The transforms allow sufficient generality to support just about any desired
configuration, with the advantage that common configurations are "easy" while
unusual configurations are supported but notable for their oddness (they
require a custom transform).
As of this commit, this system produces the same set of test graphs as the
existing YAML, modulo:
- extra.treeherder.groupName -- this was not consistent in the YAML
- extra.treeherder.build -- this is ignored by taskcluster-treeherder anyway
- mozharness command argument order
- boolean True values for environment variables are now the string "true"
- metadata -- this is now much more consistent, with task name being the label
Testing of this commit demonstrates that it produces the same set of test tasks for
the following projects (those which had special cases defined in the YAML):
- autoland
- ash (*)
- willow
- mozilla-inbound
- mozilla-central
- try:
-b do -p all -t all -u all
-b d -p linux64,linux64-asan -u reftest -t none
-b d -p linux64,linux64-asan -u reftest[x64] -t none[x64]
(*) this patch omits the linux64/debug tc-M-e10s(dt) test, which is enabled on
ash; ash will require a small changeset to re-enable this test.
IGNORE BAD COMMIT MESSAGES (because the hook flags try syntax!)
MozReview-Commit-ID: G34dg9f17Hq
--HG--
rename : taskcluster/taskgraph/kind/base.py => taskcluster/taskgraph/task/base.py
rename : taskcluster/taskgraph/kind/docker_image.py => taskcluster/taskgraph/task/docker_image.py
rename : taskcluster/taskgraph/kind/legacy.py => taskcluster/taskgraph/task/legacy.py
extra : rebase_source : 03e70902c2d3a297eb9e3ce852f8737c2550d5a6
extra : histedit_source : d4d9f4b192605af21f41d83495fc3c923759c3cb
2016-07-12 02:27:14 +03:00
|
|
|
|
|
|
|
|
transforms:
|
2017-11-11 08:36:41 +03:00
|
|
|
- taskgraph.transforms.tests:transforms
|
|
|
|
|
- taskgraph.transforms.job:transforms
|
|
|
|
|
- taskgraph.transforms.task:transforms
|
2017-10-17 22:57:14 +03:00
|
|
|
|
2017-10-17 23:25:41 +03:00
|
|
|
# Each stanza in a file pointed to by 'jobs-from' describes a particular test
|
|
|
|
|
# suite or sub-suite. These are processed through the transformations described
|
|
|
|
|
# above to produce a bunch of tasks. See the schema in
|
|
|
|
|
# `taskcluster/taskgraph/transforms/tests.py` for a description of the fields
|
|
|
|
|
# used in these files.
|
|
|
|
|
|
|
|
|
|
# Adding a new test type or running tests on a new platform? Be sure to review
|
|
|
|
|
# https://wiki.mozilla.org/Sheriffing/Job_Visibility_Policy
|
|
|
|
|
|
2017-10-17 22:57:14 +03:00
|
|
|
jobs-from:
|
2017-11-11 08:36:41 +03:00
|
|
|
- awsy.yml
|
2020-03-31 23:25:29 +03:00
|
|
|
- browsertime-desktop.yml
|
2019-10-15 20:05:13 +03:00
|
|
|
- browsertime-mobile.yml
|
2017-11-11 08:36:41 +03:00
|
|
|
- compiled.yml
|
|
|
|
|
- firefox-ui.yml
|
|
|
|
|
- marionette.yml
|
|
|
|
|
- misc.yml
|
|
|
|
|
- mochitest.yml
|
2018-04-24 17:30:42 +03:00
|
|
|
- raptor.yml
|
2019-09-24 23:45:16 +03:00
|
|
|
- raptor-chrome.yml
|
2019-08-26 16:40:48 +03:00
|
|
|
- raptor-gve.yml
|
2019-08-28 15:41:46 +03:00
|
|
|
- raptor-refbrow.yml
|
2017-11-11 08:36:41 +03:00
|
|
|
- reftest.yml
|
|
|
|
|
- talos.yml
|
|
|
|
|
- web-platform.yml
|
|
|
|
|
- xpcshell.yml
|
2018-11-21 00:57:46 +03:00
|
|
|
|
|
|
|
|
job-defaults:
|
2019-04-17 01:02:46 +03:00
|
|
|
attributes:
|
|
|
|
|
retrigger: true
|
2018-11-21 00:57:46 +03:00
|
|
|
require-signed-extensions:
|
|
|
|
|
by-release-type:
|
|
|
|
|
release|esr.*: true
|
|
|
|
|
beta:
|
|
|
|
|
by-test-platform:
|
|
|
|
|
.*-devedition/.*: false
|
|
|
|
|
default: true
|
|
|
|
|
default: false
|
2021-07-26 16:16:25 +03:00
|
|
|
mozharness:
|
|
|
|
|
requires-signed-builds:
|
|
|
|
|
by-test-platform:
|
|
|
|
|
macosx1100.*: true
|
|
|
|
|
default: false
|
2020-02-06 11:39:54 +03:00
|
|
|
fetches:
|
|
|
|
|
toolchain:
|
|
|
|
|
by-test-platform:
|
|
|
|
|
win.*:
|
|
|
|
|
- win32-minidump-stackwalk
|
2020-03-10 09:27:56 +03:00
|
|
|
- win32-fix-stacks
|
2020-02-06 11:39:54 +03:00
|
|
|
macosx.*:
|
|
|
|
|
- macosx64-minidump-stackwalk
|
2020-03-10 09:27:56 +03:00
|
|
|
- macosx64-fix-stacks
|
2020-05-06 17:28:37 +03:00
|
|
|
android-em-7.*:
|
2021-07-21 01:19:14 +03:00
|
|
|
- android-system-image-x86_64-linux
|
|
|
|
|
- android-avd-x86_64-linux
|
2020-05-21 16:28:10 +03:00
|
|
|
- android-emulator-linux
|
2020-05-06 17:28:37 +03:00
|
|
|
- linux64-minidump-stackwalk
|
|
|
|
|
- linux64-fix-stacks
|
2020-02-06 11:39:54 +03:00
|
|
|
default:
|
|
|
|
|
- linux64-minidump-stackwalk
|
2020-03-10 09:27:56 +03:00
|
|
|
- linux64-fix-stacks
|
