Bug 1844638 - Add OSX1300 M2 platform to taskcluster. r=MasterWayZ,perftest-reviewers,taskgraph-reviewers,sparky

Differential Revision: https://phabricator.services.mozilla.com/D184178
This commit is contained in:
andrej 2023-08-14 18:39:30 +00:00
Родитель 5178d58a5a
Коммит 9a23ba5906
9 изменённых файлов: 636 добавлений и 48 удалений

Просмотреть файл

@ -655,6 +655,11 @@ workers:
implementation: generic-worker
os: macosx
worker-type: 'gecko-{alias}'
t-osx-1300-m2:
provisioner: releng-hardware
implementation: generic-worker
os: macosx
worker-type: 'gecko-{alias}'
t-osx-1015-power:
provisioner: releng-hardware
implementation: generic-worker

Просмотреть файл

@ -212,7 +212,11 @@ browsertime-tp6-essential:
raptor:
apps: [firefox, chrome, chromium, custom-car]
test: tp6
run-visual-metrics: true
run-visual-metrics:
by-test-platform:
macosx1300.*shippable.*: false
# Bug 1845014 Resolve osx 1300 vismet permafails
default: true
subtests:
- amazon
- [bing-search, bing]
@ -293,50 +297,60 @@ browsertime-benchmark:
raptor:
apps: [firefox, chrome, chromium, safari, custom-car]
subtests:
by-app:
firefox:
- ares6
- [assorted-dom, dom]
- [jetstream2, js2]
- [matrix-react-bench, mrb]
- [motionmark-animometer, mm-a]
- [motionmark-htmlsuite, mm-h]
- [speedometer, sp]
- [speedometer3, sp3]
- [stylebench, sb]
- [sunspider, ss]
- [twitch-animation, tw-a]
- [unity-webgl, ugl]
- [webaudio, wa]
safari:
- ares6
- [assorted-dom, dom]
- [jetstream2, js2]
# - [matrix-react-bench, mrb] (Bug 1802922)
- [motionmark-animometer, mm-a]
- [motionmark-htmlsuite, mm-h]
- [speedometer, sp]
- [speedometer3, sp3]
- [stylebench, sb]
- [sunspider, ss]
- [unity-webgl, ugl]
# - [webaudio, wa] (Bug 1802922)
custom-car:
- [speedometer, sp]
- [speedometer3, sp3]
by-test-platform:
macosx1300.*shippable.*:
by-app:
custom-car: []
chromium: []
safari: [] # Bug 1848400 safari perma-fails on osx1300
default:
- [speedometer, sp]
- [speedometer3, sp3]
default:
- ares6
- [assorted-dom, dom]
- [jetstream2, js2]
- [matrix-react-bench, mrb]
- [motionmark-animometer, mm-a]
- [motionmark-htmlsuite, mm-h]
- [speedometer, sp]
- [speedometer3, sp3]
- [stylebench, sb]
- [sunspider, ss]
- [unity-webgl, ugl]
- [webaudio, wa]
by-app:
firefox:
- ares6
- [assorted-dom, dom]
- [jetstream2, js2]
- [matrix-react-bench, mrb]
- [motionmark-animometer, mm-a]
- [motionmark-htmlsuite, mm-h]
- [speedometer, sp]
- [speedometer3, sp3]
- [stylebench, sb]
- [sunspider, ss]
- [twitch-animation, tw-a]
- [unity-webgl, ugl]
- [webaudio, wa]
safari:
- ares6
- [assorted-dom, dom]
- [jetstream2, js2]
# - [matrix-react-bench, mrb] (Bug 1802922)
- [motionmark-animometer, mm-a]
- [motionmark-htmlsuite, mm-h]
- [speedometer, sp]
- [speedometer3, sp3]
- [stylebench, sb]
- [sunspider, ss]
- [unity-webgl, ugl]
# - [webaudio, wa] (Bug 1802922)
custom-car:
- [speedometer, sp]
- [speedometer3, sp3]
default:
- ares6
- [assorted-dom, dom]
- [jetstream2, js2]
- [matrix-react-bench, mrb]
- [motionmark-animometer, mm-a]
- [motionmark-htmlsuite, mm-h]
- [speedometer, sp]
- [speedometer3, sp3]
- [stylebench, sb]
- [sunspider, ss]
- [unity-webgl, ugl]
- [webaudio, wa]
treeherder-symbol: Btime()
tier:
by-app:
@ -403,6 +417,8 @@ browsertime-benchmark:
matrix-react-bench: 1500
motionmark-htmlsuite: 1500
unity-webgl: 1500
speedometer3: 2100
speedometer: 2100
default: 900
mozharness:
extra-options:

Просмотреть файл

@ -361,6 +361,11 @@ macosx1015-64-ccov-qr/opt:
test-sets:
- macosx1015-64-qr-tests
macosx1300-64-shippable-qr/opt:
build-platform: macosx64-shippable/opt
test-sets:
- macosx1300-64-qr-tests
##
# Android platforms (matching /android-em.*/)
#

Просмотреть файл

@ -417,6 +417,10 @@ macosx64-talos:
# - talos-tabswitch # Bug 1453007 times out
# - talos-h1 # too long to unpack profile- Bug 1442893
macosx1300-64-qr-tests:
- browsertime-tp6-essential
- browsertime-benchmark
# Android
android-x86_64-tests:

Просмотреть файл

@ -137,6 +137,8 @@ def set_treeherder_machine_platform(config, tasks):
# treeherder.
"macosx1100-64/opt": "osx-1100/opt",
"macosx1100-64-shippable/opt": "osx-1100-shippable/opt",
"macosx1300-64/opt": "osx-1300/opt",
"macosx1300-64-shippable/opt": "osx-1300-shippable/opt",
"win64-asan/opt": "windows10-64/asan",
"win64-aarch64/opt": "windows10-aarch64/opt",
}
@ -652,6 +654,8 @@ def handle_tier(config, tasks):
"macosx1015-64-qr/debug",
"macosx1100-64-shippable-qr/opt",
"macosx1100-64-qr/debug",
"macosx1300-64-shippable-qr/opt",
"macosx1300-64-qr/debug",
"android-em-7.0-x86_64-shippable/opt",
"android-em-7.0-x86_64-shippable-lite/opt",
"android-em-7.0-x86_64/debug",

Просмотреть файл

@ -21,7 +21,9 @@ raptor_description_schema = Schema(
Optional("activity"): optionally_keyed_by("app", str),
Optional("apps"): optionally_keyed_by("test-platform", "subtest", [str]),
Optional("binary-path"): optionally_keyed_by("app", str),
Optional("run-visual-metrics"): optionally_keyed_by("app", bool),
Optional("run-visual-metrics"): optionally_keyed_by(
"app", "test-platform", bool
),
Optional("subtests"): optionally_keyed_by("app", "test-platform", list),
Optional("test"): str,
Optional("test-url-param"): optionally_keyed_by(

Просмотреть файл

@ -94,6 +94,7 @@ WINDOWS_WORKER_TYPES = {
MACOSX_WORKER_TYPES = {
"macosx1015-64": "t-osx-1015-r8",
"macosx1100-64": "t-osx-1100-m1",
"macosx1300-64": "t-osx-1300-m2",
}
transforms = TransformSequence()
@ -114,6 +115,8 @@ def set_worker_type(config, tasks):
task["worker-type"] = MACOSX_WORKER_TYPES["macosx1015-64"]
elif test_platform.startswith("macosx1100-64"):
task["worker-type"] = MACOSX_WORKER_TYPES["macosx1100-64"]
elif test_platform.startswith("macosx1300-64"):
task["worker-type"] = MACOSX_WORKER_TYPES["macosx1300-64"]
elif test_platform.startswith("win"):
# figure out what platform the job needs to run on
if task["virtualization"] == "hardware":

Просмотреть файл

@ -1509,7 +1509,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **gecko profile interval**: 1
* **lower is better**: false
* **page cycles**: 5
* **page timeout**: 180000
* **page timeout**: 600000
* **subtest lower is better**: true
* **subtest unit**: ms
* **test url**: `<http://\<host\>:\<port\>/Speedometer/index.html?raptor>`__
@ -1695,6 +1695,27 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
- ❌
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer**
- ✅
- ✅
- ✅
- ✅
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -1995,6 +2016,27 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
- ❌
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer**
- ✅
- ✅
- ✅
- ✅
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -2117,7 +2159,7 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
* **host from parent**: false
* **lower is better**: false
* **page cycles**: 5
* **page timeout**: 180000
* **page timeout**: 600000
* **repository**: https://github.com/WebKit/Speedometer
* **repository revision**: 36712deb57d45879f56dd2136f8a6ed8a22d964b
* **submetric summary method**: median
@ -2309,6 +2351,27 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
- ❌
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ✅
- ❌
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -2618,6 +2681,27 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
- ❌
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ✅
- ❌
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -10055,6 +10139,37 @@ Tests for page-load performance. The links direct to the actual websites that ar
- ❌
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-tp6-essential-chrome-amazon**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-chromium-amazon**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-custom-car-amazon**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-firefox-amazon**
- ✅
- ✅
- ✅
- ✅
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -10466,6 +10581,37 @@ Tests for page-load performance. The links direct to the actual websites that ar
- ❌
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-tp6-essential-chrome-bing-search**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-chromium-bing-search**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-custom-car-bing-search**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-firefox-bing-search**
- ✅
- ✅
- ✅
- ✅
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -11202,6 +11348,37 @@ Tests for page-load performance. The links direct to the actual websites that ar
- ❌
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-tp6-essential-chrome-cnn**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-chromium-cnn**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-custom-car-cnn**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-firefox-cnn**
- ✅
- ✅
- ✅
- ✅
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -12947,6 +13124,37 @@ Tests for page-load performance. The links direct to the actual websites that ar
- ❌
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-tp6-essential-chrome-fandom**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-chromium-fandom**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-custom-car-fandom**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-firefox-fandom**
- ✅
- ✅
- ✅
- ✅
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -14379,6 +14587,37 @@ Tests for page-load performance. The links direct to the actual websites that ar
- ❌
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-tp6-essential-chrome-google-slides**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-chromium-google-slides**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-custom-car-google-slides**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-firefox-google-slides**
- ✅
- ✅
- ✅
- ✅
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -15610,6 +15849,37 @@ Tests for page-load performance. The links direct to the actual websites that ar
- ✅
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-tp6-essential-chrome-instagram**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-chromium-instagram**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-custom-car-instagram**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-firefox-instagram**
- ✅
- ✅
- ✅
- ✅
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -19686,6 +19956,37 @@ Tests for page-load performance. The links direct to the actual websites that ar
- ❌
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-tp6-essential-chrome-twitter**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-chromium-twitter**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-custom-car-twitter**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-firefox-twitter**
- ✅
- ✅
- ✅
- ✅
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -20447,6 +20748,37 @@ Tests for page-load performance. The links direct to the actual websites that ar
- ❌
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-tp6-essential-chrome-wikipedia**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-chromium-wikipedia**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-custom-car-wikipedia**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-firefox-wikipedia**
- ✅
- ✅
- ✅
- ✅
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -20853,6 +21185,37 @@ Tests for page-load performance. The links direct to the actual websites that ar
- ❌
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-tp6-essential-chrome-yahoo-mail**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-chromium-yahoo-mail**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-custom-car-yahoo-mail**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-firefox-yahoo-mail**
- ✅
- ✅
- ✅
- ✅
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -23087,6 +23450,37 @@ A set of test pages that are run as live sites instead of recorded versions. The
- ❌
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-tp6-essential-chrome-cnn**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-chromium-cnn**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-custom-car-cnn**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-firefox-cnn**
- ✅
- ✅
- ✅
- ✅
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -25123,6 +25517,37 @@ Page-load performance test suite on Android. The links direct to the actual webs
- ❌
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-tp6-essential-chrome-amazon**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-chromium-amazon**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-custom-car-amazon**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-firefox-amazon**
- ✅
- ✅
- ✅
- ✅
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -26099,6 +26524,37 @@ Page-load performance test suite on Android. The links direct to the actual webs
- ❌
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-tp6-essential-chrome-cnn**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-chromium-cnn**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-custom-car-cnn**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-firefox-cnn**
- ✅
- ✅
- ✅
- ✅
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -28717,6 +29173,37 @@ Page-load performance test suite on Android. The links direct to the actual webs
- ✅
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-tp6-essential-chrome-instagram**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-chromium-instagram**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-custom-car-instagram**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-firefox-instagram**
- ✅
- ✅
- ✅
- ✅
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -30094,6 +30581,37 @@ Page-load performance test suite on Android. The links direct to the actual webs
- ❌
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-tp6-essential-chrome-wikipedia**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-chromium-wikipedia**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-custom-car-wikipedia**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-firefox-wikipedia**
- ✅
- ✅
- ✅
- ✅
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@ -31206,6 +31724,37 @@ These tests aren't used in standard testing, they are only used in the Raptor un
- ❌
.. list-table:: **test-macosx1300-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-tp6-essential-chrome-amazon**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-chromium-amazon**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-custom-car-amazon**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-tp6-essential-firefox-amazon**
- ✅
- ✅
- ✅
- ✅
.. list-table:: **test-windows10-32-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1

Просмотреть файл

@ -13,7 +13,7 @@ expose_gecko_profiler = true
lower_is_better = false
owner = SpiderMonkey Team
page_cycles = 5
page_timeout = 180000
page_timeout = 600000
subtest_lower_is_better = true
subtest_unit = ms
test_url = http://<host>:<port>/Speedometer/index.html?raptor