Граф коммитов

128 Коммитов

Автор SHA1 Сообщение Дата
Joel Maher f8875234b3 Bug 1621095 - add reftest-qr to run focused webrender reftests on android phones. r=bc
add reftest-qr to run focused webrender reftests on android phones.

Differential Revision: https://phabricator.services.mozilla.com/D72312
2020-04-24 18:54:51 +00:00
Bogdan Tara a5112d03db Backed out changeset 97280448a042 (bug 1621095) for test_ext_test.html failures CLOSED TREE 2020-04-24 17:09:37 +03:00
Joel Maher b9a6e9d31c Bug 1621095 - add reftest-qr to run focused webrender reftests on android phones. r=bc
add reftest-qr to run focused webrender reftests on android phones.

Differential Revision: https://phabricator.services.mozilla.com/D72312
2020-04-24 12:35:12 +00:00
Bogdan Tara 1eade95ccd Backed out changeset 0592b572c58d (bug 1624649) for many failures complaining about minidump_stackwalk path CLOSED TREE 2020-04-01 22:12:57 +03:00
Wander Lairson Costa b54bca51c3 Bug 1624649: Move android emu to pull from toolchain instead tooltool r=nalexander
Currently, we build android emulator packages manually and upload to
tooltool.

This patch switches it to be pulled from the toolchain built artifacts.

This also allows android tests to run in the staging environment.

Differential Revision: https://phabricator.services.mozilla.com/D68617

--HG--
extra : moz-landing-system : lando
2020-04-01 16:30:21 +00:00
Geoff Brown d46135408b Bug 1598746 - Adjust some mochitest and reftest SCHEDULES.exclusive entries; r=ahal
Use finer granularity for some reftest/mochitest SCHEDULES.exclusive entries,
so that reftest-plain does not run when only crashtests are modified, and
vice versa; similarly, break up mochitest into mochitest/browser-chrome/chrome/
a11y. Use schedules-component instead of category.

Differential Revision: https://phabricator.services.mozilla.com/D60085

--HG--
extra : moz-landing-system : lando
2020-03-24 14:55:28 +00:00
Bob Clary 8147c4bc45 Bug 1618919 - reduce frequency of jittest/jsreftest on arm7 to mozilla-central/try, add testing on release branches, r=jmaher.
Differential Revision: https://phabricator.services.mozilla.com/D67341

--HG--
extra : moz-landing-system : lando
2020-03-18 19:09:41 +00:00
Edwin Takahashi 3bec702dcb Bug 1620204 - enable windows10-aarch64 reftests, crashtests, mochitest-media on beta/release r=jmaher
Changes:

Specifically enable `mozilla-beta` and `mozilla-release` for windows10-aarch64 `reftest`, `crashtest` and `mochitest-media`.

This will exclude `mozilla-esr*` which is part of the `release` tag (https://searchfox.org/mozilla-central/source/taskcluster/taskgraph/util/attributes.py#18-27)

Differential Revision: https://phabricator.services.mozilla.com/D65811

--HG--
extra : moz-landing-system : lando
2020-03-06 22:00:19 +00:00
Edwin Takahashi 65d23c4f71 Bug 1620460 - turn off all tests except crashtest, reftest and mochitest-media on windows10-aarch64 r=jmaher
Changes:

Remove all tests other than `reftests`, `crashtests` and `mochitest-media` for windows10-aarch64.
Important changes are in `taskcluster/ci/test/test-platforms.yml` and `taskcluster/ci/test/test-sets.yml`.

I've gone ahead and removed the windows10-aarch64 specific entries in the YAML files as well.

Differential Revision: https://phabricator.services.mozilla.com/D65654

--HG--
extra : moz-landing-system : lando
2020-03-06 00:15:43 +00:00
Bob Clary 68ab8142d4 Bug 1610977 - disable service worker testing until alternatives are available, r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D64061

--HG--
extra : moz-landing-system : lando
2020-02-26 19:48:23 +00:00
Andreea Pavel 6a00f6a7b0 Backed out changeset 12c7490d8dfd (bug 1610977) for breaking android test_error_reporting.html on a CLOSED TREE 2020-02-25 18:35:25 +02:00
Bob Clary 66b9177ff4 Bug 1610977 - disable service worker testing until alternatives are available, r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D64061

--HG--
extra : moz-landing-system : lando
2020-02-25 15:25:38 +00:00
Edwin Takahashi 5d26f83a10 Bug 1602863 - update linux64 platform regex in yaml files to be compatible with linux64 and linux1804 strings r=gbrown
Changes:

Update `linux64` regex to in yaml files for suites that have been migrated over to run on ubuntu1804.

Current naming convention: `linux64-asan/opt`.
New naming convention: `linux1804-64-asan/opt`
Future (potential) convention: `linux2004-64-asan/opt`

Using the `linux.*64` regex will result in a match for all three of the names above. This will ensure that we don't need to constantly update the regex for each new version, while being specific enough.

Differential Revision: https://phabricator.services.mozilla.com/D59572

--HG--
extra : moz-landing-system : lando
2020-01-14 17:35:00 +00:00
Marco Castelluccio 9bbdae6a99 Bug 1607965 - Make Windows coverage build an opt build. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D59292

--HG--
rename : testing/mozharness/configs/builds/taskcluster_sub_win64/ccov_debug.py => testing/mozharness/configs/builds/taskcluster_sub_win64/ccov_opt.py
extra : moz-landing-system : lando
2020-01-10 09:51:17 +00:00
Geoff Brown 8f41e2cd7c Bug 1595279 - Adjust tasks run on windows aarch64; r=jmaher
Stop running integration branch browsertime tasks on windows10-aarch64;
these were added recently in bugs 1585013 and bug 1604113 but I don't
think there was any specific consideration of windows10-aarch64.
Restore mochitest-media and all reftest tests on mozilla-central only
on windows10-aarch64.

Differential Revision: https://phabricator.services.mozilla.com/D57658

--HG--
extra : moz-landing-system : lando
2019-12-18 21:29:23 +00:00
alexandru.ionescu bae763d008 Bug 1596367 Turn off testing and performance sherffinig on mozilla-inbound r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D55637

--HG--
extra : moz-landing-system : lando
2019-12-10 13:27:00 +00:00
Andrew Halberstadt f57f05e1c8 Bug 1601397 - [ci] Enable R-fis (tier 1) on mozilla-central and autoland, r=jmaher
Depends on D56211

Differential Revision: https://phabricator.services.mozilla.com/D56212

--HG--
extra : moz-landing-system : lando
2019-12-06 16:55:02 +00:00
Andrew Halberstadt 68f3f65093 Bug 1601397 - [ci] Refactor fission configuration for more flexability r=jmaher,gbrown
This implements a 'fission-run-by-projects' and 'fission-tier' key that mirrors
the non-fission versions. We need to duplicate the keys rather than use
something like 'by-variant' due to the order that things are processed in the
tests.py transforms.

These keys should only be temporary until Fission is running the same as
non-Fission. In the meantime they will give us greater control over what runs
where.

The taskgraph generated before and after this change is identical.

Differential Revision: https://phabricator.services.mozilla.com/D56211

--HG--
extra : moz-landing-system : lando
2019-12-06 19:55:14 +00:00
Marco Castelluccio ff9a035b66 Bug 1596279 - Set the same chunk numbers and timeouts for coverage opt builds as in coverage debug builds. r=jmaher
In bug 1596368 we will adjust them, after disabling tests in coverage debug builds.

Depends on D53000

Differential Revision: https://phabricator.services.mozilla.com/D53001

--HG--
extra : moz-landing-system : lando
2019-11-14 16:20:24 +00:00
Bob Clary 7e08e9cc75 Bug 1595279 - disable windows10-aarch64 on mozilla-central and restrict try to --full, r=jmaher.
Differential Revision: https://phabricator.services.mozilla.com/D52838

--HG--
extra : moz-landing-system : lando
2019-11-13 14:55:45 +00:00
Geoff Brown 7d2245678c Bug 1583695 - Adjust Android test timeouts; r=bc
Change the taskcluster max-run-time for mochitests and reftests to use the
defaults, now that android tests no longer run anywhere near 7200 seconds.
(Also noticed some unrelated tc configuration that is obsolete - tidied that.)
Also remove the special 600 second reftest timeout for android debug reftests.

Differential Revision: https://phabricator.services.mozilla.com/D47301

--HG--
extra : moz-landing-system : lando
2019-09-26 17:03:18 +00:00
Geoff Brown d636f9fd2b Bug 1581847 - Increase test chunks for windows 10 asan reftests; r=intermittent-reviewers,ahal
Avoid intermittent task timeouts.

Differential Revision: https://phabricator.services.mozilla.com/D46153

--HG--
extra : moz-landing-system : lando
2019-09-17 14:30:51 +00:00
Geoff Brown e003efe065 Bug 1579905 - Increase test chunks for windows10-ccov reftest; r=egao
Avoid intermittent task timeouts by running in more chunks.

Differential Revision: https://phabricator.services.mozilla.com/D45254

--HG--
extra : moz-landing-system : lando
2019-09-09 22:19:33 +00:00
Geoff Brown be67d46e14 Bug 1577037 - Stop running all Fennec functional tests; r=bc
Stop running all Fennec functional (non-performance) tests:
 - stop running all Android 4.3 tests
 - switch android-em-7 cppunit and android-hw jittest from the Fennec apk to the
   geckoview apk (no difference in behavior expected)
 - stop running Android 7.0 marionette tests, since they also run against Fennec
 - remove android-em-4.* references from taskcluster configs
 - remove android instance: extra-large references from taskcluster configs,
   since they only affect aws, which is no longer used for Android

Android-hw raptor tests running against Fennec remain; I will prepare a separate
patch for those.

Differential Revision: https://phabricator.services.mozilla.com/D43684

--HG--
extra : moz-landing-system : lando
2019-09-04 15:58:36 +00:00
Jeff Muizelaar 0815909698 Bug 1571969. Stop running all the QR tests as virtual-with-gpu. r=jmaher
This uses the layers.d3d11.enable-blacklist pref to allow running WebRender on WARP.

Differential Revision: https://phabricator.services.mozilla.com/D42255

--HG--
extra : moz-landing-system : lando
2019-08-18 12:59:49 +00:00
Narcis Beleuzu e2803d7c18 Backed out changeset 67be750311a1 (bug 1571969) for raptor failures on tests.py . CLOSED TREE 2019-08-18 06:22:48 +03:00
Jeff Muizelaar 5da9e3a7b5 Bug 1571969. Stop running all the QR tests as virtual-with-gpu. r=jmaher
This uses the layers.d3d11.enable-blacklist pref to allow running WebRender on WARP.

Differential Revision: https://phabricator.services.mozilla.com/D42255

--HG--
extra : moz-landing-system : lando
2019-08-16 22:43:48 +00:00
Razvan Maries 129bdaf0d0 Backed out changeset 4f8a94072fa6 (bug 1571969) as per Jeff's request. CLOSED TREE 2019-08-16 22:07:15 +03:00
Jeff Muizelaar ecf25e83b1 Bug 1571969. Stop running all the QR tests as virtual-with-gpu. r=jmaher
This uses the layers.d3d11.enable-blacklist pref to allow running WebRender on WARP.

Differential Revision: https://phabricator.services.mozilla.com/D42255

--HG--
extra : moz-landing-system : lando
2019-08-16 17:32:45 +00:00
Dorel Luca f97e939824 Backed out changeset 10a056f52e49 (bug 1571969) for cpp failure. CLOSED TREE 2019-08-16 19:02:56 +03:00
Jeff Muizelaar 82fe69f5d0 Bug 1571969. Stop running all the QR tests as virtual-with-gpu. r=jmaher
This uses the layers.d3d11.enable-blacklist pref to allow running WebRender on WARP.

Differential Revision: https://phabricator.services.mozilla.com/D42255

--HG--
extra : moz-landing-system : lando
2019-08-16 14:34:00 +00:00
Joel Maher ea680be1a5 Bug 1569916 - run reftest/crashtest on android-hw when gfx/* files change. r=ahal
run reftest/crashtest on android-hw when gfx/* files change.

Differential Revision: https://phabricator.services.mozilla.com/D39900

--HG--
extra : moz-landing-system : lando
2019-07-31 13:43:59 +00:00
Geoff Brown 46455c8f26 Bug 1568856 - Run android-hw jsreftest against geckoview; r=bc
Switch android-hw jsreftest to geckoview. Technically this runs all
android-hw reftests on geckoview -- I don't imagine we'll ever want to
run any android-hw fennec reftests.

Differential Revision: https://phabricator.services.mozilla.com/D39350

--HG--
extra : moz-landing-system : lando
2019-07-25 20:23:22 +00:00
Tom Ritter f0456750c9 Bug 1565949 - Bump the runtime of mingwclang x86 debug reftests r=firefox-build-system-reviewers,mshal
Differential Revision: https://phabricator.services.mozilla.com/D38026

--HG--
extra : moz-landing-system : lando
2019-07-16 18:30:26 +00:00
Edwin Gao 12afe9e77d Bug 1556866 - balance reftest chunks for macosx1014 r=jmaher
Changes:
- reduce reftest chunks for macosx1014
- streamline regex for web-platform.yml

Differential Revision: https://phabricator.services.mozilla.com/D38217

--HG--
extra : moz-landing-system : lando
2019-07-16 18:11:50 +00:00
Joel Maher 46c8e2539b Bug 1562745 - use debug builds for macosx1014 tests and disable text-utf8.html, stream-safe-creation.any.sharedworker.html, test_captive_portal_service.js temporarily r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D37458

--HG--
extra : moz-landing-system : lando
2019-07-10 07:02:43 +00:00
Dorel Luca 0987691994 Backed out changeset 78c77633f61f (bug 1562745) for WPT failures in signed-exchange/reporting/sxg-reporting-navigation-mi_error.tentative.html
--HG--
extra : rebase_source : 80c0911bea57a0a54787b2694efe622079e6c146
2019-07-10 06:53:18 +03:00
Joel Maher 0236569496 Bug 1562745 - use debug builds for macosx1014 tests and disable text-utf8.html, stream-safe-creation.any.sharedworker.html, test_captive_portal_service.js temporarily r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D37458

--HG--
extra : moz-landing-system : lando
2019-07-09 18:52:40 +00:00
Cosmin Sabou cddd4c6528 Backed out changeset f9c0c52368d6 (bug 1562745) for causing crashes on stream-safe-creation.any.serviceworker.html 2019-07-06 01:05:01 +03:00
Geoff Brown bfa723f163 Bug 1562745 - Make OSX10.14 debug tests actually use debug builds. r=jmaher
As far as I can tell, the intermittent suite_start failures are due to
stdout/stderr output interleaving -- a known issue for reftest logging,
without a clear way forward. Let's work around it the same way we did
on Windows.

Differential Revision: https://phabricator.services.mozilla.com/D37023

--HG--
extra : moz-landing-system : lando
2019-07-05 12:56:54 +00:00
Kartikaya Gupta 615038de48 Bug 1525314 - Run gecko reftests for WebRender on pixel 2. r=gbrown
Only enabled on try/m-c as tier-2 for now, per email discussion, to minimize
load on bitbar Pixel 2 devices.

Depends on D36799

Differential Revision: https://phabricator.services.mozilla.com/D36800

--HG--
extra : moz-landing-system : lando
2019-07-04 21:35:08 +00:00
Coroiu Cristina 3983fddf6d Backed out 6 changesets (bug 1525314) for reftest failures at reftests/svg/filters/css-filters/saturate-zero.html om a CLOSED TREE
Backed out changeset 0ed2509b7191 (bug 1525314)
Backed out changeset af72d1c4c107 (bug 1525314)
Backed out changeset ab21a3ff4ae4 (bug 1525314)
Backed out changeset 02399933ac4b (bug 1525314)
Backed out changeset 95790a07a93c (bug 1525314)
Backed out changeset 28f52fd3934e (bug 1525314)
2019-07-05 00:29:12 +03:00
Kartikaya Gupta e8b6b55632 Bug 1525314 - Run gecko reftests for WebRender on pixel 2. r=gbrown
Only enabled on try/m-c as tier-2 for now, per email discussion, to minimize
load on bitbar Pixel 2 devices.

Depends on D36799

Differential Revision: https://phabricator.services.mozilla.com/D36800

--HG--
extra : moz-landing-system : lando
2019-07-04 15:25:27 +00:00
Geoff Brown 945ee0068f Bug 1556058 - Update test expectations for Android 7.0 reftests; r=kats
These changes are needed for consistently green runs with the new emulator with
"-gpu on".
Most changes are simple removal of fuzzy-if(geckoview) but I also needed to add
at least one new fuzzy-if.
In this configuration we can run reftests in just 2 chunks (20 minutes each on
opt/30 minutes on debug).

Differential Revision: https://phabricator.services.mozilla.com/D36258

--HG--
extra : moz-landing-system : lando
2019-06-28 17:30:48 +00:00
Jan de Mooij 4eef6de2e1 Bug 1526659 - Use the default 3 chunks instead of 2 for Windows debug/ASan jsreftests to avoid time-outs. r=jmaher
Tests are imported from test262 upstream so this test suite is expected to become slower over time.

Differential Revision: https://phabricator.services.mozilla.com/D36295

--HG--
extra : moz-landing-system : lando
2019-06-28 10:21:02 +00:00
Edwin Gao 464a5faa1e Bug 1555454 - migrate jsreftests to macosx1014 r=gbrown
Changes:
- migrate jsreftest over to macosx1014
- re-balance the chunks for non-ccov variants of macosx1014

Differential Revision: https://phabricator.services.mozilla.com/D34771

--HG--
extra : moz-landing-system : lando
2019-06-12 21:23:07 +00:00
Geoff Brown baaf6d9e64 Bug 1556767 - Increase max-run-time for linux64 ccov jsreftest; r=egao
These tasks normally run in 45 to 55 minutes; if they exceed 60 minutes, the
task fails. Failures are not frequent, but I would like to avoid them. We could
increase chunks, but it looks like we have handled the other ccov cases like
this, by increasing the max-run-time.

Differential Revision: https://phabricator.services.mozilla.com/D33656

--HG--
extra : moz-landing-system : lando
2019-06-04 15:53:28 +00:00
Geoff Brown 92114a65b1 Bug 1555458 - Stop android-hw debug jittest/jsreftest on integration branches; r=egao
Incremental effort to improve android-hw device availability: Stop running android-hw
debug jsreftest and jittest on integration branches.
Also, remove the option for android-hw opt jittest on try. opt is a nice alternative
to pgo on try in general, but the risk of accidental (unnecessary) inclusion in
try pushes makes this a luxury we cannot afford on android-hw.

Differential Revision: https://phabricator.services.mozilla.com/D33156

--HG--
extra : moz-landing-system : lando
2019-05-30 17:29:24 +00:00
Edwin Gao c146994015 Bug 1553310 - Enable jsreftest/jittest on android-hw-p2-8-0-arm7-api-16 and correspondinly disable on android-em instances r=jmaher
Changes:

- add `jsreftest` to the list of permitted tests to run on `android-hw-p2-8-0-arm7-api-16`
- add necessary mozharness setup for `android-hw` for jsreftest
- disable `android-em` from running jsreftests

Differential Revision: https://phabricator.services.mozilla.com/D32262

--HG--
extra : moz-landing-system : lando
2019-05-24 18:58:56 +00:00
Andrew Halberstadt 2dff4a6138 Bug 1553527 - [ci] Create a new 'fission' test variant r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D32196

--HG--
extra : moz-landing-system : lando
2019-05-24 18:41:01 +00:00