Граф коммитов

124 Коммитов

Автор SHA1 Сообщение Дата
Geoff Brown 38dd21ea87 Bug 1593779 - Bail out of test-verify tasks faster when there is no work to do; r=bc
This minor optimization is easily implemented: If there are no tests to verify, call fatal(0).
However, I encountered a minor obstacle: If the task exits before creating the upload directory,
the task fails, regardless of exit value; the remaining changes overcome this by creating the
upload directory earlier.

Differential Revision: https://phabricator.services.mozilla.com/D51684

--HG--
extra : moz-landing-system : lando
2019-11-04 21:46:57 +00:00
Bob Clary 0e4603dbfd Bug 1568623 - [test isolation] Add web-platform-tests support, r=jmaher.
Differential Revision: https://phabricator.services.mozilla.com/D39242

--HG--
extra : moz-landing-system : lando
2019-07-25 01:23:45 +00:00
Kartikaya Gupta 14cf3a5147 Bug 1558598 - Force WebRender on or off in the WPT harness. r=ato
Differential Revision: https://phabricator.services.mozilla.com/D35856

--HG--
extra : moz-landing-system : lando
2019-06-29 09:48:53 +00:00
James Graham 3dbbd8c724 Bug 1559902 - Make wpt more forgiving of crashes on treeherder, r=ahal
This is required so that crashes on import don't block updating tests.
It makes that change from 1539449 only apply to non-wpt suites, which is
not ideal but no worse than the previous setup.

Differential Revision: https://phabricator.services.mozilla.com/D35218
2019-06-19 11:07:03 -07:00
Dorel Luca cb53554453 Backed out 3 changesets (bug 1558598) for Geckoview failures
Backed out changeset d9c42c5f4850 (bug 1558598)
Backed out changeset d2f0c18e82de (bug 1558598)
Backed out changeset f24e407e9a6d (bug 1558598)
2019-06-12 18:19:07 +03:00
Kartikaya Gupta dac61ec776 Bug 1558598 - Force-disable webrender unless it is enabled. r=ahal
Ensure we force-disable webrender unless it is explicitly enabled
via the --enable-webrender flag. Also add missing env variables for
the telemetry_client.py case which appears to be a copy/paste error
that was not caught because we never run that test with WR enabled.

Depends on D34622

Differential Revision: https://phabricator.services.mozilla.com/D34623

--HG--
extra : moz-landing-system : lando
2019-06-12 13:13:35 +00:00
Andrew Halberstadt 6b482c7f2e Bug 1541527 - Remove "-e10s" from treeherder group symbols and task labels, r=jmaher,gbrown
Since e10s is the default configuration, we shouldn't explicitly mark things
with the "-e10s" suffix. Instead we should mark things that *don't* run with
'e10s. This patch removes '-e10s' from all treeherder group symbols and task
labels, adds the "-1proc" suffix to tasks that are non-e10s.

Differential Revision: https://phabricator.services.mozilla.com/D25958

--HG--
extra : moz-landing-system : lando
2019-04-15 18:18:33 +00:00
James Graham 4a3c4618c1 Bug 1519862 - Allow ignoring process_crash in determing mozharness job status, r=ahal
For shutdown crashes in wpt wse need to ignore the crashes for now
until we have a way of allowing specific ones. So just have a global
flag that permits this.

Differential Revision: https://phabricator.services.mozilla.com/D16836
2019-01-23 11:04:48 +00:00
Geoff Brown 49b8434f58 Bug 1512352 - Improve task retry handling in test-verify; r=bc 2019-01-14 07:58:41 -07:00
James Graham 48b47d05cd Bug 1513598 - Run only specified wpt tests with mach try fuzzy, r=marco
The keys in the test_paths dict contain the name of the suite e.g. web-platform-tests-testharness, so specify these
keys rather than the generic web-platform-tests key

Differential Revision: https://phabricator.services.mozilla.com/D14284

--HG--
extra : moz-landing-system : lando
2018-12-13 14:21:09 +00:00
James Graham 92886d48d7 Bug 1512816 - Use on-disk symbols path for wpt when available, r=ted
Differential Revision: https://phabricator.services.mozilla.com/D14262

--HG--
extra : moz-landing-system : lando
2018-12-12 19:03:15 +00:00
James Graham 3319035104 Bug 1509983 - Enable wpt android reftests on try/m-c, r=gbrown,ato
Depends on D13089

Differential Revision: https://phabricator.services.mozilla.com/D13090

--HG--
extra : moz-landing-system : lando
2018-11-30 15:31:50 +00:00
Marco Castelluccio 65ca4461a5 Bug 1489100 - Specify tests per suite in MOZHARNESS_TEST_PATHS. r=ahal
--HG--
extra : rebase_source : 09d05ca38ad25ce6178172e607ce0207525ea484
2018-11-15 17:54:13 +01:00
Henrik Skupin a0b3d921d3 Bug 1509175 - MnH has to use a resolution of 1600x1200 instead of 1366x768 for virtual screen. r=ato
Differential Revision: https://phabricator.services.mozilla.com/D12626

--HG--
extra : moz-landing-system : lando
2018-11-23 08:24:41 +00:00
James Graham 679ffd4520 Bug 1505739 - Enable wpt CSS reftests on Mac, r=automatedtester
Differential Revision: https://phabricator.services.mozilla.com/D11309

--HG--
extra : moz-landing-system : lando
2018-11-09 10:39:24 +00:00
Csoregi Natalia ce1a763fd8 Backed out 2 changesets (bug 1505739) for css failures e.g. /css/css-ui/caret-color-013.html. CLOSED TREE
Backed out changeset 135bb7f0d1a8 (bug 1505739)
Backed out changeset ea50b8a6a2a7 (bug 1505739)
2018-11-08 22:19:57 +02:00
James Graham d98f3d6c79 Bug 1505739 - Enable wpt CSS reftests on Mac, r=automatedtester
Differential Revision: https://phabricator.services.mozilla.com/D11309

--HG--
extra : moz-landing-system : lando
2018-11-08 18:16:15 +00:00
James Graham 8976487754 Bug 1500081 - Use --install-fonts to install fonts for wptrunner, r=AutomatedTester
This replaces a previous Firefox-only method except on Windows 7 where
it seems that we have some issues with the registry.

Differential Revision: https://phabricator.services.mozilla.com/D9091
2018-10-18 15:54:30 +01:00
James Graham bb19587996 Bug 1481723 - Enable wpt css tests on Windows, r=ato
MozReview-Commit-ID: ekP5TOSaRM

Differential Revision: https://phabricator.services.mozilla.com/D7201
2018-10-18 15:54:30 +01:00
Geoff Brown 355c3ff64a Bug 1495430 - Use AndroidMixin in web_platform_tests.py mozharness script; r=bc,automatedtester 2018-10-11 09:47:56 -06:00
Henrik Skupin 3057752927 Bug 1370636 - [wdspec] Update mozharness configuration for geckodriver on Windows. r=jgraham
The patch makes sure that the correct path to the geckodriver binary
is used for the web-platform-tests script.

Differential Revision: https://phabricator.services.mozilla.com/D7417

--HG--
extra : moz-landing-system : lando
2018-10-02 13:36:01 +00:00
Andrew Halberstadt ee4af8a5f1 Bug 1470266 - [mozharness] Add --setpref argument to main desktop scripts, r=jmaher
The mozharness scripts have a lot of special case arguments for one off
configurations, stuff like --e10s, --enable-webrender and --gpu-required.

Many of these command line args ultimately only end up setting an extra pref in
the test harnesses. Instead, let's just give mozharness the ability to set
prefs directly via --setpref. This way we can pass them through from taskgraph
without needing to add extra configuration to mozharness when making changes
like this.

Differential Revision: https://phabricator.services.mozilla.com/D7191

--HG--
extra : moz-landing-system : lando
2018-10-02 13:11:40 +00:00
Marco Castelluccio bd3f040c33 Bug 1476574 - Enable reset/dump for wpt and cleanup harness code for supporting reset/dump now that it is supported by all test suites. r=jmaher
--HG--
extra : source : c1b3950cc12f1642ad60338d2a8701e2b60131ea
extra : intermediate-source : 4ea7997194e9f995bb0b1e434524a0ea5596d758
extra : histedit_source : fffe672f456fd7c503792d2a3e99184c14bfd36c
2018-07-19 11:56:43 +02:00
Coroiu Cristina 46afadc431 Backed out 2 changesets (bug 1476574) for browser-chrome failures at browser/base/content/test/static/browser_all_files_referenced.js
Backed out changeset 4ea7997194e9 (bug 1476574)
Backed out changeset ec37892ce390 (bug 1476574)
2018-07-19 23:40:24 +03:00
Marco Castelluccio 57da0df505 Bug 1476574 - Enable reset/dump for wpt and cleanup harness code for supporting reset/dump now that it is supported by all test suites. r=jmaher
--HG--
extra : rebase_source : 554f640652e8a44e53d37ca8b4a139845efd75ec
extra : source : c1b3950cc12f1642ad60338d2a8701e2b60131ea
2018-07-19 11:56:43 +02:00
James Graham e7b4476630 Bug 1354232 - Chunk by dir more for wpt on asan, r=maja_zf
This means that when we run these tests, the LSAN exceptions will have
the minimum possible scope.

MozReview-Commit-ID: 5aFDWqSiaNb
2018-07-19 16:32:17 +01:00
Joel Maher 8ee7eee7e1 Bug 1467837 - adjust some code for test-coverage gpu/chunks and minor cleanup in per test code. r=gbrown 2018-06-08 16:21:14 -04:00
Narcis Beleuzu adf3d042d3 Backed out changeset a71f125a6d73 (bug 1464744) for wpt failures. CLOSED TREE 2018-06-04 02:58:20 +03:00
Xidorn Quan 8fc0bb9c61 Bug 1464744 followup - Enable wpt of css-scrollbars on all platforms. r=jgraham
--HG--
extra : source : 7e8608344bd8f270a32a9ba233d88e529365b0af
2018-06-04 09:03:19 +10:00
Gregory Mierzwinski 6b7a09faaf Bug 1465300 - Exit test coverage chunk after all suites are checked for baseline tests. r=jmaher
This patch fixes baseline test addition. It allows all baselines to run in all test suites. Previously, only the test suite which had too many tests executed in it, was searched to the end for any baselines. Now, we continue to all other test suites before we finish.

MozReview-Commit-ID: FWMAsHb22CO

--HG--
extra : rebase_source : 7dbcdb3977bd351367ff9fa7892e41c2b86a2dce
2018-05-29 22:11:00 -04:00
Joel Maher 9e5d9c55f5 Bug 1442790 - fix test-verify to not fail on: 'No checks run.'. r=ahal 2018-05-28 06:44:24 -04:00
Dorel Luca 047df7a932 Merge mozilla-inbound to mozilla-central. a=merge 2018-05-26 07:09:39 +03:00
Gregory Mierzwinski 6e9713d33a Bug 1462434 - Prevent baseline coverage tests from being skipped. r=jmaher
This patch prevents baseline coverage tests from being skipped when too many tests are being run.

MozReview-Commit-ID: JVTOYZAXbwf

--HG--
extra : rebase_source : dedd6a323445f030b60180805c6c6adf5d10771b
2018-05-23 12:41:52 -04:00
Chris AtLee 444afb9092 Bug 1237182: Remove BuildbotMixin in favour of AutomationMixin r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D1371

--HG--
rename : testing/mozharness/test/test_mozilla_buildbot.py => testing/mozharness/test/test_mozilla_automation.py
extra : rebase_source : 2fdec7a8b06c1b29ea47de1b368c08d9b8b75c3e
2018-05-16 12:51:37 -04:00
Joel Maher 8ff40400ce Bug 1461440 - test-verify should support MOZHARNESS_TEST_PATHS. r=gbrown 2018-05-23 09:59:51 -04:00
Chris AtLee e3d628f8c0 Bug 1237182: Remove mozharness blobber mixin r=mtabara
--HG--
extra : rebase_source : 3a631d554fdd143aa5e06903c067b1907f40a82f
extra : source : aedcb763d9479b484ec4f5603e0f2c4efd0c9511
2018-05-11 18:16:08 -04:00
Chris AtLee 6e7f604585 Bug 1237182: Removing unused buildbot support r=Callek
MozReview-Commit-ID: EjclZgc864L

--HG--
extra : rebase_source : aebc03899ad88aa2838825c14a45c59e1e59be05
extra : source : ba91fec47e908619d9a8f550ee65cd78f67e3d59
2018-05-04 13:51:35 -04:00
Narcis Beleuzu 495eed2d41 Backed out changeset ba91fec47e90 (bug 1237182) for breaking the Windows 2012 Nightlies. a=backout 2018-05-12 17:33:18 +03:00
Chris AtLee ef68c91c87 Bug 1237182: Removing unused buildbot support r=Callek
MozReview-Commit-ID: EjclZgc864L

--HG--
extra : rebase_source : 5ad7974462d14c00916fd0c88e06843e0f1f4276
2018-05-04 13:51:35 -04:00
Dorel Luca 979ac450c8 Backed out changeset 67d2aa892562 (bug 1237182) for breaking Decision task. CLOSED TREE 2018-05-10 21:20:39 +03:00
Chris AtLee 714c7498fd Bug 1237182: Removing unused buildbot support r=Callek
MozReview-Commit-ID: EjclZgc864L

--HG--
extra : rebase_source : 18ceefd30a5e5df3be7dc4152256b4407f61e8eb
2018-05-04 13:51:35 -04:00
Joel Maher cd861869c6 Bug 1458730 - Test-Verify summarization fails on windows. r=gbrown 2018-05-10 06:00:43 -04:00
Joel Maher 91721cfdc5 Bug 1455316 - sometimes when test-verify finds a failure, all future tests are marked as failing also. r=gbrown 2018-05-01 14:04:24 -04:00
Andreea Pavel 959a710440 Backed out changeset afbec9a6802c (bug 1455316) for breaking sy jobs 2018-05-02 23:46:23 +03:00
Joel Maher 08e964fd73 Bug 1455316 - sometimes when test-verify finds a failure, all future tests are marked as failing also. r=gbrown 2018-05-01 14:04:24 -04:00
Noemi Erli 583038f191 Backed out changeset 5cdb10268f47 (bug 1455316) for breaking Users/cltbld/tasks/task_1525191282/mozharness/mozharness/base/script.py on a CLOSED TREE 2018-05-01 20:17:08 +03:00
Joel Maher 3e9caea623 Bug 1455316 - sometimes when test-verify finds a failure, all future tests are marked as failing also. r=gbrown 2018-05-01 11:50:46 -04:00
Marco Castelluccio 00d8757d68 Bug 1431753 - Upload per-test coverage reports. r=sparky
--HG--
extra : rebase_source : 52a23196a01867d1409229d6c50ce7c92b9367e6
2018-04-19 12:42:38 +02:00
Joel Maher 9077c8cf36 Bug 1453056 - test-verify should have the ability to run in chunks depending on the incoming tests. r=gbrown 2018-04-24 10:20:11 -04:00
Marco Castelluccio 7e52f8d35c Bug 1431753 - Add a test-coverage test suite, similar to test-verify, that runs tests in isolation in coverage mode. r=gbrown,jmaher
--HG--
extra : rebase_source : 1dcbefe05533b1295761a966484b2b250c3a6fa5
2018-04-19 19:19:31 +02:00