Граф коммитов

8071 Коммитов

Автор SHA1 Сообщение Дата
egao 45a93dd0b7 Bug 1637011 - refactor web-platform-tests chunking process in chunking.py r=ahal
Changes:

  - for web-platform-tests codepath, no longer perform filtering of the runtimes information to a list of key:value.
  - for web-platform-tests codepath, load runtimes information into an OrderedDict in order from highest to lowest runtime.
  - if any test paths remain after initial chunking by runtime information, distribute such paths across all chunks.

Differential Revision: https://phabricator.services.mozilla.com/D76538
2020-05-27 20:21:48 +00:00
Jamie Nicol bfd4af6e88 Bug 1585050 - Run mochitests on android emulator with webrender enabled. r=ktaeleman
Differential Revision: https://phabricator.services.mozilla.com/D77000
2020-05-27 16:43:48 +00:00
Ben Hearsum 34915064c5 Bug 1637542: Disable {linux64,win32,win64} opt and linux64 artifact builds on autoland. r=jmaher
The opt builds were originally disabled in bug 1522111, but were re-enabled when webgpu was added.

Differential Revision: https://phabricator.services.mozilla.com/D76906
2020-05-27 17:53:38 +00:00
Dzmitry Malyshau abaaa872a5 Bug 1634425 - Integrate WebGPU API tracing r=jgilbert
This is the logic of tracing the WebGPU API calls at the level of wgpu-core,
serialized into a folder of choosing on the user drive. Traces are extremely portable,
they can be shared (on BugZilla) and then replayed on the developer machine,
which can have a different architecture from the users machine.

The standalone player is introduced in `gfx/wgpu/player`, similar to WebRender's Wrench.

The output dir is controlled by "dom.webgpu.traceDir" pref. No tracing happens if it's empty.

Differential Revision: https://phabricator.services.mozilla.com/D73333
2020-05-27 16:49:03 +00:00
Andrew Halberstadt a829c1fad0 Bug 1640382 - [taskgraph] Don't try to set 'schedules-component' on tasks that use 'when.files-changed', r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D76979
2020-05-27 14:37:37 +00:00
Sylvestre Ledru 03c7506984 no bug - run-on-project: Add a new note r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D76730
2020-05-27 14:24:58 +00:00
Gregory Mierzwinski 804a5e3ba6 Bug 1641017 - Fix browsertime mobile run-on-projects settings. r=perftest-reviewers,AlexandruIonescu
This patch fixes the run-on-projects settings for browsertime mobile tests which were regressed from a bad merge (or multiple large patches landing very close to each other).

Differential Revision: https://phabricator.services.mozilla.com/D76911
2020-05-27 06:10:37 +00:00
Andrew Halberstadt cc77d57a4a Bug 1641065 - [taskgraph.optimize] Refactor the 'test_optimziation' flag to a set of projects, r=marco
Instead of a boolean, it's now a set of projects for which tasks should be removed.
If they project doesn't match the specified set it will be kept.

This ensures tasks that have these optimzers applied won't run on |mach try auto|.

Differential Revision: https://phabricator.services.mozilla.com/D76987
2020-05-27 11:52:54 +00:00
Sylvestre Ledru 1432104c95 Bug 1641168 - Don't run mingw tests in autoland r=aryx,marco
Differential Revision: https://phabricator.services.mozilla.com/D77005
2020-05-27 09:46:30 +00:00
egao a769706988 Bug 1638183 - increase xorg client count to 2048 for ubuntu1804-test docker image r=jmaher
Changes:
  - apply an explicit increase in the number of xorg client count to 2048.
  - remove the custom.conf file as it was not making any difference in the behavior of the docker image.

Differential Revision: https://phabricator.services.mozilla.com/D76897
2020-05-26 19:40:29 +00:00
Bogdan Tara 6ed3c943f7 Backed out changeset f4ed4d3e0e9e (bug 1634425) for hazard failure on WebGPUParent.cpp CLOSED TREE 2020-05-27 01:12:40 +03:00
Dzmitry Malyshau 67c0d914f3 Bug 1634425 - Integrate WebGPU API tracing r=jgilbert
This is the logic of tracing the WebGPU API calls at the level of wgpu-core,
serialized into a folder of choosing on the user drive. Traces are extremely portable,
they can be shared (on BugZilla) and then replayed on the developer machine,
which can have a different architecture from the users machine.

The standalone player is introduced in `gfx/wgpu/player`, similar to WebRender's Wrench.

The output dir is controlled by "dom.webgpu.traceDir" pref. No tracing happens if it's empty.

Differential Revision: https://phabricator.services.mozilla.com/D73333
2020-05-26 21:15:40 +00:00
Tom Prince 9e8692e9d1 Bug 1639334: Set `run-on-projects` for `gv-junit-e10s-multi` correctly; r=ahal
The original patch add `run-on-projects` to `TEST_VARIANTS`, but nothing
currently looks at that. Move it into a `replace` block, which gets merged with
the task definition.

This is enough to handle this specific change, but if more control is needed
per-test, we should revisit how this is handled. Fission supports
`fission-run-on-projects` and `fission-tier` to override those values based on
the variants, but it would probably make sense to generalize those to have more
general way of specifying variant-specific configuration.

Differential Revision: https://phabricator.services.mozilla.com/D76772
2020-05-26 14:40:56 +00:00
Gregory Mierzwinski 18cd0c676d Bug 1640429 - Run v8 fetch with --force. r=jmaher
This patch attempts to fix the long-running customv8 toolchain tasks by adding a --force to the `fetch v8` call. This additional option prevents `fetch` from checking for existing .gclient files (which should never exist) to help with the long delay we are seeing in this call.

Differential Revision: https://phabricator.services.mozilla.com/D76857
2020-05-26 15:42:22 +00:00
Kershaw Chang 9fe6da812b Bug 1602832 - P2: Create 'socketprocess_networking' test variant r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D58112
2020-05-26 14:30:16 +00:00
Andrew Halberstadt 4c80f3f36b Bug 1640890 - [ci] Use 'push-interval-10' optimization on fuzzing builds, r=bc
This has the same effect as the 'backstop' optimization except it *doesn't*
optimize tasks on non-autoland branches.

Differential Revision: https://phabricator.services.mozilla.com/D76842
2020-05-26 13:45:03 +00:00
Gregory Mierzwinski 008827b6ac Bug 1638376 - Run recorded sites as live sites once a week. r=perftest-reviewers,alexandru.irimovici
This patch enables a new cron job that runs our recorded sites as live sites once a week through browsertime so we can continuously monitor how well our recordings match with what page the user is seeing.

Differential Revision: https://phabricator.services.mozilla.com/D75575
2020-05-26 11:20:27 +00:00
Butkovits Atila f167b5c275 Backed out 6 changesets (bug 1602832) for causing perma failure at test_trr_case_sensitivity.js. CLOSED TREE
Backed out changeset 0e9c378df995 (bug 1602832)
Backed out changeset 534fedb3836e (bug 1602832)
Backed out changeset db012c05d64e (bug 1602832)
Backed out changeset ca0c207dca21 (bug 1602832)
Backed out changeset bea1f3aeea49 (bug 1602832)
Backed out changeset 2d54acd78124 (bug 1602832)
2020-05-26 13:09:07 +03:00
Kershaw Chang 917b0cce29 Bug 1602832 - P2: Create 'socketprocess_networking' test variant r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D58112
2020-05-26 08:35:22 +00:00
Andrew Halberstadt f5b5676618 Bug 1633866 - [taskgraph] Implement the ability for tasks to dynamically specify chunks, r=gbrown,jmaher
This allows tasks to opt into dynamic chunking. This means rather than define
the chunks ahead of time, in-tree manifest runtime data is used to guess how
many chunks are needed for a reasonable average task runtime (currently 20
min).

Only suites that are chunked in the taskgraph, and therefore whose manifests
are known ahead of time, can opt into this feature.

Differential Revision: https://phabricator.services.mozilla.com/D76497
2020-05-25 18:52:12 +00:00
Kartikaya Gupta 4e7d703303 Bug 1638664 - Run the windows searchfox build as cross-compilation on Linux. r=asuth
This updates the task definition for the win64 searchfox job to closely match
the win64/debug task definition in taskcluster/ci/build/windows.yml. So, instead
of running the build with the mozsearch-plugin on a windows worker, it runs
on a Linux worker and does a cross-compile of windows code. The end result in
terms of searchfox artifacts is equivalent, except for absolute filename paths.
I verified that with mozsearch/mozsearch#299 and mozsearch/mozsearch-mozilla#87
in place, searchfox correctly indexes windows-only C++ and Rust code.

Differential Revision: https://phabricator.services.mozilla.com/D76721
2020-05-25 18:53:08 +00:00
Andrew Halberstadt 3901f12775 Bug 1640580 - [taskgraph.util.bugbug] Translate WPT paths from relative source directory to WPT ids, r=marco
Differential Revision: https://phabricator.services.mozilla.com/D76719
2020-05-25 15:44:58 +00:00
egao 8e54528b9d Bug 1637463 - support loading of runtime information for a specific suite r=ahal
Changes:
  - permit existing code in chunking.py and mochitests/runtests.py to load manifest runtime information specifict to the suite

Differential Revision: https://phabricator.services.mozilla.com/D75592
2020-05-24 00:24:05 +00:00
Mihai Alexandru Michis 74ff68a9a5 Backed out 3 changesets (bug 1637463) for causing bc jobs to timeout.
CLOSED TREE

Backed out changeset 93efb53380c2 (bug 1637463)
Backed out changeset 5c8ccda5f1b1 (bug 1637463)
Backed out changeset a5fc1b604238 (bug 1637463)
2020-05-23 02:35:26 +03:00
egao d40fc31a1b Bug 1637463 - support loading of runtime information for a specific suite r=ahal
Changes:
  - permit existing code in chunking.py and mochitests/runtests.py to load manifest runtime information specifict to the suite

Differential Revision: https://phabricator.services.mozilla.com/D75592
2020-05-22 18:31:47 +00:00
Marco Castelluccio 30cfe57424 Bug 1640047 - Don't take into account bugbug's known tasks if they are likely wrong. r=ahal DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D76418
2020-05-22 15:28:43 +00:00
Andrew Halberstadt 0591e31c1f Bug 1639349 - [ci] Set up a SCHEDULES rule to exclude non-webrender tests on webrender-only pushes, r=gbrown
Depends on D76433

Differential Revision: https://phabricator.services.mozilla.com/D76434
2020-05-22 14:03:46 +00:00
Andrew Halberstadt e6fc2d3678 Bug 1639349 - [taskgraph] Set schedules-component for test kind in an independent transform, r=gbrown
Depends on D76306

Differential Revision: https://phabricator.services.mozilla.com/D76433
2020-05-22 14:03:46 +00:00
Ben Hearsum d7624bd580 Bug 1638014: blacklist shippable tests from try when there is an opt version of the test available r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D76012
2020-05-22 17:45:06 +00:00
Rob Wu 27981af497 Bug 1636158 - Update the addons-mlbf.bin attachment via periodic_file_updates.sh r=sfraser
Tested by running the following code and verifying that the script runs
successfully and generates a reasonable diff with the latest metadata
and matching attachment content:

```
$ cd taskcluster/docker/periodic-updates/
$ tar -czf- -s "#$(git rev-parse --show-cdup)#topsrcdir/#" . $(awk -v d="$(git rev-parse --show-cdup)" '/^# %include/{print d$3}' Dockerfile) | docker build - -t hsts-local
$ docker run -e DO_REMOTE_SETTINGS=1 -e PRODUCT="firefox" -e BRANCH="mozilla-central" -e USE_MOZILLA_CENTRAL=1 hsts-local
```

After that, I opened a shell in the container, built Firefox and ran the
following test, to confirm that the updated records are used correctly:

```
mach test toolkit/mozapps/extensions/test/xpcshell/rs-blocklist/test_blocklist_mlbf_dump.js
```

Differential Revision: https://phabricator.services.mozilla.com/D76158
2020-05-22 01:37:37 +00:00
Tom Prince 2bf24e6359 Bug 1639955: Use prefix for geckodriver toolchain artifacts; r=aki
We originally switched it to use just `public/` becuase iscript broke with the
extra path, but that broke out-of-tree consumers. Now that iscript is fixed,
switch it back.

Differential Revision: https://phabricator.services.mozilla.com/D76409
2020-05-22 03:38:32 +00:00
Tom Prince 9703222150 Bug 1639955: Include `toolchain-artifact` in the cached-task digest; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D76410
2020-05-22 03:38:29 +00:00
Chris AtLee 4c1292f8f8 Bug 1637381: Fix reference to old tarball for win64-clang-tidy r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D76420
2020-05-22 01:12:56 +00:00
Justin Wood d582323fcb Bug 1640057 - Make condition profile fetch use the correct directory (en-US from shippable). r=aki
Fixes bustage from 1623355.

Differential Revision: https://phabricator.services.mozilla.com/D76424
2020-05-22 01:47:28 +00:00
Sylvestre Ledru 27f8422c60 Bug 1635826 - platform docs: improve the list of platforms r=marco DONTBUILD
* document more jobs
* document when some are running
* remove some old jobs
  - stylo seq a9c044b771
  - webrender pgo https://github.com/mozilla/treeherder/pull/6437

Differential Revision: https://phabricator.services.mozilla.com/D76184
2020-05-21 09:16:12 +00:00
Bob Clary 5d2b7338b8 Bug 1639886 - Allow the Backstop optimization strategy to be used outside of the test optimization, r=ahal.
Differential Revision: https://phabricator.services.mozilla.com/D76350
2020-05-21 20:53:20 +00:00
Andrew Halberstadt 5ad7af589e Bug 1633866 - [taskgraph] Refactor logic around manifest chunking, r=egao
This sets things up to be a little bit easier and cleaner to modify going
forward. The taskgraph before/after this change is identical.

Differential Revision: https://phabricator.services.mozilla.com/D74452
2020-05-21 15:58:24 +00:00
Justin Wood e49ff70dad Followup to Bug 1623355 - Part 1, specifically fix typo in 'nightly'. CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D76352
2020-05-21 18:07:22 +00:00
Chris AtLee b34b110320 Bug 1637381: Install zstandard on linting images on a CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D76348
2020-05-21 17:31:01 +00:00
Gregory Mierzwinski c4ae7d3f70 Bug 1639374 - Disable majority of browsertime desktops. r=perftest-reviewers,Bebe
This patch disables the majority of browsertime desktop tests. First, we disable all of the tests on autoland so no more browsertime tests run there. These benchmark tests that were running there will be enabled on mozilla-central along with the rest of the tests. Finally, all browsertime tests will be further restricted to running on the linx64-shippable platform.

Differential Revision: https://phabricator.services.mozilla.com/D76212
2020-05-21 14:07:15 +00:00
Justin Wood 6c368aa658 Bug 1617481 - Remove most of nightly attribute from taskcluster/taskgraph. r=aki
We leave the nightly index in place for now in order to support Geckodriver until Bug 1577110 sticks.

Differential Revision: https://phabricator.services.mozilla.com/D74510
2020-05-21 16:31:04 +00:00
Justin Wood 3f24c1f0f0 Bug 1617481 - Remove nightly index's. r=aki
They only really worked for promoted builds when the build was generated on the nightly cron anyway.

Differential Revision: https://phabricator.services.mozilla.com/D74509
2020-05-21 16:30:11 +00:00
Justin Wood f8829d41ab Bug 1636637 - Remove now-redundant geckoview fat aar (non-shippable). r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74508
2020-05-21 16:30:03 +00:00
Justin Wood b2ef4dc0b7 Bug 1636637 - Make geckoview shippable its own treeherder line and update its index. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74507
2020-05-21 16:30:01 +00:00
Justin Wood 4cff028d95 Bug 1636635 - Swap devedition to shippable index and use non-Nightly treeherder symbols. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74506
2020-05-21 16:29:59 +00:00
Justin Wood ec5c1d56da Bug 1623355 - Part 9/9 - Remove 'pgo' support from performance testing target tasks. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74961
2020-05-21 16:29:51 +00:00
Justin Wood 27e43125b2 Bug 1623355 - Part 8/9 - Set new shippable index's for Android shippable builds. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74360
2020-05-21 16:29:48 +00:00
Justin Wood 66aebeae94 Bug 1623355 - Part 7/9 - Set treeherder symbols appropriately for Android Shippable. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74359
2020-05-21 16:29:46 +00:00
Justin Wood d02f213610 Bug 1623355 - Part 6/9 - Remove Android PGO build types. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74309
2020-05-21 16:29:44 +00:00
Justin Wood 897aafaf58 Bug 1623355 - Part 5/9 - Rename pgo instrumentation steps to shippable. And make condition profiles use shippable. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74308
2020-05-21 16:29:41 +00:00