Граф коммитов

9289 Коммитов

Автор SHA1 Сообщение Дата
Mike Hommey 8d18757970 Bug 1680182 - Use dump-syms toolchain rather than tooltool artifact. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D98426
2020-12-02 22:26:26 +00:00
Mike Hommey b7e6c5660f Bug 1680183 - Make dump-syms binary compatible with older libstdc++. r=firefox-build-system-reviewers,mhentges
This will allow to run it on older systems without LD_LIBRARY_PATH
tricks.

Differential Revision: https://phabricator.services.mozilla.com/D98425
2020-12-02 22:26:26 +00:00
Mike Hommey 12679da6a0 Bug 1680152 - Bump macos SDK to 10.12. r=spohl,firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D98421
2020-12-02 21:50:28 +00:00
Mike Hommey 5543e97235 Bug 1680172 - Upgrade builders to rustc 1.48. r=firefox-build-system-reviewers,dmajor
We keep dump-syms on 1.47 because it breaks at runtime when built with
1.48. It also puts it in sync with other toolchains that won't upgrade
until we need them to.

Differential Revision: https://phabricator.services.mozilla.com/D98422
2020-12-02 22:12:04 +00:00
Gregory Mierzwinski 8651d29de5 Bug 1676703 - Fail visual-metrics tasks if a zero is reported in the metrics. r=perftest-reviewers,AlexandruIonescu
This patch makes vismet tasks fail when the *Index metrics are reported as zero.

Differential Revision: https://phabricator.services.mozilla.com/D96735
2020-12-02 17:22:39 +00:00
Kimberly Sereduck 4958438156 Bug 1674851 - Add chromedriver for Chrome 87 r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D98357
2020-12-02 17:12:51 +00:00
Steve Fink 3d02a92acd Bug 1680159 - Do not collect source code during automated hazard analysis. r=jonco
Differential Revision: https://phabricator.services.mozilla.com/D98409
2020-12-02 16:22:40 +00:00
Mitchell Hentges 4184bca3d4 Bug 1661153: Removes _ensure_zstd() and usages r=firefox-build-system-reviewers,glandium
The zstandard package is always installed in the mach virtualenv.
The patch assumes that zstandard is only used from the mach virtualenv,
and never the build virtualenv.

Differential Revision: https://phabricator.services.mozilla.com/D98387
2020-12-02 15:16:14 +00:00
Christian Holler 119d129332 Bug 1677049 - Add mochitest-browser-chrome to the TSan test set. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D98451
2020-12-02 12:41:31 +00:00
Butkovits Atila de782976bf Backed out changeset 5153f0eaf518 (bug 1676533) as requested by glandium. CLOSED TREE 2020-12-02 07:58:47 +02:00
Mike Hommey 72cc842ad5 Bug 1671545 - Require at least rustc 1.47.0 to build. r=firefox-build-system-reviewers,dmajor
And remove the rust 1.43 toolchain, now it's not used anymore.

Differential Revision: https://phabricator.services.mozilla.com/D93733
2020-12-02 00:01:56 +00:00
Mike Hommey 14c1084f72 Bug 1679938 - Don't recurse the build into mfbt for projects that don't need it. r=firefox-build-system-reviewers,mhentges
While all toolkit and js-based projects make use of mfbt, some others,
like tools/crashreporter and tools/update-packaging, don't.

So instead of including mfbt from the top-level directory, include it
from the relevant project top-level mozbuilds.

This allows to remove the dependency on mfbt files in the hash for the
minidump-stackwalk and mar-tools toolchains.

Differential Revision: https://phabricator.services.mozilla.com/D98378
2020-12-01 23:52:03 +00:00
Alexis Beingessner e2c5b3cbbe Bug 1680124 - Document Rust builds (and add some pointers/links for clang ones). r=dmajor
Differential Revision: https://phabricator.services.mozilla.com/D98386
2020-12-01 23:55:34 +00:00
Csoregi Natalia e1c9e65ec1 Backed out changeset 9bd89da852cf (bug 1680028) for causing gecko decision tasks to fail. CLOSED TREE 2020-12-01 21:34:50 +02:00
Julien Cristau 40bf7ed8c2 Bug 1680028 - run l10n-bumper daily instead of hourly. r=releng-reviewers,jmaher
To ensure l10n updates are still picked up by beta builds in a timely
fashion, remove "DONTBUILD" from commit messages when running on
mozilla-beta, and run a couple of hours before the "daily-releases" job
starts.

Differential Revision: https://phabricator.services.mozilla.com/D98349
2020-12-01 18:52:23 +00:00
Razvan Maries 1e986258d1 Backed out changeset f5532b7dc480 (bug 1672181) as per Gregory's request. CLOSED TREE 2020-12-01 17:12:11 +02:00
Julien Cristau 025ffb9f0a Bug 1677755 - turn the mac devedition build into a universal binary with x86-64 + aarch64. r=glandium DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D97347
2020-12-01 08:27:57 +00:00
Mike Hommey 5df4c50570 Bug 1679923 - Upgrade rustc to 1.49 beta 2 for arm64 mac builds. r=firefox-build-system-reviewers,dmajor
At the same time, remove the macosx64-rust-beta toolchain, unused since
bug 1678154.

Differential Revision: https://phabricator.services.mozilla.com/D98277
2020-12-01 03:53:16 +00:00
Mike Hommey 5a48880a05 Bug 1679924 - Setup plain debug mac builds on automation. r=firefox-build-system-reviewers,dmajor
Bug 1672888 set up a plain opt build that runs on m-c only, like the
other plain opt builds. It didn't add plain debug builds on integration
branches as well to avoid having too many jobs running on the slim
mac worker pool, but since bug 1678154 moved most jobs off them, we can
now add those.

Differential Revision: https://phabricator.services.mozilla.com/D98279
2020-12-01 03:56:19 +00:00
David Major fc89cd6438 Bug 1679909 - Use PATH instead of -B in build-compiler-rt.sh r=glandium
As of version 12, clang doesn't accept `-B` for target-prefixed binaries. This is said to be for GCC compatibility: 3452a0d8c1

Differential Revision: https://phabricator.services.mozilla.com/D98261
2020-12-01 04:32:55 +00:00
Sebastian Hengst c42742a46b Bug 1679886 - increase max task run time for Android profile generation to 45 minutes. r=aerickson DONTBUILD
It exceeded the timeout frequently after being close to it before.

Differential Revision: https://phabricator.services.mozilla.com/D98246
2020-11-30 22:59:04 +00:00
Jeff Gilbert 637fafc5a7 Bug 1662516 - Enable m-gli on Linux. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D95096
2020-11-30 18:13:19 +00:00
Andrew Halberstadt 6db2921d7f Bug 1672181 - [taskgraph] Make test tasks py3 by default and add a py2 override r=bc,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D97669
2020-11-26 17:42:27 +00:00
stransky 114cd41e5a Bug 1665844 [Wayland] Fix mutter to start in Wayland mode in Mozilla automation, r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D97161
2020-11-30 07:10:57 +00:00
Bogdan Tara 168c45a7ac Backed out changeset 951e6717abf4 (bug 1662516) for M-gli failures CLOSED TREE 2020-11-30 09:19:00 +02:00
Jeff Gilbert a10a4ccb9e Bug 1662516 - Enable m-gli on Linux. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D95096
2020-11-30 05:44:33 +00:00
Sylvestre Ledru be678a9be7 Bug 1588710 - Try to use clang 11 for stackwalk r=firefox-build-system-reviewers,andi,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D97568
2020-11-28 13:34:01 +00:00
Ricky Stewart 34344a8073 Bug 1661624 - Include `psutil` in the `mach` `virtualenv`s r=firefox-build-system-reviewers,rstewart
Install `psutil` when setting up the `mach` `virtualenv`s and stop importing the in-tree version in the build.

Nothing in-tree currently assumes or mandates the installation of `psutil` (all uses of `psutil` are guarded with imports of the form `try : import psutil; except ImportError: psutil = None`), so there's no back-incompatibility concerns here. There will be an awkward period where telemetry will be lacking CPU/disk data for everyone until they re-run `mach bootstrap` or `mach create-mach-environment`, but that will come back as people gradually update their `virtualenv`s.

An alternative to circumvent that issue is REQUIRING that `psutil` be installed by adding an assertion in `mach` that `psutil` can be found (allowing us to remove all the conditional logic in-tree around whether `psutil` is installed), but I wouldn't claim that we're ready to do that and deal with whatever fallout might occur.

Differential Revision: https://phabricator.services.mozilla.com/D90914
2020-11-27 21:05:00 +00:00
Mike Hommey e68c3c3d3b Bug 1678451 - Split the Ubuntu test image and work around recent issues. r=releng-reviewers,bhearsum
To avoid breakage from Ubuntu package upgrades, we split the test image
into two, one that sets up the packages only, and that won't change when
we need to update our scripts, and another that derives from it, that
adds all our scripts and other setup.

Additionally, we work around the recent timeout issues due to the
upgrade of packages.

The timeout itself is due to gst-launch waiting indefinitely when it
crashes, rather than exiting with an error code. Bug 1679491 addresses
this issue, but the core problem is that gst-launch crashes, which seems
to be that some change in libc (presumably "Fix pthread_rwlock_try*lock
stalls") turns `gst_object_unref: assertion '((GObject *)
object)->ref_count > 0' failed` fatal warnings (which were already
happening) into actual crashes (presumably because a race condition is
lost on a use-after-free).

This workaround, however, will stop working as soon as the updated libc
package migrates from bionic-updates into bionic proper, presumaby on
the next 18.04 dot-release. Hopefully, we won't be rebuilding the base
image for a while, avoiding further problems. Eventually, we'll want to
upload the base image to docker hub so that it's set in stone, and
change the FROM in the base image to use that instead.

Differential Revision: https://phabricator.services.mozilla.com/D98045
2020-11-27 16:34:50 +00:00
Razvan Maries 960c5da1e7 Backed out changeset a39c15378e6f (bug 1672181) for Mochitest perma failures. CLOSED TREE 2020-11-26 19:38:22 +02:00
Andrew Halberstadt 5e91379180 Bug 1672181 - [taskgraph] Make test tasks py3 by default and add a py2 override r=bc,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D97669
2020-11-20 21:45:17 +00:00
Olivier Tilloy 75b4e18676 Bug 1677781 - add the mpris slot to snapcraft.yaml to enable media controls. r=jlorenzo
Differential Revision: https://phabricator.services.mozilla.com/D97889
2020-11-26 10:47:42 +00:00
Mike Hommey d6a8360a45 Bug 1677022 - Followup to unbust toolchain tasks with no arguments.
Differential Revision: https://phabricator.services.mozilla.com/D97974
2020-11-26 01:52:30 +00:00
Alexis Beingessner a2e4c21db2 Bug 1677593 - Add support for building rust from source. r=glandium
This adds a linux64-rust-dev toolchain and a git fetch of rust-lang/rust
that it can source from (stable tag for 1.47).

There are some issues with cross-compiling, so for now the toolchain only
builds a host build, although a lot of the machinery for cross compiling is
there for anyone brave/desperate enough to get it working.

Also note some changes were made to Rust's config.toml between 1.47 and 1.50,
so some version detection may need to be added in the future.

There is experimental support for providing patches via a new --patch flag.

Additionally, I documented the existence of the "bors-" mode.

Differential Revision: https://phabricator.services.mozilla.com/D97497
2020-11-26 00:42:27 +00:00
Cristina Coroiu f795b6e3c2 Backed out 2 changesets (bug 1654817) on request by aklotz
Backed out changeset bf721cd8ab14 (bug 1654817)
Backed out changeset fb1c314e6394 (bug 1654817)
2020-11-23 19:12:29 +02:00
Andi-Bogdan Postelnicu ccbacf12e5 Bug 1678399 - Make clang-tidy-external part of our clang-tidy suit. r=freddyb
Differential Revision: https://phabricator.services.mozilla.com/D97643
2020-11-23 08:30:49 +00:00
Mike Hommey 9eae3b523e Bug 1678485 - Enable PGO on arm64 mac builds. r=firefox-build-system-reviewers,andi,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D97749
2020-11-20 15:16:14 +00:00
Ricky Stewart c9720a8ee7 Bug 1676533 - Consult the base revision for file hashes instead of the on-disk files in `mach artifact` r=ahal
This enables `mach artifact` and `mach bootstrap` to not fail due to local changes.

Differential Revision: https://phabricator.services.mozilla.com/D96892
2020-11-20 18:58:51 +00:00
Joel Maher 37e2c77538 Bug 1677640 - remove windows7 talos-webgl-gli. r=sparky
remove windows7 talos-webgl-gli test from being scheduled.

Differential Revision: https://phabricator.services.mozilla.com/D97685
2020-11-20 14:08:57 +00:00
Mike Hommey 9604340588 Bug 1678154 - Change aarch64 macos builds to be more like the x86_64 ones. r=firefox-build-system-reviewers,dmajor
This also removes some differences between some json files in test
archives.

Differential Revision: https://phabricator.services.mozilla.com/D97700
2020-11-20 03:14:15 +00:00
Mike Hommey ffd412896c Bug 1678154 - Create a clang repack including the aarch64 mac compiler-rt. r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D97699
2020-11-20 01:54:33 +00:00
Mike Hommey 323c368072 Bug 1678154 - Enable aarch64 mac support to llvm-dsymutil. r=firefox-build-system-reviewers,dmajor
While here, upgrade it to LLVM 11.

Differential Revision: https://phabricator.services.mozilla.com/D97697
2020-11-20 02:09:20 +00:00
Mike Hommey f27976b952 Bug 1678154 - Build compiler-rt for aarch64 macos. r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D97696
2020-11-20 03:18:15 +00:00
Mike Hommey d015ddb9b6 Bug 1678154 - Add aarch64-prefixed binaries to cctools. r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D97695
2020-11-20 03:19:36 +00:00
Mike Hommey 4efa8e2b00 Bug 1678154 - Pack the mac OS SDK as a private artifact. r=firefox-build-system-reviewers,nalexander
Differential Revision: https://phabricator.services.mozilla.com/D97694
2020-11-20 00:03:13 +00:00
Mike Hommey 03bc6afe15 Bug 1677914 - Don't require the SHELL variable to be set. r=firefox-build-system-reviewers,mhentges
And don't set SHELL on mac workers (added in da452e43b5d5 because of the
exception thrown by this code not having a fallback)

Differential Revision: https://phabricator.services.mozilla.com/D97686
2020-11-19 22:43:05 +00:00
Mike Hommey a6418700d5 Bug 1678439 - Upgrade rustc to 1.49 beta for arm64 mac builds. r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D97666
2020-11-19 20:27:01 +00:00
Andrew Creskey bbfaa4e2e8 Bug 1677617 - Disable the fenix MAIN test r=sparky
The test will no longer run on commits until we can resolve the failure, which is blocked on a Fenix issue.
https://github.com/mozilla-mobile/fenix/issues/13470

Differential Revision: https://phabricator.services.mozilla.com/D97226
2020-11-19 15:33:05 +00:00
Gregory Mierzwinski b92c9ca167 Bug 1677119 - Fix run-on-projects settings for the live site tests. r=perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D97592
2020-11-19 14:53:03 +00:00
Johan Lorenzo c83718f66d Bug 1676130 - part 1: Backed out changeset 19db5464f5d1 (bug 1668908) r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D96409
2020-11-19 13:31:00 +00:00
Frederik Braun 8ace599a12 Bug 1678295 - move civet to clang 11 r=andi
Differential Revision: https://phabricator.services.mozilla.com/D97562
2020-11-19 12:47:58 +00:00
Razvan Maries fa10d6af82 Backed out changeset 684580bcc087 (bug 1672704) for Gecko Decision Task bustage. CLOSED TREE 2020-11-19 07:00:39 +02:00
Jean-Yves Avenard 6c4d6a6510 Bug 1672704 - Disable sanity test with talos. r=mattwoodrow
Differential Revision: https://phabricator.services.mozilla.com/D94920
2020-11-18 15:28:27 +00:00
Razvan Maries 4ce2cfb03a Backed out changeset bc0c64106daa (bug 1665844) for automation errors. CLOSED TREE 2020-11-19 01:10:48 +02:00
Aki Sasaki 4ac4b1acab Bug 1677914 - add SHELL env var to mac builders. r=taskgraph-reviewers,jmaher DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D97469
2020-11-18 20:51:27 +00:00
stransky 6e0f22f7e9 Bug 1665844 [Wayland] Fix mutter to start in Wayland mode in Mozilla automation, r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D97161
2020-11-18 20:30:05 +00:00
Andrew Halberstadt fbeb7bbe02 Bug 1672967 - [taskgraph.action] Ensure we copy the task definition when retriggering backfills, r=taskgraph-reviewers,jmaher
Backfill tasks might run with a slightly different definition than the task
with the same label in the current task graph. When we encounter them, ensure
we create a new task with an (almost) identical definition, rather than
grabbing it from the current push's full-task-graph.json.

There's already an action that has this behaviour (that is used for the
decision task). So rather than re-implement this behaviour in the regular
retrigger action, this patch ensures that the 'retrigger-decision' action
applies to backfills rather than the regular one.

Differential Revision: https://phabricator.services.mozilla.com/D97352
2020-11-18 16:45:56 +00:00
Andrew Halberstadt 43e87a2037 Bug 1672967 - [taskgraph.action] Fix bug in actions lookup, r=taskgraph-reviewers,jmaher
According to the documentation, actions are supposed to have an "order" system,
where the first action that applies to a task via its context, is supposed to
take precedence. But when running the match algorithm, we never break out of
the loop. So we end up applying the *last* action that matches a tasks' context.

As far as I can tell, this means we have been using the 'retrigger-disabled'
action for everything and things like retriggering Decision tasks don't work.

Differential Revision: https://phabricator.services.mozilla.com/D97351
2020-11-18 16:49:11 +00:00
Andrew Halberstadt 095481e67d Bug 1672967 - [taskgraph.action] Don't proceed with creating task if 'test_manifest_modifier' failed, r=taskgraph-reviewers,jmaher
If we aren't able to assign the appropriate manifests to the backfill, the
backfill is useless. Let's just let the exception propagate and fail loudly,
rather than log an error and keep going.

Differential Revision: https://phabricator.services.mozilla.com/D97350
2020-11-17 20:31:30 +00:00
Cristina Coroiu e1be39b9e8 Backed out changeset 101792a18a59 (bug 1676533) on request by Ricky for causing regressions 2020-11-18 18:10:04 +02:00
Joel Maher 6f2b0274a7 Bug 1677640 - reduce scheduling of win32 perf tests on integration and release branches. r=sparky
remove default scheduling of talos, raptor, awsy on windows7-32.  Ensure these are still available on try server.  There is one exception, the talos-webgl-gli job, this is scheduled via a transform and I would rather leave that alone or remove all gli tests.

Differential Revision: https://phabricator.services.mozilla.com/D97310
2020-11-18 00:16:55 +00:00
Jeff Gilbert 6d3ebf06f8 Bug 1607940 - Extend m-gli variant use until 2021-02-01. r=jmaher DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D97373
2020-11-17 22:01:02 +00:00
Mike Hommey 909363e1da Bug 1677473 - Add missing test archive to mac universal build artifacts. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D97238
2020-11-17 15:57:42 +00:00
Rob Lemley 0a1e4da703 Bug 1677794 - Remove sm-nowarp-jit from ridealong linux64 try builds. r=firefox-build-system-reviewers,dmajor
sm-nowarp-jit was removed from spidermonkey/linux.yml in bug 1673553.

Differential Revision: https://phabricator.services.mozilla.com/D97339
2020-11-17 18:08:03 +00:00
Ricky Stewart ddc8d97c34 Bug 1676533 - Consult the base revision for file hashes instead of the on-disk files in `mach artifact` r=ahal
This enables `mach artifact` and `mach bootstrap` to not fail due to local changes.

Differential Revision: https://phabricator.services.mozilla.com/D96892
2020-11-16 18:51:03 +00:00
Andi-Bogdan Postelnicu e9fbba867c Bug 1666550 - Update `clang-tools` to `clang-11`. r=dmajor
Differential Revision: https://phabricator.services.mozilla.com/D97137
2020-11-17 15:04:14 +00:00
Noemi Erli e0fd535990 Backed out changeset c5f7092adb7a (bug 1665844) for causing mass mochitest automation errors CLOSED TREE 2020-11-17 05:50:06 +02:00
Mike Hommey 824a5891ad Bug 1677023 - Set UPLOAD_DIR on generic-worker like we do for docker_worker. r=taskgraph-reviewers,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D96964
2020-11-16 23:51:30 +00:00
Mike Hommey 5bfabfaaf1 Bug 1677022 - Allow to run toolchain tasks on mac workers. r=taskgraph-reviewers,aki
By using a string instead of list for the command, we leave it to
the run-task transform to wrap with bash, which we don't need to do
ourselves anymore.

Differential Revision: https://phabricator.services.mozilla.com/D96963
2020-11-16 23:51:30 +00:00
Mike Hommey eb485ced35 Bug 1677020 - Always cap try tasks to a 28 days expiry. r=taskgraph-reviewers,jmaher
Currently, if a task defines its own expiry with a very large value,
that will be respected even on try, where we actually don't want that to
happen.

This also helps simplify the setup for docker images.

We also take on the occasion to remove the discrepancy between the
default expiry for tasks in general and tests in particular. Bug 1258497
set the original expiry to 14 days, bug 1281004 added another place
where the expiry was set to 14 days for tests specifically, and then bug
1304180 changed the expiry to 28 days, but it just seems the location
for tests was overlooked rather than deliberately left to 14 days.

Differential Revision: https://phabricator.services.mozilla.com/D96962
2020-11-16 23:51:22 +00:00
Mike Hommey 82a882888d Bug 1543149 - Use `mach python` to run mozharness build script and remove PYTHONPATH hack. r=releng-reviewers,aki
Also fix the gecko path on extra-config-path flags on mac tasks
(currently not causing problems because unused).

And while here, we switch to python3.

Differential Revision: https://phabricator.services.mozilla.com/D96961
2020-11-13 18:32:28 +00:00
stransky 370bfbe6bc Bug 1665844 [Wayland] Fix mutter to start in Wayland mode in Mozilla automation, r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D97161
2020-11-16 18:52:09 +00:00
Gregory Mierzwinski c7a02fda76 Bug 1677478 - Disable conditioned profiles on mobile browsertime. r=aryx DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D97174
2020-11-16 22:46:19 +00:00
Mike Hommey ff50994089 Bug 1672888 - Setup plain mac builds on automation. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D96958
2020-11-13 14:22:08 +00:00
Ben Hearsum 390a288378 Bug 1677550: Native ARM64 Mac Nightly Fails to Update r=aki
Differential Revision: https://phabricator.services.mozilla.com/D97217
2020-11-16 20:48:21 +00:00
Alexis Beingessner 9a0f581986 Bug 1671691 - Enable Rust stdlib instrumentation. r=decoder
* Bumps the tsan toolchain to rust-nightly-2020-11-14 that has my patches to make -Zbuild-std work in vendored environments:
  * https://github.com/rust-lang/cargo/pull/8834
  * https://github.com/rust-lang/rust/pull/78790

* Passes -Zbuild-std to cargo when MOZ_TSAN is defined (mk_add_options --enable-thread-sanitizer)

* Removes generic Rust supressions and adds much more specific ones
    * One presumed upstream false positive from tsan not understanding the code
    * One actual upstream bug tsan found (yay!)
    * One new real issue uncovered
    * One issue that probably already existed intermittently but I happened to hit

Differential Revision: https://phabricator.services.mozilla.com/D97165
2020-11-16 18:36:41 +00:00
Bob Clary f53d2424e1 Bug 1675330 - Do not use exception tasks when replacing tasks using index-search. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D96565
2020-11-16 18:18:43 +00:00
Ben Hearsum 7a641114f3 Bug 1677550: Native ARM64 Mac Nightly Fails to Update r=aki
This patch adjusts the BCJ options for macOS builds to avoid using
optimizations that only work on x86/x86_64.

Differential Revision: https://phabricator.services.mozilla.com/D97196
2020-11-16 18:13:15 +00:00
Noemi Erli f24bd4fcff Backed out 4 changesets (bug 1666345, bug 1661624, bug 1667152, bug 1666347) for causing mochitest failures CLOSED TREE
Backed out changeset 8ce536574e74 (bug 1666347)
Backed out changeset 7cc5b13a3bf6 (bug 1666345)
Backed out changeset e112876ba18b (bug 1661624)
Backed out changeset 0f03ce337449 (bug 1667152)
2020-11-16 21:06:12 +02:00
Ricky Stewart d8119e6288 Bug 1661624 - Include `psutil` in the `mach` `virtualenv`s r=firefox-build-system-reviewers,mhentges
Install `psutil` when setting up the `mach` `virtualenv`s and stop importing the in-tree version in the build.

Nothing in-tree currently assumes or mandates the installation of `psutil` (all uses of `psutil` are guarded with imports of the form `try : import psutil; except ImportError: psutil = None`), so there's no back-incompatibility concerns here. There will be an awkward period where telemetry will be lacking CPU/disk data for everyone until they re-run `mach bootstrap` or `mach create-mach-environment`, but that will come back as people gradually update their `virtualenv`s.

An alternative to circumvent that issue is REQUIRING that `psutil` be installed by adding an assertion in `mach` that `psutil` can be found (allowing us to remove all the conditional logic in-tree around whether `psutil` is installed), but I wouldn't claim that we're ready to do that and deal with whatever fallout might occur.

Differential Revision: https://phabricator.services.mozilla.com/D90914
2020-11-13 20:21:45 +00:00
Gregory Mierzwinski df3b9c9835 Bug 1677503 - Disable conditioned profiles for desktop. r=aryx DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D97171
2020-11-16 15:59:05 +00:00
Dzmitry Malyshau 67a1f9eb04 Bug 1629357 - Make WebGPU dependent on WebRender feature r=aosmond
WebGPU itself doesn't care about WebRender or even the GPU process.
However, the presentation to canvas as written today only works with WebRender, so
it seems fine to have it as a dependency in general.

An alternative could be to just fail getContext() call if webrender is disabled.

Differential Revision: https://phabricator.services.mozilla.com/D70888
2020-11-16 15:25:39 +00:00
Dzmitry Malyshau 997b81e57e Bug 1677233 - Fix windows7-32-qr jobs r=gw
Differential Revision: https://phabricator.services.mozilla.com/D97060
2020-11-16 14:58:51 +00:00
James Graham ce553ffb6c Bug 1677084 - Run wpt tests on mac qr configurations, r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D97145
2020-11-16 14:05:26 +00:00
Jan de Mooij 7f3a15f80c Bug 1673553 part 2 - Remove Warp shell flags and Treeherder jobs. r=iain,jmaher
A bit counterintuitive because we're keeping Warp and not Ion, but it's easiest
to make this change and later potentially rename the Ion prefs to Warp prefs.

Depends on D96987

Differential Revision: https://phabricator.services.mozilla.com/D96988
2020-11-13 18:21:18 +00:00
Mihai Alexandru Michis 06103d0e92 Backed out 3 changesets (bug 1666345, bug 1667152, bug 1661624) for causing mochitest timeouts.
CLOSED TREE

Backed out changeset baa1f7a615e4 (bug 1666345)
Backed out changeset b6646baa866d (bug 1661624)
Backed out changeset e4d550db6037 (bug 1667152)
2020-11-13 22:14:45 +02:00
Ben Hearsum 2cebc89f5f Bug 1648832: Make updater/Balrog support AArch64 macOS. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D97028
2020-11-13 18:41:56 +00:00
Ricky Stewart 69321f149f Bug 1661624 - Include `psutil` in the `mach` `virtualenv`s r=firefox-build-system-reviewers,mhentges
Install `psutil` when setting up the `mach` `virtualenv`s and stop importing the in-tree version in the build.

Nothing in-tree currently assumes or mandates the installation of `psutil` (all uses of `psutil` are guarded with imports of the form `try : import psutil; except ImportError: psutil = None`), so there's no back-incompatibility concerns here. There will be an awkward period where telemetry will be lacking CPU/disk data for everyone until they re-run `mach bootstrap` or `mach create-mach-environment`, but that will come back as people gradually update their `virtualenv`s.

An alternative to circumvent that issue is REQUIRING that `psutil` be installed by adding an assertion in `mach` that `psutil` can be found (allowing us to remove all the conditional logic in-tree around whether `psutil` is installed), but I wouldn't claim that we're ready to do that and deal with whatever fallout might occur.

Differential Revision: https://phabricator.services.mozilla.com/D90914
2020-11-13 03:03:33 +00:00
Cristina Coroiu 16460d64d1 Merge mozilla-central to autoland a=merge. CLOSED TREE 2020-11-13 18:45:40 +02:00
Cristina Coroiu 625f0008fd Merge autoland to mozilla-central a=merge 2020-11-13 18:20:41 +02:00
Dorel Luca 44e6dfd7e0 Merge autoland to mozilla-central. a=merge 2020-11-13 11:58:20 +02:00
Andrew Osmond 14c1a2a995 Bug 1676925 - Remove code supporting the defunct WebRender experiments. r=jrmuizel,marionette-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D96943
2020-11-13 05:40:10 +00:00
Mike Hommey 14c18cae4f Bug 1675740 - Republish one more file to make beetmover happy. r=me,a=bustage 2020-11-13 13:14:44 +09:00
Mike Hommey 537689499d Bug 1675740 - Republish more files to make beetmover happy. r=me,a=bustage 2020-11-13 10:33:17 +09:00
smolnar 1e6e466d99 Backed out 4 changesets (bug 1666347, bug 1667152, bug 1661624, bug 1666345) for causing mingw bustage. CLOSED TREE
Backed out changeset 19f707f5c097 (bug 1666347)
Backed out changeset 3732ee259759 (bug 1666345)
Backed out changeset 353d3c9e74b9 (bug 1661624)
Backed out changeset a651515586a8 (bug 1667152)
2020-11-12 19:55:58 +02:00
Steve Fink 2c0345bdaf Bug 1672428 - Remove hazard-analysis.sh r=jonco
Differential Revision: https://phabricator.services.mozilla.com/D95467
2020-11-12 20:12:28 +00:00
Steve Fink 5daa65c47f Bug 1672428 - Run a self-test before doing the actual analysis. r=jonco
Differential Revision: https://phabricator.services.mozilla.com/D95442
2020-11-12 20:00:24 +00:00
Steve Fink 07550f5718 Bug 1672428 - Switch the actual analysis to mach r=jonco
Differential Revision: https://phabricator.services.mozilla.com/D95441
2020-11-12 19:58:16 +00:00
Steve Fink d235350b21 Bug 1672428 - Remove a layer of mapping from "project" to "application" r=jonco
Differential Revision: https://phabricator.services.mozilla.com/D95438
2020-11-12 19:26:26 +00:00
Steve Fink 4d6b3ec016 Bug 1672428 - Allow simultaneous browser and shell instances of the hazard analysis r=jonco
Differential Revision: https://phabricator.services.mozilla.com/D95436
2020-11-12 19:26:12 +00:00
Steve Fink 2ba95a258e Bug 1672428 - Use `mach hazards build-shell` for actual hazard job JS shell r=jonco
Differential Revision: https://phabricator.services.mozilla.com/D95094
2020-11-12 19:26:06 +00:00
Tom Ritter c66c67c6df Bug 1674914 - Switch the verify-updatebot script to the autoland API r=sheehan DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D96724
2020-11-12 16:33:20 +00:00
Alexis Beingessner d1d354bb8f Bug 1674773 - make tsan builds use consistent flags. r=rstewart
This makes --enable-thread-sanitizer turn on Rust tsan (-Zsanitizer=thread).
This requires changing SpiderMonkey tsan to use the tsan rust nightly.

In future changes, more Rust tsan integration will key off of MOZ_TSAN.

Differential Revision: https://phabricator.services.mozilla.com/D96453
2020-11-10 21:11:37 +00:00
Andrew Halberstadt c4b40283ab Bug 1676946 - [taskgraph] Fix invalid os value in util.chunking.guess_mozinfo_from_task, r=taskgraph-reviewers,aki
The value for 'info["os"]' is "win" not "windows". As set further up in this
function.

Differential Revision: https://phabricator.services.mozilla.com/D96903
2020-11-12 20:48:06 +00:00
Frederik Braun 6446264f93 Bug 1666808 - enable code-review for external clang-tidy r=tjr,andi,marco
Differential Revision: https://phabricator.services.mozilla.com/D91149
2020-11-13 11:49:51 +00:00
Ricky Stewart 55f90afcca Bug 1661624 - Include `psutil` in the `mach` `virtualenv`s r=firefox-build-system-reviewers,mhentges
Install `psutil` when setting up the `mach` `virtualenv`s and stop importing the in-tree version in the build.

Nothing in-tree currently assumes or mandates the installation of `psutil` (all uses of `psutil` are guarded with imports of the form `try : import psutil; except ImportError: psutil = None`), so there's no back-incompatibility concerns here. There will be an awkward period where telemetry will be lacking CPU/disk data for everyone until they re-run `mach bootstrap` or `mach create-mach-environment`, but that will come back as people gradually update their `virtualenv`s.

An alternative to circumvent that issue is REQUIRING that `psutil` be installed by adding an assertion in `mach` that `psutil` can be found (allowing us to remove all the conditional logic in-tree around whether `psutil` is installed), but I wouldn't claim that we're ready to do that and deal with whatever fallout might occur.

Differential Revision: https://phabricator.services.mozilla.com/D90914
2020-11-12 15:58:05 +00:00
Brindusan Cristian 0f710bf462 Backed out changeset 2052e35c9932 (bug 1638365) for performance regressions as requested by alexandrui on irc. CLOSED TREE 2020-11-12 14:31:20 +02:00
Mike Hommey 2c3e9aa3e9 Bug 1675740 - Replace the mac shippable build with a build that unifies a x86_64 and an aarch64 build. r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D96691
2020-11-12 05:40:42 +00:00
Mike Hommey 9f6f422cd2 Bug 1675740 - Allow to skip the upload-symbols tasks. r=taskgraph-reviewers,aki
Differential Revision: https://phabricator.services.mozilla.com/D96782
2020-11-12 04:35:48 +00:00
Lars T Hansen 9ae09ac9bb Bug 1674722 - Update raptor options for wasm tests. r=perftest-reviewers,AlexandruIonescu
The pref name has changed from wasm_ionjit to wasm_optimizingjit
(partly to accomodate macOS, partly because this is better for the
current architecture).  So rename the prefs, and also rename the tests
to reflect this reality.  A PR has been submitted to update awfy.

Differential Revision: https://phabricator.services.mozilla.com/D96376
2020-11-11 12:50:33 +00:00
Lars T Hansen 7c0ad487d5 Bug 1675836 - remove two wasm-cranelift tests. r=perftest-reviewers,AlexandruIonescu
Remove two raptor tests that are obsoleted because the configuration they
test is being removed (in bug 1674722).  PR has been filed for ditto removal in awfy, https://github.com/mozilla-frontend-infra/firefox-performance-dashboards/pull/343.

Differential Revision: https://phabricator.services.mozilla.com/D96375
2020-11-11 09:10:46 +00:00
Tom Ritter 490b9e9b02 Bug 1674897 - Potentially raise an error in the updatebot verification script r=aki DONTBUILD
If we don't find any revisions in !public() - when run on autoland - then the
assumptions of the script are incorrect and we may have changed something, such
that the script starts silently succeeding even though it's not checking anything.

Differential Revision: https://phabricator.services.mozilla.com/D95591
2020-11-10 22:45:37 +00:00
Ben Hearsum 986014a362 Bug 1676493: Use v2 api for secondary balrog toplevel blob submission. r=aki DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D96624
2020-11-10 20:41:02 +00:00
Henrik Skupin ef63e6c9bb Bug 1669169 - [marionette] Add MnFr TaskCluster job to run Marionette tests with actors disabled. r=marionette-reviewers,jdescottes,jmaher,maja_zf
Differential Revision: https://phabricator.services.mozilla.com/D96466
2020-11-10 20:07:41 +00:00
Chris H-C d90a483bd2 Bug 1676097 - Add FOG Python Subsuite to TC config r=janerik
Differential Revision: https://phabricator.services.mozilla.com/D96470
2020-11-10 08:46:16 +00:00
Sebastian Hengst b6c332bb0a Bug 1665754 - skip macos silicon builds during optimization for now. a=limited-pool
Differential Revision: https://phabricator.services.mozilla.com/D96548
2020-11-10 12:27:59 +00:00
Mike Hommey af02c91f37 Bug 1665754 - Setup an Apple silicon macos build. r=firefox-build-system-reviewers,dmajor
Baby steps. This adds an unsigned non-universal Apple silicon-only macos
build.

Differential Revision: https://phabricator.services.mozilla.com/D96339
2020-11-10 08:46:22 +00:00
Tarek Ziadé 7c132a5e1b Bug 1668494 - add an influxdb layer r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D92480
2020-11-10 08:36:44 +00:00
Cosmin Sabou f2556d47da Backed out 2 changesets (bug 1674773) for turning Bug 1646925 into almost permafail.
Backed out changeset acd441508a66 (bug 1674773)
Backed out changeset 89babec1b885 (bug 1674773)
2020-11-10 11:27:50 +02:00
Dave House f2a83c2f53 Bug 1665379 - Add CI workerType for apple silicon build on x86 apple hardware macosx64-aarch64/opt. r=jmaher,glandium,aki,bhearsum DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D96261
2020-11-10 03:28:22 +00:00
Alexis Beingessner 2e16b14340 Bug 1674773 - make tsan builds use consistent flags. r=rstewart
This makes --enable-thread-sanitizer turn on Rust tsan (-Zsanitizer=thread).
This requires changing SpiderMonkey tsan to use the tsan rust nightly.

In future changes, more Rust tsan integration will key off of MOZ_TSAN.

Differential Revision: https://phabricator.services.mozilla.com/D96453
2020-11-09 20:12:42 +00:00
Aaron Klotz 773de4f33a Bug 1654817: Part 1 - Convert e10s-multi transform to an e10s-single transform; r=taskgraph-reviewers,jmaher
Since e10s-multi is going to be enabled by default, this gives us the ability
to run junit in a secondary, e10s-single configuration so that we can see them
both side-by-side for a little while, at least until we're settled in with the
e10s-multi configuration.

Differential Revision: https://phabricator.services.mozilla.com/D94883
2020-11-04 17:26:14 +00:00
Gregory Mierzwinski 6dc884266f Bug 1675739 - Disable macos raptor chrome/chromium tests. r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D96316
2020-11-09 14:31:16 +00:00
Julian Descottes 7d26bf4638 Bug 1643717 - Promote DevTools Fission tests to tier 1 r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D96028
2020-11-09 13:08:05 +00:00
Mike Hommey c99ed8ea6e Bug 1675707 - Don't activate the virtualenv when running mozharness. r=firefox-build-system-reviewers,mhentges
When the virtualenv is activated, subprocesses of mozharness inherit the
PATH that it sets, making plain python resolve to the virtualenv python,
which is actually not desirable for builds.

Ideally, we'd avoid creating a virtualenv for mozharness entirely,
especially considering it creates its own, and then the build creates
yet another one, but that doesn't work because of PYTHONPATH interfering
with the build virtualenv.

Differential Revision: https://phabricator.services.mozilla.com/D96168
2020-11-06 14:38:15 +00:00
Sylvestre Ledru fbc7199bc1 Bug 1675705 - mozlint in the CI: also run black when touching a configure r=rstewart
Differential Revision: https://phabricator.services.mozilla.com/D96163
2020-11-06 18:50:42 +00:00
Gregory Mierzwinski 601c4f6678 Bug 1674928 - Disable Raptor-webext tests on MacOS. r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D95632
2020-11-05 14:26:46 +00:00
Gabriele Svelto 4b85e11596 Bug 1675263 - Refactor the scripts used to scrape Microsoft and Apple system symbols r=marco DONTBUILD
This patch changes a few different things:
- The Docker image used for both scrapers are now based off of our standard
  Debian 10 image instead of an old Ubuntu one
- Both images were changed to make it easy to work with them when an
  interactive task is used
- The python packages used by the scripts had their versions pinned and
  cryptographic hashes have been recorded so that they can be verified before
  running the task
- The dump_syms version used on Windows was bumped to include fixes that allow
  us to scrape public symbols from DLLs and EXEs that have no PDB file available
- The maximum open file limit of the Window scraper was bumped up to cope with
  runs where we gather plenty of symbols in one go
- Similarly the maximum number of symultaneous connections to a single symbol
  server has been limited to 4 to avoid being throttled
- The macOS Python tools were modified to work with Python 3

Differential Revision: https://phabricator.services.mozilla.com/D95853
2020-11-06 11:02:25 +00:00
Tom Ritter 5ab182e7e6 Bug 1674182 - Support a regex filter for./mach try auto r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D95186
2020-11-05 17:53:31 +00:00
Tarek Ziadé 83a9dd6f9f Bug 1667151 - add support for pre-compiled scipy/numpy r=sparky
This patch will make sure that we select the right
wheels for numpy and scipy when `--visualmetrics` is used,
so we don't need to compile them.

It also make sure we don't install all those packages
unless the environment wants to use visual metrics.

Differential Revision: https://phabricator.services.mozilla.com/D91740
2020-11-05 17:16:34 +00:00
Gregory Mierzwinski e18e2835c9 Bug 1670284 - Run android perf tests with webrender-enabled. r=perftest-reviewers,Bebe
This patch makes webrender-enabled testing the main method for testing and also adds a subset of tests that will without it enabled until the switch is fully complete.

Differential Revision: https://phabricator.services.mozilla.com/D95744
2020-11-05 14:28:58 +00:00
Gregory Mierzwinski 5c2926e336 Bug 1638365 - Use webdriver navigation for pageload tests. r=perftest-reviewers,Bebe
This patch upgrade browsertime to v10, enables webdriver-based navigation in browsertime tests, and also disables the Firefox WindowRecorder for a fairer comparison between Chrome and Firefox.

Differential Revision: https://phabricator.services.mozilla.com/D95425
2020-11-05 14:27:56 +00:00
Kartikaya Gupta 8aa6bf7aac Bug 1673071 - Run the full slate of test suites on macos-qr. r=jmaher,jrmuizel
This patch flips things around so that the non-QR macosx test platforms are
running a "skeleton crew" set of tests, and the QR macosx test platforms are
running all the tests that were previously running with non-QR. As of Fx83
macOS has WebRender enabled by default for 90%+ of the population so it makes
sense to test that configuration more heavily, but leave some tests running
for the non-QR configuration as well.

Differential Revision: https://phabricator.services.mozilla.com/D95430
2020-11-03 23:05:05 +00:00
Steve Fink f18174ffbd Bug 1673984 - Upgrade gcc from 9.1.0 to 9.3.0 r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D95083
2020-11-04 00:08:10 +00:00
Matt Woodrow 982780b2ca Bug 1674856 - Enable webrender-sw config for Windows10 debug reftests. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D95570
2020-11-03 23:51:22 +00:00
Sebastian Hengst 78c64a3664 Bug 1675086 - drop references to 'pgo' platforms for Linux and Windows. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D95802
2020-11-03 22:45:54 +00:00
Razvan Maries 156298851f Backed out 4 changesets (bug 1673071) for perma failures on grid-minimum-contribution-baseline-shim-vertical-lr.html. CLOSED TREE
Backed out changeset a8ad01797ee0 (bug 1673071)
Backed out changeset f2ed8ed80bf2 (bug 1673071)
Backed out changeset 34d6c0fbfeef (bug 1673071)
Backed out changeset d6857ecf3c81 (bug 1673071)
2020-11-04 00:56:16 +02:00
Kartikaya Gupta 320132a119 Bug 1673071 - Run the full slate of test suites on macos-qr. r=jmaher,jrmuizel
This patch flips things around so that the non-QR macosx test platforms are
running a "skeleton crew" set of tests, and the QR macosx test platforms are
running all the tests that were previously running with non-QR. As of Fx83
macOS has WebRender enabled by default for 90%+ of the population so it makes
sense to test that configuration more heavily, but leave some tests running
for the non-QR configuration as well.

Differential Revision: https://phabricator.services.mozilla.com/D95430
2020-11-03 14:59:49 +00:00
Razvan Maries c032d89358 Backed out 3 changesets (bug 1674856) for Windows10 swr reftests perma failures. CLOSED TREE
Backed out changeset 8e52162cdf48 (bug 1674856)
Backed out changeset eb84f9c620ac (bug 1674856)
Backed out changeset 477a1070a971 (bug 1674856)
2020-11-03 21:43:26 +02:00
Matt Woodrow 3e0d1fbb98 Bug 1674856 - Enable webrender-sw config for Windows10 debug reftests. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D95570
2020-11-03 12:25:39 +00:00
Sebastian Hengst ab1951c79c Bug 1675051 - run Linux DevEdition tests as the expected tier 1. r=jmaher DONTBUILD
The migration of the task images from Ubuntu 16.04 to Ubuntu 18.04 in
bug 1602863 added the Ubuntu version to the platform. The platform of Linux x64
DevEdition didn't get added and used the default tier 2. We don't run tests
for Linux 32-bit anymore.

Differential Revision: https://phabricator.services.mozilla.com/D95754
2020-11-03 16:48:53 +00:00
Gregory Mierzwinski a929a223c5 Bug 1674927 - Disable similarity calculations for huge increase in run time. r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D95631
2020-11-03 13:38:54 +00:00
Sebastian Hengst e1e7bc96d8 Bug 1673413 - Increase default range of backfilled pushes to 19. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D94748
2020-11-03 09:26:48 +00:00
Andrew Halberstadt 1e76ae8e1f Bug 1673436 - [taskgraph] Run more manifests per-push on autoland, r=marco
This decreases the scheduling algorithm from a CT_MEDIUM (0.8) threshold to
CT_LOW (0.7). It also reduces the threshold used in the manifest resolving
algorithm down to 0.5. This means we'll have more "ride-along" manifests that
happen to be in the same chunk as the more important ones.

Differential Revision: https://phabricator.services.mozilla.com/D94757
2020-11-02 21:31:05 +00:00
Agi Sferro 0308170ebf Bug 1673100 - Add version of gv-junit that runs with fission. r=esawin,ahal
Differential Revision: https://phabricator.services.mozilla.com/D95062
2020-11-02 19:39:38 +00:00
Mike Hommey 9c1b6785e8 Bug 1672094 - Upgrade tsan builds to the last rust nightly with version 1.48.0. r=firefox-build-system-reviewers,dmajor
The first versions with 1.48 had a regression that was fixed later
during the 1.48.0 development phase. Use the last of those to have
something closer to a release, but still versioned 1.48.

Differential Revision: https://phabricator.services.mozilla.com/D94573
2020-10-24 21:46:57 +00:00
Julian Descottes 7cd5c308c1 Bug 1673419 - [devtools] Run performance node tests in the devtools-tests suite on CI r=nchevobbe
Depends on D95234
This will enable running the typescript checks for the performance-new panel on try.

Differential Revision: https://phabricator.services.mozilla.com/D95235
2020-10-30 17:20:04 +00:00
Julian Descottes bc53fd3404 Bug 1673419 - [devtools] Run shared_components node tests in the devtools-tests suite on CI r=nchevobbe
Depends on D95232

The tests were previously added to the runner, but they were not included in the test suite.

Differential Revision: https://phabricator.services.mozilla.com/D95234
2020-10-30 17:21:57 +00:00
Andrew Halberstadt 14d0784d5e Bug 1673992 - [taskgraph] Ensure we stop extracting mozharness.zip in the cwd r=bhearsum
Rather than putting a top-level "mozharness" directory in "mozharness.zip",
this puts the root of mozharness at the root of the archive. Then we extract
the archive into a "mozharness" directory. This way the path on disk ends up
being the same, but generic-worker won't attempt to modify the permissions of
files in the cwd.

Differential Revision: https://phabricator.services.mozilla.com/D95138
2020-10-30 13:32:01 +00:00
Gregory Mierzwinski 15d48fd899 Bug 1667398 - Enable macosx browsertime tests on autoland and mozilla-central. r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D94896
2020-10-30 13:15:21 +00:00
Gregory Mierzwinski dfe5f60745 Bug 1673058 - Disable raptor-webext pageload tests on linux. r=perftest-reviewers,Bebe
This patch disable raptor-webext tests on linux.

Differential Revision: https://phabricator.services.mozilla.com/D94630
2020-10-30 13:13:29 +00:00
Razvan Maries ba834e9f0e Backed out changeset e281605f0fd2 (bug 1673992) for Android wrench bustage. CLOSED TREE 2020-10-29 23:10:22 +02:00
Andrew Halberstadt 93710a04d5 Bug 1673992 - [taskgraph] Ensure we stop extracting mozharness.zip in the cwd r=bhearsum
Rather than putting a top-level "mozharness" directory in "mozharness.zip",
this puts the root of mozharness at the root of the archive. Then we extract
the archive into a "mozharness" directory. This way the path on disk ends up
being the same, but generic-worker won't attempt to modify the permissions of
files in the cwd.

Differential Revision: https://phabricator.services.mozilla.com/D95138
2020-10-29 17:30:56 +00:00
Kartikaya Gupta edc1d48bfd Bug 1669478 - Enable WebRender on most of the windows10-64 ccov tests. r=ahal,jrmuizel
This moves most of the windows ccov tests to run with WebRender enabled by
putting them in the windows10-64-ccov-qr test platform. (The -qr suffix causes
the taskgraph code to enable WebRender for these jobs).
The only one skipped is the marionette GPU test because it contains a test that
specifically requires WebRender disabled.

The existing non-regex config keys that referred to `windows10-64-ccov` also
get updated, and in a couple of places we need to add a new non-regex key to
disambiguate between two matching regex keys.

Differential Revision: https://phabricator.services.mozilla.com/D94769
2020-10-28 17:47:56 +00:00
Kartikaya Gupta fd8ca47744 Bug 1669478 - Remove unused windows10-64-ccov/debug bits. r=ahal
We never actually run anything on this test platform, we only run opt.

Differential Revision: https://phabricator.services.mozilla.com/D94768
2020-10-28 17:45:55 +00:00
Steve Fink ad27d5a1be Bug 1673103 - Switch SM jobs to use newer dump_syms r=calixte
Differential Revision: https://phabricator.services.mozilla.com/D94914
2020-10-28 16:39:05 +00:00
Steve Fink 6cf5fdbd02 Bug 1673103 - SM(pkg): Upload artifacts even if job fails r=calixte
Differential Revision: https://phabricator.services.mozilla.com/D94913
2020-10-28 16:38:53 +00:00
Narcis Beleuzu cb30b4d320 Backed out 2 changesets (bug 1669478) for linting failure on tests.py . CLOSED TREE
Backed out changeset 995156a1234a (bug 1669478)
Backed out changeset 56e6528b37eb (bug 1669478)
2020-10-28 18:37:13 +02:00
Kartikaya Gupta e4bcc652fe Bug 1669478 - Enable WebRender on most of the windows10-64 ccov tests. r=ahal,jrmuizel
This moves most of the windows ccov tests to run with WebRender enabled by
putting them in the windows10-64-ccov-qr test platform. (The -qr suffix causes
the taskgraph code to enable WebRender for these jobs).
The only one skipped is the marionette GPU test because it contains a test that
specifically requires WebRender disabled.

The existing non-regex config keys that referred to `windows10-64-ccov` also
get updated, and in a couple of places we need to add a new non-regex key to
disambiguate between two matching regex keys.

Differential Revision: https://phabricator.services.mozilla.com/D94769
2020-10-28 16:23:20 +00:00
Kartikaya Gupta 5d8025d178 Bug 1669478 - Remove unused windows10-64-ccov/debug bits. r=ahal
We never actually run anything on this test platform, we only run opt.

Differential Revision: https://phabricator.services.mozilla.com/D94768
2020-10-28 16:23:18 +00:00
Jeff Gilbert 14627c3915 Bug 1662603 - Enable m-gli on Windows. r=ahal
Disable webgl-ipc variant on .*-ccov/.* platforms.

Differential Revision: https://phabricator.services.mozilla.com/D92816
2020-10-28 00:14:18 +00:00
Aaron Klotz c592bffdfb Bug 1650118: Part 6 - Update test harnesses; r=bc,sparky,perftest-reviewers,jgraham
e10s is no longer a GeckoView option, so I'd like to remove it from test
harnesses when possible.

Depends on D90934

Differential Revision: https://phabricator.services.mozilla.com/D91640
2020-10-27 18:16:30 +00:00
Razvan Maries f3f6721caa Backed out 8 changesets (bug 1650118) for wpt failures on inside-dedicated-worker.html. CLOSED TREE
Backed out changeset ab6218dd84f5 (bug 1650118)
Backed out changeset a99d1aae6e2e (bug 1650118)
Backed out changeset ed357b8bb07e (bug 1650118)
Backed out changeset cd5155e732d9 (bug 1650118)
Backed out changeset 63cc752924f2 (bug 1650118)
Backed out changeset 7f0a281a399e (bug 1650118)
Backed out changeset 0fd77fef3c95 (bug 1650118)
Backed out changeset f397e86fd61e (bug 1650118)
2020-10-27 18:39:11 +02:00
Aaron Klotz b7a9856e97 Bug 1650118: Part 6 - Update test harnesses; r=bc,sparky,perftest-reviewers,jgraham
e10s is no longer a GeckoView option, so I'd like to remove it from test
harnesses when possible.

Depends on D90934

Differential Revision: https://phabricator.services.mozilla.com/D91640
2020-10-27 11:41:28 +00:00
Kartikaya Gupta 7c9a6249f0 Bug 1673359 - Allow suffixes on ccov test platforms. r=ahal
This allows additional suffixes (e.g. -qr) to be added to ccov test platforms,
and in most cases those labels will be treated the same as the other ccov jobs.
In a few cases exact (non-regex) keys were left unmodified, because changing
a non-regex key to a regex key can result in taskgraph generation failure, if
more than one regex key matches.

I verified that this patch does not modify the output generated by `./mach
taskgraph full --json`.

Differential Revision: https://phabricator.services.mozilla.com/D94725
2020-10-27 14:00:11 +00:00
Kartikaya Gupta 9f8de3a314 Bug 1673359 - Replace regex complexity with more fixed list. r=ahal
As with the previous patch, the negative regex makes changes hard. This replaces
the negative regex with a positive list of matching labels, similar to the one
a few lines down. I verified that this patch does not modify the output for
`./mach taskgraph full --json`.

Differential Revision: https://phabricator.services.mozilla.com/D94724
2020-10-27 14:00:03 +00:00
Kartikaya Gupta 7b97f0a4b8 Bug 1673359 - Replace regex complexity with more granular test sets. r=ahal,sfink
I need to modify the ccov regexes to allow additional suffixes. The negative-
search regex makes this hard, and seems quite complex/error-prone. Instead of the
negative-search regex, we can accomplish the same thing by splitting out a
new test-set.

Note that with this patch, there are a handful of jobs that get removed from
the list generated by `./mach taskgraph full` (listed below). I believe this
is a desirable change since per the comment in the code it seems like we don't
want these jobs to run. In fact, I don't see these jobs on TreeHerder, so maybe
some other step is pruning them out anyway.

The jobs being removed are below. The '*' at the end represents the chunk number,
each of the labels with a '*' has 6 chunks which I've collapsed into a single
label for brevity.

  test-linux1804-64-asan/opt-jittest-1proc-*
  test-linux1804-64/debug-jittest-1proc-*
  test-linux1804-64-devedition/opt-jittest-1proc-*
  test-linux1804-64/opt-jittest-1proc-*
  test-linux1804-64-qr/debug-jittest-1proc-*
  test-linux1804-64-qr/opt-jittest-1proc-*
  test-linux1804-64-shippable/opt-jittest-1proc-*
  test-linux1804-64-shippable-qr/opt-jittest-1proc-*
  test-windows10-64-asan/opt-jittest-1proc
  test-windows10-64/debug-jittest-1proc
  test-windows10-64-devedition/opt-jittest-1proc
  test-windows10-64/opt-jittest-1proc
  test-windows10-64-shippable/opt-jittest-1proc
  test-windows7-32/debug-jittest-1proc
  test-windows7-32/opt-jittest-1proc
  test-windows7-32-shippable/opt-jittest-1proc

Differential Revision: https://phabricator.services.mozilla.com/D94723
2020-10-27 14:00:01 +00:00
Kershaw Chang a227c48e26 Bug 1673340 - Revert changes done in Bug 1668851, 1663718 and 1497249 r=necko-reviewers,dragana
Differential Revision: https://phabricator.services.mozilla.com/D94808
2020-10-27 11:13:13 +00:00
Ricky Stewart 210585edd2 Bug 1672023 - Remove excluded files from `black.yml`
These files were omitted from the original patch because reformatting them required some manual intervention in order to avoid breaking unit tests. Generally the `noqa` lines were already there and just needed to be moved from one line to another (due to the reformatting by `black`), but sometimes `black` saw fit to move a bunch of stuff all onto one line, requiring me to introduce new `noqa` lines.

Besides the autoformat by `black` and some manual fixups, this patch contains no other changes.

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94052

Depends on D94045
2020-10-26 18:21:44 +00:00
Ricky Stewart 02a7b4ebdf Bug 1654103: Standardize on Black for Python code in `mozilla-central`.
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-26 18:34:53 +00:00
Gregory Mierzwinski 2955443b86 Bug 1673074 - Modify cron to run chrome linux tests in browsertime. r=perftest-reviewers,Bebe
This patch modifies the cron to run chrome linux tests on browsertime instead of webext. It also removes the linux smoke tests.

Differential Revision: https://phabricator.services.mozilla.com/D94628
2020-10-26 12:49:21 +00:00
Florin Strugariu 48929af845 Bug 1642329 - Migrate unity-webgl benchmarks from raptor to browsertime on android r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D94294
2020-10-26 09:25:56 +00:00
Florin Strugariu bc0d2e2fa2 Bug 1642329 - Migrate speedometer benchmarks from raptor to browsertime on android r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D94292
2020-10-22 14:06:25 +00:00
Matt Woodrow ab7c9702a9 Bug 1668288 - Enable damp and webgl talos tests for software webrender, and promote bcv to tier 1. r=ahal,perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D94405
2020-10-23 16:51:25 +00:00
Razvan Maries 41ed5b93a9 Backed out changeset b43d1c8c7639 (bug 1672094) for Linux tsan Build Bustages. CLOSED TREE 2020-10-25 00:43:21 +03:00
Mike Hommey 3d75ac9c10 Bug 1672094 - Upgrade tsan builds to the last rust nightly with version 1.48.0. r=firefox-build-system-reviewers,dmajor
The first versions with 1.48 had a regression that was fixed later
during the 1.48.0 development phase. Use the last of those to have
something closer to a release, but still versioned 1.48.

Differential Revision: https://phabricator.services.mozilla.com/D94573
2020-10-23 11:56:28 +00:00
sanketh 14a4c90302 Bug 1668304 - Bump mingw-clang builds to clang 11 r=tjr,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D94676
2020-10-24 05:07:23 +00:00
Bogdan Tara da1098d4aa Backed out 10 changesets (bug 1654103, bug 1672023, bug 1518999) for PanZoomControllerTest.touchEventForResult gv-junit failures CLOSED TREE
Backed out changeset ff3fb0b4a512 (bug 1672023)
Backed out changeset e7834b600201 (bug 1654103)
Backed out changeset 807893ca8069 (bug 1518999)
Backed out changeset 13e6b92440e9 (bug 1518999)
Backed out changeset 8b2ac5a6c98a (bug 1518999)
Backed out changeset 575748295752 (bug 1518999)
Backed out changeset 65f07ce7b39b (bug 1518999)
Backed out changeset 4bb80556158d (bug 1518999)
Backed out changeset 8ac8461d7bd7 (bug 1518999)
Backed out changeset e8ba13ee17f5 (bug 1518999)
2020-10-24 03:36:18 +03:00
Steve Fink 25abe08e0c Bug 1668489 - Switch to sixgill that qualifies `using`-aliased template members to avoid collisions between different types r=jonco
Differential Revision: https://phabricator.services.mozilla.com/D94356
2020-10-23 23:13:07 +00:00
Mike Hommey 5c75040f4c Bug 1672889 - Add a mac nasm toolchain. r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D94533
2020-10-23 13:54:26 +00:00
Ricky Stewart fe80718d67 Bug 1672023 - Remove excluded files from `black.yml` r=sylvestre,perftest-reviewers,geckoview-reviewers,agi
These files were omitted from the original patch because reformatting them required some manual intervention in order to avoid breaking unit tests. Generally the `noqa` lines were already there and just needed to be moved from one line to another (due to the reformatting by `black`), but sometimes `black` saw fit to move a bunch of stuff all onto one line, requiring me to introduce new `noqa` lines.

Besides the autoformat by `black` and some manual fixups, this patch contains no other changes.

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94052
2020-10-23 20:40:44 +00:00
Ricky Stewart c0cea3b0fa Bug 1654103: Standardize on Black for Python code in `mozilla-central`. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-23 20:40:42 +00:00
Gregory Mierzwinski 534e4a3a3c Bug 1667384 - Enable linux browsertime tests on autoland and mozilla-central. r=perftest-reviewers,AlexandruIonescu
This patch enables browsertime tests on Linux wherever Raptor-webext is currently running. It also modifies the tiers to match our current settings.

Differential Revision: https://phabricator.services.mozilla.com/D94170
2020-10-23 13:17:42 +00:00
Myeongjun Go 27e4a2b691 Bug 1672207 - [perfdocs] Remove legacy code on build_test_description r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D94127
2020-10-23 13:04:19 +00:00
Mike Hommey 76f4d3c908 Bug 1672890 - Allow to run mozharness build tasks on mac workers. r=releng-reviewers,aki
Differential Revision: https://phabricator.services.mozilla.com/D94534
2020-10-23 02:03:53 +00:00
Mike Hommey dfe70677ef Bug 1672885 - Always use /usr/local/bin/python3 on mac workers. r=releng-reviewers,aki
This is a followup to bug 1669879. Only the 10.10 workers had python in
a /tools path, and new 10.15 are excluded from the current checks, so
just use /usr/local/bin/python3 unconditionally. While at it, make one
mac-specific setup mac-specific rather than 10.14-specific.

Differential Revision: https://phabricator.services.mozilla.com/D94532
2020-10-23 01:21:44 +00:00
Mike Hommey fff894926f Bug 1672837 - Don't fail to repack recent rust nightlies. r=firefox-build-system-reviewers,rstewart
The contents of the .sha256 files have changed two days ago and don't
contain the file name anymore. Considering the file name is already in
the sha256 file name, we can assume it matches. The file name check was
only an additional assurance. We could keep it conditionally, but
in only a few months, all the ones we care about will have switched to
the new format.

Differential Revision: https://phabricator.services.mozilla.com/D94490
2020-10-22 21:24:49 +00:00
Aki Sasaki 2eef36919a Bug 1644574 - don't optimize out codeql-cpp. r=taskgraph-reviewers,bhearsum DONTBUILD
`run-on-projects: []` should keep us from running this elsewhere. If we do enable it, we don't want to optimize it out.

Differential Revision: https://phabricator.services.mozilla.com/D94360
2020-10-21 20:06:33 +00:00
Joel Maher 4dd326cbea Bug 1670995 - run android mochitest/wpt on -qr by default. r=jnicol
run android mochitest/wpt on -qr by default

Differential Revision: https://phabricator.services.mozilla.com/D94334
2020-10-21 19:16:06 +00:00
sanketh 35cd8eb504 Bug 1655482 - Bump MinGW to fix the STATUS_HEAP_CORRUPTION define r=tjr
- Bump MinGW version
- Add patch to workaround MinGW's dwrite_3.h
- Remove MinGW workaround for STATUS_HEAP_CORRUPTION define
- Remove MinGW workaround in MMPolicies.h.

Differential Revision: https://phabricator.services.mozilla.com/D91157
2020-10-22 15:58:54 +00:00
Marco Castelluccio 788f772cf9 Bug 1672505 - Make the 'system_symbols' target tasks method select symbol scraping tasks too. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D94393
2020-10-22 15:38:01 +00:00
Mike Hommey 74e2a2cabf Bug 1672499 - Get wrench cargo tests from the deps subdirectory. r=kats
As of cargo 1.44.0, the test binaries are not copied into
target/$target/debug, but they are in target/$target/debug/deps (they
were there too before). Cargo test runs the tests from there now
instead, so change the scripts accordingly.

Differential Revision: https://phabricator.services.mozilla.com/D94402
2020-10-22 11:25:58 +00:00
Gregory Mierzwinski d8355d92cd Bug 1672429 - Set shouldAlert to true for perftest view tests. r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D94327
2020-10-22 14:02:05 +00:00
Alex Lopez 1508f89c46 Bug 1600916 - Change version field on geckoview beetmover to valid Maven version. r=jlorenzo
Differential Revision: https://phabricator.services.mozilla.com/D93882
2020-10-22 08:26:13 +00:00
Andrew Erickson 36f042392a Bug 1672295: increase max-run-time for js-bench jobs r=jmaher
Increase max-run-time to one hour.

Differential Revision: https://phabricator.services.mozilla.com/D94212
2020-10-21 17:11:07 +00:00
Mike Hommey 2817852926 Bug 1672328 - Allow to pull rustc builds from upstream CI. r=firefox-build-system-reviewers,rstewart
This is useful to bisect problems through our own CI.

Differential Revision: https://phabricator.services.mozilla.com/D94267
2020-10-22 01:11:17 +00:00
Kartikaya Gupta 3839ef0be5 Bug 1665643 - Rename a couple of WR jobs to avoid the target task filter. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D94196
2020-10-22 01:01:50 +00:00
Dorel Luca 1ff59cb7a3 Backed out changeset 7558c8821a07 (bug 1654103) for multiple failures. CLOSED TREE 2020-10-22 03:51:06 +03:00
Dorel Luca 26941cf2f5 Backed out changeset 94ec15429e21 (bug 1672023) for Backout conflicts with Bug 1654103. CLOSED TREE 2020-10-22 03:43:01 +03:00
Ricky Stewart 8b352f1843 Bug 1672023 - Remove excluded files from `black.yml` r=sylvestre,perftest-reviewers,geckoview-reviewers,agi
These files were omitted from the original patch because reformatting them required some manual intervention in order to avoid breaking unit tests. Generally the `noqa` lines were already there and just needed to be moved from one line to another (due to the reformatting by `black`), but sometimes `black` saw fit to move a bunch of stuff all onto one line, requiring me to introduce new `noqa` lines.

Besides the autoformat by `black` and some manual fixups, this patch contains no other changes.

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94052
2020-10-21 21:29:30 +00:00
Ricky Stewart 50762dacab Bug 1654103: Standardize on Black for Python code in `mozilla-central`. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-21 21:27:27 +00:00
Andrew Halberstadt d2a7f9df0f Bug 1662603 - [ci] Ensure we don't run 'webgl-ipc' talos tasks on ccov platforms, r=taskgraph-reviewers,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D94329
2020-10-21 21:08:41 +00:00
Andrew Halberstadt d793d59bb4 Bug 1662603 - [ci] Print dependents of a task that should not be scheduled, r=taskgraph-reviewers,jmaher
This makes it easier to diagnose why the integration test failed.

Differential Revision: https://phabricator.services.mozilla.com/D94328
2020-10-21 21:08:32 +00:00
Christian Holler ed121667bb Bug 1648192 - Add mochitest-media to TSan test set. r=ahal
Depends on D94289

Differential Revision: https://phabricator.services.mozilla.com/D94290
2020-10-21 17:07:02 +00:00
Christian Holler afa29f71b7 Bug 1672155 - Adjust mochitest task configurations for TSan. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D94285
2020-10-21 17:06:13 +00:00
Ben Hearsum d684a58597 Bug 1638989: run 'mach taskcluster-load-image' with python 3 r=releng-reviewers,aki DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D94188
2020-10-21 14:04:50 +00:00
Gabriele Svelto 3a01d4b322 Bug 1672342 - Sort the fetch jobs files in alphabetical order r=sylvestre DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D94278
2020-10-21 10:06:30 +00:00
Mike Hommey 0b93a75baa Bug 1644624 - Apply the compiler_builtins hack to aarch64-linux-android too. CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D94260
2020-10-21 07:37:19 +00:00
Razvan Maries 5e0d52e2cc Backed out 6 changesets (bug 1650118) as per Aaron's request. CLOSED TREE
Backed out changeset 4a7fc6398ad6 (bug 1650118)
Backed out changeset b9fa3dd9c05d (bug 1650118)
Backed out changeset 2cb9109dee0a (bug 1650118)
Backed out changeset a6ca38804021 (bug 1650118)
Backed out changeset 66b9527aecad (bug 1650118)
Backed out changeset 74fd3eb970a6 (bug 1650118)
2020-10-21 07:32:57 +03:00
Mike Hommey bb0438f009 Bug 1671555 - Upgrade all toolchains using rust 1.41 to 1.47. r=firefox-build-system-reviewers,dmajor
And remove the rust 1.41 toolchains.

Differential Revision: https://phabricator.services.mozilla.com/D93732
2020-10-20 04:55:02 +00:00
Mike Hommey d97aed8151 Bug 1644624 - Upgrade builders to rustc 1.47. r=firefox-build-system-reviewers,dmajor
Also upgrade the ccov builds to clang 11, as they were stuck on clang 9
because of the older version of rust, and the new version of rust
requires to bump clang as well (due to code-coverage-related symbols
name change).

Skip TSAN builds because they currently fail with bug 1672094.

Differential Revision: https://phabricator.services.mozilla.com/D93731
2020-10-21 01:29:29 +00:00
Mike Hommey 476c7a1cb7 Bug 1644624 - Optionally postprocess the compiler_builtins rlib when repacking rust. r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D93730
2020-10-20 19:30:06 +00:00
Cosmin Sabou b8fd79f461 Backed out 5 changesets (bug 1644624, bug 1671555) for windows shippable bustage.
Backed out changeset fee83fc16940 (bug 1644624)
Backed out changeset afb2a7ff532c (bug 1671555)
Backed out changeset 609ac687f7e3 (bug 1644624)
Backed out changeset d91db0801099 (bug 1644624)
Backed out changeset ce09ad625b53 (bug 1644624)
2020-10-20 06:52:09 +03:00
Mike Hommey d77d26cd6d Partially backout changeset 609ac687f7e3 (bug 1644624) for tsan mochitest bustage. CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D94064
2020-10-20 01:26:53 +00:00
Mike Hommey a22b90ec8c Bug 1671555 - Upgrade all toolchains using rust 1.41 to 1.47. r=firefox-build-system-reviewers,dmajor
And remove the rust 1.41 toolchains.

Differential Revision: https://phabricator.services.mozilla.com/D93732
2020-10-16 15:57:03 +00:00
Mike Hommey 5d0f00c246 Bug 1644624 - Upgrade builders to rustc 1.47. r=firefox-build-system-reviewers,dmajor
Also upgrade the ccov builds to clang 11, as they were stuck on clang 9
because of the older version of rust, and the new version of rust
requires to bump clang as well (due to code-coverage-related symbols
name change).

Differential Revision: https://phabricator.services.mozilla.com/D93731
2020-10-16 20:58:30 +00:00
Mike Hommey 1ee16dc4df Bug 1644624 - Optionally postprocess the compiler_builtins rlib when repacking rust. r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D93730
2020-10-16 15:52:15 +00:00
Mike Hommey 5afb69830c Bug 1670156 - Use the same prefix/suffix for rust libraries on mingw builds. r=firefox-build-system-reviewers,dmajor
Rustc >= 1.44 changed the file names of the static libraries it
produces with -windows-gnu targets, to match that of mingw clang/gcc.

Considering we still build on 1.43, the best fix would be to derive the
prefix/suffix based on the version of rust, but that actually turns into
a hard-to-solve problem because of configure tests for bindgen also
depending on the prefix/suffix value to be known.

On the other hand, we're soon due to an update to 1.47, so the simpler
solution is to just push mingw builds to require 1.44 (settling for the
smallest upgrade possible for now) and to remove the split between C and
rust library prefix/suffixes.

Differential Revision: https://phabricator.services.mozilla.com/D93726
2020-10-16 16:06:19 +00:00
Mike Hommey 15db2adc30 Bug 1670156 - Switch 32-bits mingw clang to dwarf exceptions. r=tjr
That is what rust uses, and versions of rust >= 1.44 make the
discrepancy visible as a linker error on missing the _Unwind_Resume
symbol, so we need to align things.

Differential Revision: https://phabricator.services.mozilla.com/D93725
2020-10-16 12:51:22 +00:00
Mike Hommey bd3416a215 Bug 1671542 - Get rust toolchain xz archives rather than gz from upstream. r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D93722
2020-10-19 21:34:26 +00:00
Aaron Klotz 1876a00d8b Bug 1650118: Part 6 - Update test harnesses; r=bc,sparky,perftest-reviewers
e10s is no longer a GeckoView option, so I'd like to remove it from test
harnesses when possible.

Differential Revision: https://phabricator.services.mozilla.com/D91640
2020-10-19 18:17:16 +00:00
Connor Sheehan 676ffafaec Bug 1670031: update fallback fingerprint in `run-task` r=zeid
Differential Revision: https://phabricator.services.mozilla.com/D94018
2020-10-19 15:37:23 +00:00
Andrew Halberstadt 00f7e29eac Bug 1668288 - [ci] Enable 'webrender-sw' variant on more talos platforms and tests, r=perftest-reviewers,sparky
This will add the following tasks to mozilla-central:
> test-linux64-qr/opt-talos-chrome-swr-e10s
> test-linux64-qr/opt-talos-damp-swr-e10s
> test-linux64-qr/opt-talos-g3-swr-e10s
> test-linux64-qr/opt-talos-g5-swr-e10s
> test-linux64-qr/opt-talos-perf-reftest-swr-e10s
> test-linux64-qr/opt-talos-sessionrestore-many-windows-swr-e10s
> test-linux64-qr/opt-talos-tabswitch-swr-e10s
> test-linux64-qr/opt-talos-tp5o-swr-e10s
> test-linux64-qr/opt-talos-webgl-swr-e10s
> test-linux64-shippable-qr/opt-talos-chrome-swr-e10s
> test-linux64-shippable-qr/opt-talos-damp-swr-e10s
> test-linux64-shippable-qr/opt-talos-g3-swr-e10s
> test-linux64-shippable-qr/opt-talos-g5-swr-e10s
> test-linux64-shippable-qr/opt-talos-perf-reftest-swr-e10s
> test-linux64-shippable-qr/opt-talos-sessionrestore-many-windows-swr-e10s
> test-linux64-shippable-qr/opt-talos-tabswitch-swr-e10s
> test-linux64-shippable-qr/opt-talos-tp5o-swr-e10s
> test-linux64-shippable-qr/opt-talos-webgl-swr-e10s
> test-macosx1014-64-shippable-qr/opt-talos-bcv-swr-e10s
> test-macosx1014-64-shippable-qr/opt-talos-chrome-swr-e10s
> test-macosx1014-64-shippable-qr/opt-talos-damp-swr-e10s
> test-macosx1014-64-shippable-qr/opt-talos-g1-swr-e10s
> test-macosx1014-64-shippable-qr/opt-talos-g4-swr-e10s
> test-macosx1014-64-shippable-qr/opt-talos-g5-swr-e10s
> test-macosx1014-64-shippable-qr/opt-talos-perf-reftest-swr-e10s
> test-macosx1014-64-shippable-qr/opt-talos-sessionrestore-many-windows-swr-e10s
> test-macosx1014-64-shippable-qr/opt-talos-svgr-swr-e10s
> test-macosx1014-64-shippable-qr/opt-talos-tp5o-swr-e10s
> test-windows10-64-qr/opt-talos-bcv-swr-e10s
> test-windows10-64-qr/opt-talos-chrome-swr-e10s
> test-windows10-64-qr/opt-talos-damp-swr-e10s
> test-windows10-64-qr/opt-talos-g1-swr-e10s
> test-windows10-64-qr/opt-talos-g4-swr-e10s
> test-windows10-64-qr/opt-talos-g5-swr-e10s
> test-windows10-64-qr/opt-talos-other-swr-e10s
> test-windows10-64-qr/opt-talos-perf-reftest-swr-e10s
> test-windows10-64-qr/opt-talos-sessionrestore-many-windows-swr-e10s
> test-windows10-64-qr/opt-talos-svgr-swr-e10s
> test-windows10-64-qr/opt-talos-tabswitch-swr-e10s
> test-windows10-64-qr/opt-talos-tp5o-swr-e10s
> test-windows10-64-qr/opt-talos-webgl-swr-e10s
> test-windows10-64-qr/opt-talos-xperf-swr-e10s
> test-windows10-64-shippable-qr/opt-talos-bcv-swr-e10s
> test-windows10-64-shippable-qr/opt-talos-chrome-swr-e10s
> test-windows10-64-shippable-qr/opt-talos-damp-swr-e10s
> test-windows10-64-shippable-qr/opt-talos-g1-swr-e10s
> test-windows10-64-shippable-qr/opt-talos-g4-swr-e10s
> test-windows10-64-shippable-qr/opt-talos-g5-swr-e10s
> test-windows10-64-shippable-qr/opt-talos-other-swr-e10s
> test-windows10-64-shippable-qr/opt-talos-perf-reftest-swr-e10s
> test-windows10-64-shippable-qr/opt-talos-sessionrestore-many-windows-swr-e10s
> test-windows10-64-shippable-qr/opt-talos-svgr-swr-e10s
> test-windows10-64-shippable-qr/opt-talos-tabswitch-swr-e10s
> test-windows10-64-shippable-qr/opt-talos-tp5o-swr-e10s
> test-windows10-64-shippable-qr/opt-talos-webgl-swr-e10s
> test-windows10-64-shippable-qr/opt-talos-xperf-swr-e10s

Differential Revision: https://phabricator.services.mozilla.com/D93525
2020-10-19 15:06:07 +00:00
Florin Strugariu 70251b3778 Bug 1524545 Run raptor-unity-webgl only on autoland r=davehunt,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D93496
2020-10-19 09:04:44 +00:00
Andreea Pavel 43b4621abb Backed out changeset 2c30c54dea46 for not fixing bug 1671594 2020-10-17 13:35:04 +03:00
Gregory Mierzwinski 5f87b8eb22 Bug 1669999 - Rename ytp-h264-std to ytp-hfr. r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D93665
2020-10-16 16:05:20 +00:00
Gregory Mierzwinski af9fc3a358 Bug 1670000 - Enable ytp browsertime tests in mozilla-central. r=perftest-reviewers,davehunt
This patch enables youtube-playback tests running on browsertime.

Differential Revision: https://phabricator.services.mozilla.com/D93664
2020-10-16 16:04:49 +00:00
Gregory Mierzwinski 171050737a Bug 1671415 - Disable 2019 youtube-playback tests. r=perftest-reviewers,davehunt
This patch removes the 2019 youtube-playback tests from mozilla-central.

Differential Revision: https://phabricator.services.mozilla.com/D93663
2020-10-16 16:05:07 +00:00
kanishk509 a0a2eaeec1 Bug 1666255 - Change task suffixes for cold/warm/chimera. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D93426
2020-10-15 18:39:05 +00:00
Kartikaya Gupta 93ec4de40f Bug 1671193 - Don't try to set prefs in jittests as it doesn't work. r=jrmuizel
Differential Revision: https://phabricator.services.mozilla.com/D93575
2020-10-14 20:37:29 +00:00
Aki Sasaki 384eb82720 no bug - enable chain of trust on pgo profile tasks. r=releng-reviewers,mtabara
Differential Revision: https://phabricator.services.mozilla.com/D93457
2020-10-14 15:35:58 +00:00
Gregory Mierzwinski cfa02b6161 Bug 1652457 - Remove non-live site tests from Sunday live-site raptor cron. r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D93397
2020-10-14 15:05:06 +00:00
Cosmin Sabou b1aaa8d3d5 Backed out changeset b8ba96c90d81 (bug 1662603) for busting gecko decision task. CLOSED TREE 2020-10-14 07:28:16 +03:00
Jeff Gilbert 46c2dc965d Bug 1662603 - Enable m-gli on Windows. r=ahal
Disable webgl-ipc variant on .*-ccov/.* platforms.

Differential Revision: https://phabricator.services.mozilla.com/D92816
2020-10-13 20:24:47 +00:00
Gregory Mierzwinski 1810afabc7 Bug 1669534 - Run chrome/chromium pageload tests in browsertime. r=perftest-reviewers,Bebe
This patch fixes various issues that prevented us from running chromium/chrom in raptor-browsertime.
(1) Chromium fetch task now also fetches the latest chromedriver.
(2) FFMPEG failures when recording on chrome/chromium.
(3) Various changes where chromium wasn't considered as a variant of chrome.

Differential Revision: https://phabricator.services.mozilla.com/D92646
2020-10-13 20:36:52 +00:00
Johan Lorenzo 3f84eea7e3 Bug 1670266 - Remove outdated releaserunner3 docs r=sylvestre DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D93092
2020-10-13 08:19:30 +00:00
David Major 3366589f7e Bug 1670686 - Update to clang 11.0.0 final release r=firefox-build-system-reviewers,andi,rstewart
The `llvmorg-11.0.0` release was tagged today at `176249bd`.

Differential Revision: https://phabricator.services.mozilla.com/D93225
2020-10-12 15:40:38 +00:00
Jamie Nicol 0662f91400 Bug 1595794 - Run geckoview-junit tests on emulator with webrender enabled. r=geckoview-reviewers,jmaher,agi
Differential Revision: https://phabricator.services.mozilla.com/D52682
2020-10-12 10:34:29 +00:00
Mike Hommey 93b282a460 Bug 1651538 - Relabel docker images with the prefix "docker-image" instead of "build-docker-image". r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D82807
2020-10-09 00:07:56 +00:00
Mike Hommey 85f2357130 Bug 1670163 - Upgrade fix-stacks to latest master. r=dmajor
This updates dependencies, fixing build failures with rustc 1.47 in some
of them.

Differential Revision: https://phabricator.services.mozilla.com/D93054
2020-10-09 12:02:27 +00:00
Henrik Skupin bcd7618282 Bug 1651542 - [puppeteer] Warm-up font cache for Firefox when running Puppeteer unit tests. r=maja_zf
Due to font cache issues with the ub18-test docker image in
TaskCluster the first startup of Firefox sometimes takes more
than 15s.

As workaround for now just start Firefox once before running
Puppeteer unit tests.

Differential Revision: https://phabricator.services.mozilla.com/D93110
2020-10-09 21:03:10 +00:00
Razvan Maries 040fd9f9f5 Backed out changeset 694d23b789b1 (bug 1651542) as per Henrik's request. CLOSED TREE 2020-10-09 22:34:56 +03:00
Henrik Skupin 70a97d98be Bug 1651542 - [puppeteer] Warm-up font cache for Firefox when running Puppeteer unit tests. r=maja_zf
Due to font cache issues with the ub18-test docker image in
TaskCluster the first startup of Firefox sometimes takes more
than 15s.

As workaround for now just start Firefox once before running
Puppeteer unit tests.

Differential Revision: https://phabricator.services.mozilla.com/D93110
2020-10-09 17:42:38 +00:00
Mike Hommey 8ae215f6f3 Bug 1669879 - Always use `hg` in run-task on mac. r=releng-reviewers,mtabara
All the workers that had hg under /tools/python27-mercurial are gone.
This also fixes run-task for workers running > 10.14.

Differential Revision: https://phabricator.services.mozilla.com/D92867
2020-10-08 09:40:25 +00:00
Mike Hommey 245482078e Bug 1669879 - Remove the t-osx-1010* worker types. r=releng-reviewers,mtabara
The last use of t-osx-1010 was removed in bug 1613982, and
t-osx-1010-pgo was never used.

Differential Revision: https://phabricator.services.mozilla.com/D92866
2020-10-08 09:33:15 +00:00
Bogdan Tara 6a589167f0 Backed out 2 changesets (bug 1669879) for docker failures CLOSED TREE
Backed out changeset f484bfd1ad97 (bug 1669879)
Backed out changeset 86061c7de217 (bug 1669879)
2020-10-09 07:50:02 +03:00
Mike Hommey cc9ce7370c Bug 1670138 - Upgrade dump-syms to 0.0.6. r=dmajor
It includes updates in dependencies that fix build failures with rustc 1.47.

Differential Revision: https://phabricator.services.mozilla.com/D93045
2020-10-09 04:17:53 +00:00
Mike Hommey d9a9f5848c Bug 1669879 - Always use `hg` in run-task on mac. r=releng-reviewers,mtabara
All the workers that had hg under /tools/python27-mercurial are gone.
This also fixes run-task for workers running > 10.14.

Differential Revision: https://phabricator.services.mozilla.com/D92867
2020-10-08 09:40:25 +00:00
Mike Hommey 6baafff796 Bug 1669879 - Remove the t-osx-1010* worker types. r=releng-reviewers,mtabara
The last use of t-osx-1010 was removed in bug 1613982, and
t-osx-1010-pgo was never used.

Differential Revision: https://phabricator.services.mozilla.com/D92866
2020-10-08 09:33:15 +00:00
Rob Lemley d4b14ce3b4 Bug 1665414 - Move tb-debian-mingw docker-image definition to Thunderbird repo. r=taskgraph-reviewers,aki
This docker image was created for Thunderbird and is unavailable for Firefox
builds.

Depends on D92703

Differential Revision: https://phabricator.services.mozilla.com/D92704
2020-10-08 18:27:43 +00:00