Граф коммитов

10282 Коммитов

Автор SHA1 Сообщение Дата
Mitchell Hentges a37e7812d4 Bug 1748737: Bump attrs to be compatible with mochitest r=ahal
A bunch of modern packages (`pytest`, `twisted`, `automat`) all need
`attrs==19.2.0` (or newer).
We _could_ bump `attrs` all the way to the modern `21.4.0` version, but
I'd like to defer that upgrade risk, since there's a
lot of backwards-incompatible changes and deprecations. So, lightly bump
it to `19.2.0`.

As part of bumping it, `pytest` is no longer compatible.
The earliest candidate that seems to be compatible is `pytest` 4.6.6,
which boasts in its release notes that it's resolved some deprecation
warnings against `attrs>=19.2.0`.

Once `pytest` was bumped, it needed a newer version of `pluggy`, which
itself has dependencies.
Since we're using hashes in `tox_requirements.txt`, all dependencies
needed to be hashed as well.

Differential Revision: https://phabricator.services.mozilla.com/D135178
2022-01-21 18:21:56 +00:00
Mike Hommey d4919a8c5f Bug 1747970 - Move AC_CHECK_FUNC{,S} to python configure. r=firefox-build-system-reviewers,andi
- AC_HAVE_FUNCS is an alias to AC_CHECK_FUNCS, so it is covered.
- Nothing uses HAVE___CXA_DEMANGLE, so we don't explictly set it,
  although we do need the result of whether __cxa_demangle is supported.
- No moz.build uses MOZ_DEMANGLE_SYMBOLS, so we only `set_define` it.
- We leave dladdr in old-configure because it needs to move along other
  dl* things.
- The hotfix for AC_CHECK_FUNC is however not needed for dladdr, so we
  remove it.
- We replace the forced HAVE_LOCALECONV on Windows with a check shared
  with all platforms.

Differential Revision: https://phabricator.services.mozilla.com/D134858
2022-01-20 21:01:20 +00:00
Mike Hommey a3c1255269 Bug 1750599 - Keep track of the time spent running valgrind on perfherder. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D136308
2022-01-19 22:27:48 +00:00
Mike Hommey 77e267d014 Bug 1750599 - Apply valgrind upstream patch that increases performance with --track-origins=yes. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D136307
2022-01-19 22:27:47 +00:00
Mike Hommey cce437063b Bug 1749386 - Fall back to `mach artifact toolchain --from-build` if we cannot resolve to a task in configure. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D136300
2022-01-19 22:17:44 +00:00
Mike Hommey 00fdf5557e Bug 1750893 - Move Android linker flags to python configure. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D136294
2022-01-19 21:32:10 +00:00
Mike Hommey 9b6c3d38b3 Bug 1750855 - Don't valgrind dbus-launch and its subprocesses. r=firefox-build-system-reviewers,mhentges
For some reason, the execution of dbus-launch causes problems after bug
1734934, even though we were executing dbus-launch before. We don't
actually care about valgrind'ing its execution, though, because it's a
system program.

Differential Revision: https://phabricator.services.mozilla.com/D136312
2022-01-19 21:16:51 +00:00
Iulian Moraru f2f55d39bc Backed out changeset ffdd096022f9 (bug 1747970) for causing android build bustages. CLOSED TREE 2022-01-19 02:20:04 +02:00
Mike Hommey 464471142b Bug 1747970 - Move AC_CHECK_FUNC{,S} to python configure. r=firefox-build-system-reviewers,andi
- AC_HAVE_FUNCS is an alias to AC_CHECK_FUNCS, so it is covered.
- Nothing uses HAVE___CXA_DEMANGLE, so we don't explictly set it,
  although we do need the result of whether __cxa_demangle is supported.
- No moz.build uses MOZ_DEMANGLE_SYMBOLS, so we only `set_define` it.
- We leave dladdr in old-configure because it needs to move along other
  dl* things.
- The hotfix for AC_CHECK_FUNC is however not needed for dladdr, so we
  remove it.
- We replace the forced HAVE_LOCALECONV on Windows with a check shared
  with all platforms.

Differential Revision: https://phabricator.services.mozilla.com/D134858
2022-01-18 23:53:38 +00:00
Mike Hommey 933a6a1002 Bug 1750671 - Fixup for artifact builds. CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D136274
2022-01-18 22:10:54 +00:00
Mike Hommey 6c2ecbdb2e Bug 1750671 - Adjustments to fix testcase. CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D136270
2022-01-18 21:31:56 +00:00
Mike Hommey 88a7543acc Bug 1750671 - Pass linker flags to compiler when running check_symbols. r=firefox-build-system-reviewers,andi
Differential Revision: https://phabricator.services.mozilla.com/D136204
2022-01-18 21:03:19 +00:00
Mike Hommey 2c9df18067 Bug 1750671 - Move linker detection around. r=firefox-build-system-reviewers,andi
Differential Revision: https://phabricator.services.mozilla.com/D136203
2022-01-18 21:03:19 +00:00
Mike Hommey 168573ae42 Bug 1750659 - Refresh D116020 patch with what landed upstream. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D136197
2022-01-18 00:59:16 +00:00
Mike Hommey 78aef3e33c Bug 1750486 - Refresh clang patch to fit upstream trunk changes. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D136196
2022-01-18 00:59:16 +00:00
Mike Hommey 939ebefde9 Bug 1749607 - Only use bootstrapped pkgconf when using bootstrapped sysroot. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D135978
2022-01-17 23:49:35 +00:00
Jan-Erik Rediger 8d108a59d0 Bug 1750544 - Upgrade to Glean v43.0.2. r=chutten
Differential Revision: https://phabricator.services.mozilla.com/D136138
2022-01-17 16:26:33 +00:00
Andrew Halberstadt 0a81bd23a2 Bug 1740631 - Add requirements-plist-url to mac signing payloads, r=aki,glandium
This file will get picked up by our mac signing infrastructure and be
forwarded to the `productbuild` invocation.

Differential Revision: https://phabricator.services.mozilla.com/D135056
2022-01-17 15:36:38 +00:00
Jesse Schwartzentruber 7178259892 Bug 1708787 - Package UBSan runtime with MacOS builds. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D135635
2022-01-14 14:47:15 +00:00
Mike Hommey bb71e9f807 Bug 1749289 - Don't apply the win64-no-symlink patch on clang trunk. r=firefox-build-system-reviewers,mhentges DONTBUILD
The patch conflicts with recent clang changes, and we're not building a
win64 clang trunk anyways.

Differential Revision: https://phabricator.services.mozilla.com/D135567
2022-01-13 21:27:33 +00:00
Mitchell Hentges f389fa2412 Bug 1730712: Don't duplicate common virtualenv requirements r=ahal
Now that command virtualenvs are automatically containing Mach's
sys.path entries, they no longer need to be duplicated.

For compatibility's sake, all "common" requirements have
been moved to be "Mach" requirements. As time goes on
and we know which packages aren't needed for Mach itself,
we can move them back into the common (to commands) requirements
file, and eventually into only the virtualenvs that need them.

Differential Revision: https://phabricator.services.mozilla.com/D132083
2022-01-13 20:49:08 +00:00
Benjamin Beurdouche 84a342941b Bug 1748820 - land NSS 44e6341be5e8 UPGRADE_NSS_RELEASE, r=beurdouche
Differential Revision: https://phabricator.services.mozilla.com/D135690
2022-01-12 10:40:38 +00:00
Agi Sferro fe94caaf56 Bug 1743469 - Target android 31. r=jgraham,jnicol,calu
Differential Revision: https://phabricator.services.mozilla.com/D133153
2022-01-11 19:16:03 +00:00
Kagami Sascha Rosylight 901a35ec10 Bug 1748874 - Part 5: Require CAN_RUN_SCRIPT to be at the first declaration r=andi
Depends on D135404

Differential Revision: https://phabricator.services.mozilla.com/D135405
2022-01-11 11:52:27 +00:00
Christian Holler 6a7cccb953 Bug 1747298 - Use CXX for Cargo linking when necessary. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D135219
2022-01-11 11:26:39 +00:00
Iulian Moraru 30ccf11d2e Backed out changeset 30fb33fe9ec3 (bug 1747298) for causing multiple mochitest failures. CLOSED TREE 2022-01-11 13:14:36 +02:00
Christian Holler 7db161c99e Bug 1747298 - Use CXX for Cargo linking when necessary. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D135219
2022-01-11 09:31:31 +00:00
Cristian Tuns dea3b789a7 Backed out 2 changesets (bug 1617369, bug 1519636) for causing lint failures on multiple files. CLOSED TREE
Backed out changeset 6726892a0012 (bug 1617369)
Backed out changeset c08caa5f8504 (bug 1519636)
2022-01-11 04:38:34 -05:00
Andi-Bogdan Postelnicu 91c41ec2e4 Bug 1617369 - Reformat recent rust changes with rustfmt r=emilio
Updated with rustfmt 1.4.37-stable (f1edd04 2021-11-29)

Differential Revision: https://phabricator.services.mozilla.com/D135527
2022-01-11 09:16:57 +00:00
Mike Hommey 3885215795 Bug 1747532 - Default to lld for local mac builds. r=firefox-build-system-reviewers,andi
When using clang >= 13.0

Differential Revision: https://phabricator.services.mozilla.com/D134862
2022-01-11 00:07:41 +00:00
Mike Hommey 5bf15edfdb Bug 1747532 - Add clang version mappings for more versions of Xcode. r=firefox-build-system-reviewers,andi
Differential Revision: https://phabricator.services.mozilla.com/D134861
2022-01-11 00:07:41 +00:00
Kagami Sascha Rosylight 458177e66f Bug 1732673 - Add cppwinrt to include path on Windows r=firefox-build-system-reviewers,andi
This enables `#include <winrt/base.h>` to work.

While the build itself works, clangd still complains that it can't find winrt/base.h, probably because of https://github.com/llvm/llvm-project/issues/53112.

Differential Revision: https://phabricator.services.mozilla.com/D135510
2022-01-10 16:06:48 +00:00
Mike Hommey c8c1a3c5f2 Bug 1748966 - Speed up bootstrap. r=firefox-build-system-reviewers,andi
Currently, the bootstrap code from configure gets bootstrapped task info
from the taskgraph, and then invokes `mach artifact toolchain` which...
does the same again. That cumulatively wastes a noticeable amount of
time, especially on Windows.

So to avoid repeating this work that the configure side already did,
we do a little more on the configure side (resolution from index to
task-id), and just give a (task-id, artifact path) pair to `mach
artifact toolchain`. The added code to `mach artifact toolchain` is
actually ironically very similar to the code that was removed in
bug 1687594.

And now that mach bootstrap uses the configure code, it benefits from
this change as well.

Differential Revision: https://phabricator.services.mozilla.com/D135311
2022-01-07 21:26:44 +00:00
Mike Hommey f48d05698c Bug 1748779 - Update the list of features in the dummy web-sys crate. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D135193
2022-01-07 09:14:10 +00:00
Mike Hommey 01c4ac46ad Bug 1748779 - Move dummy-web in-tree. r=firefox-build-system-reviewers,andi
It will make it easier to adjust those dummy libs when necessary.

Differential Revision: https://phabricator.services.mozilla.com/D135192
2022-01-07 09:14:10 +00:00
Dana Keeler 740734288a Bug 1748409 - regenerate expiring test certificates for 2022 r=jschanck
* the certificates were regenerated using `./mach generate-test-certs`
* the build/pgo/certs/ changes were made using
  `./mach python build/pgo/genpgocert.py`
* the zip files in security/manager/ssl/tests/unit/test_signed_apps/ were
  updated per the directions in the corresponding moz.build file
* security/manager/ssl/tests/unit/test_cert_override_read.js needed manual
  updating

Differential Revision: https://phabricator.services.mozilla.com/D135283
2022-01-07 02:13:06 +00:00
Csoregi Natalia 1f2a864c13 Backed out 2 changesets (bug 1747532) for busted artifact builds on MacOS. a=backout
Backed out changeset d0bc51a9eb47 (bug 1747532)
Backed out changeset 1b2a06b52985 (bug 1747532)
2022-01-06 19:38:33 +02:00
Mitchell Hentges 47520dab98 Bug 1725895: Add support for MSYS2 MozillaBuild r=glandium
MSYS2 has a slightly different directory structure (binaries are
now under "/usr/bin/" instead of "/bin/"), and we're now plonking
it in `%MOZILLABUILD%\msys2` instead of `%MOZILLABUILD%\msys` so that
MSYS1 files don't interfere with MSYS2 after a pave-over install.

Speaking of pave-over installs: if both `msys2` and `msys` are available,
this patch prefers `msys2`. This is because MozillaBuild installations
with MSYS2 are going to _assume_ they're using MSYS2, and therefore
be most compatible with the versions of packages shipped with MSYS2.

Differential Revision: https://phabricator.services.mozilla.com/D133549
2022-01-06 06:49:47 +00:00
Mitchell Hentges 92a19e0eb9 Bug 1740123: Allow invoking Mach outside of MozillaBuild r=glandium
Assuming that the `MOZILLABUILD` environment variable is set, allow
invoking Mach from non-MozillaBuild terminals.

Note that MozillaBuild still needs to be installed, and the
`MOZILLABUILD` environment variable will have to be set.

For future reference: when I tried setting this up with Windows
Store's Python 3.9, I encountered issues when running binaries installed
via `pip`: it would fail with `abort: failed to load Python DLL
python3x.dll`.

Differential Revision: https://phabricator.services.mozilla.com/D133936
2022-01-06 06:49:47 +00:00
Mitchell Hentges 0445e1ce71 Bug 1740123: Move Python version check earlier r=ahal
Move Python version check as early as possible so that more code can
safely depend on modern behaviour while out-of-date Python versions still
get graceful error messages.

Without this change, Python 2 usages fail on importing `importlib.util`
before the nice "out-of-date version" warning is printed.

Differential Revision: https://phabricator.services.mozilla.com/D134185
2022-01-06 00:32:49 +00:00
Mitchell Hentges 7e6a4952a2 Bug 1725895: Port `--profile-command` to pure-Python r=nalexander,glandium
As part of this, the shell-script part of `./mach` can be removed,
making it pure Python.

There's a change in `--profile-command` behaviour, though: it now only
profiles the specific command, rather than all of Mach.
This is because _so much of Mach_ has already been run before
CLI arguments are parsed in the Python process.

If a developer wants to profile Mach itself, they can manually run
`python3 -m cProfile -o <file> ./mach ...`

Differential Revision: https://phabricator.services.mozilla.com/D133928
2022-01-06 00:32:48 +00:00
Marian-Vasile Laza 7262acfd88 Backed out 2 changesets (bug 1725895, bug 1740123) for causing build bustages.
Backed out changeset a6eabd95e31d (bug 1740123)
Backed out changeset bfd5211060b4 (bug 1725895)
2022-01-05 03:46:17 +02:00
Mike Hommey 45bb78f8c8 Bug 1647542 - When cross-compiling on Windows, don't prioritize the target compiler as host compiler. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D135005
2022-01-05 00:47:55 +00:00
Mike Hommey fca792ecaa Bug 1748384 - Properly handle Windows SDK when the host compiler is clang-cl and the target compiler is not. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D135004
2022-01-05 00:47:55 +00:00
Mike Hommey d2d9350277 Bug 1748385 - Use the --dont-define-prefix flag of pkg-config when supported. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D135012
2022-01-05 00:02:43 +00:00
Mike Hommey 7ebc2dc34a Bug 1748385 - Add --shared flag when using pkgconf >= 1.7.4. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D135011
2022-01-05 00:02:42 +00:00
Mike Hommey 2fa5739371 Bug 1748385 - Use the system path separator for PKG_CONFIG_LIBDIR. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D135010
2022-01-05 00:02:42 +00:00
Mike Hommey e1c71aa04b Bug 1748385 - Add a pkgconf toolchain and use it. r=firefox-build-system-reviewers,mhentges
pkgconf is an alternative implementation of pkg-config that is more
cross-platform. It has also become the default on Fedora, so it's not
some random project.

Differential Revision: https://phabricator.services.mozilla.com/D135009
2022-01-05 00:02:41 +00:00
Mike Hommey 4433dc7410 Bug 513617 - Only check pkg-config on platforms where we need it. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D135008
2022-01-05 00:02:41 +00:00
Narcis Beleuzu 1b1effc9ba Backed out 5 changesets (bug 1748385, bug 513617) for bustages on pkg.configure . CLOSED TREE
Backed out changeset bc23b3cfb583 (bug 1748385)
Backed out changeset 53f3c4e3e600 (bug 1748385)
Backed out changeset 5c744edba720 (bug 1748385)
Backed out changeset ad23d3af4df6 (bug 1748385)
Backed out changeset 54e3431d9152 (bug 513617)
2022-01-05 01:23:29 +02:00