Граф коммитов

641 Коммитов

Автор SHA1 Сообщение Дата
David Major ab26127584 Bug 1686321 - Pass patches as arguments to build-compiler-rt.sh r=glandium
rename_gcov_flush_clang_11.patch doesn't apply cleanly to clang 12 and will need to be forked. Turning the filename into a parameter will let us have the tasks exist side by side.

Differential Revision: https://phabricator.services.mozilla.com/D101495
2021-01-14 03:41:08 +00:00
Dan Mosedale e91d8deeea Bug 1684936 - update NodeJS to 10.23.1 for latest sec fixes r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D100810
2021-01-07 17:06:42 +00:00
Mike Hommey 5a27f487f8 Bug 1685854 - Apply gcov_flush patch to compiler-rt. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D101294
2021-01-11 13:45:06 +00:00
Emilio Cobos Álvarez c60fdae7a4 Bug 1685957 - Use xargs to test non-unified builds. r=andi
Passing all the directories to mach allows to take more advantage of
parallelism (plus not having to start up mach and the whole export once
for every directory, which itself takes a bit of time)

This takes:

    GECKO_PATH=. taskcluster/scripts/misc/source-test-clang-non-unified.sh

from about ten mins to under two minutes on my machine.

Differential Revision: https://phabricator.services.mozilla.com/D101320
2021-01-11 04:25:29 +00:00
Mike Hommey eb3781ebc5 Bug 1685599 - Build a single macosx-cross toolchain. r=firefox-build-system-reviewers,mhentges
The new toolchain contains both aarch64 and x86_64 compiler-rts. We
could have a separate for each, but compiler-rt is small enough that
entirely separate toolchains is not warranted.

Differential Revision: https://phabricator.services.mozilla.com/D101079
2021-01-08 18:51:53 +00:00
Mike Hommey fd26bcb560 Bug 1685599 - Build a compiler-rt for x86_64. r=firefox-build-system-reviewers,mhentges
The llvm build system does support building a universal compiler-rt for
multiple platforms at once, but as far as I know it only supports doing
so with the same SDK, while we want to use separate SDKs for each, so
build the x86_64 compiler-rt separately.

Differential Revision: https://phabricator.services.mozilla.com/D101078
2021-01-08 18:51:52 +00:00
Mike Hommey feb2c466f7 Bug 1685599 - Don't rely on macosx-cross toolchain containing a mac native libLLVM. r=firefox-build-system-reviewers,andi,dmajor
The webrender wrench macos build, which is cross-compiled, needs a
macOS native libLLVM (a .dylib) to link against. The file is currently
part of the macosx-cross toolchain, but that was more incidental than
intentional. As we're going to change the macosx-cross toolchain in a
way that will remove the libLLVM.dylib, pull the file from the macOS
native clang.

Differential Revision: https://phabricator.services.mozilla.com/D101150
2021-01-08 18:51:54 +00:00
Mike Hommey b9cdcbef46 Bug 1685599 - Build llvm-symbolizer separately. r=firefox-build-system-reviewers,mhentges
Only sanitizer builds require a native llvm-symbolizer executable.
Ideally, we'd build llvm-symbolizer from scratch, which would be faster,
but for now, let's go the easy route and just extract it from the
corresponding native clang builds.

We don't actually do anything with the llvm-symbolizer executable on
android builds, so we don't install it in $FINAL_TARGET, avoilding
the dependency on android builds (plus, we actually don't have an
android-native llvm-symbolizer, so even if it were already shipped, it
would be the wrong file).

Differential Revision: https://phabricator.services.mozilla.com/D101076
2021-01-08 18:51:52 +00:00
Razvan Maries 891da67475 Backed out 6 changesets (bug 1685599) for WR bustages. CLOSED TREE
Backed out changeset 29eab2f84c77 (bug 1685599)
Backed out changeset 2839d8d39881 (bug 1685599)
Backed out changeset 3ba2f1c048c3 (bug 1685599)
Backed out changeset c7d4ecfc689a (bug 1685599)
Backed out changeset 5483ce4f5f4c (bug 1685599)
Backed out changeset 68fa5ecf205c (bug 1685599)
2021-01-08 09:04:37 +02:00
Mike Hommey 1c7ff6f2c2 Bug 1685599 - Build a single macosx-cross toolchain. r=firefox-build-system-reviewers,mhentges
The new toolchain contains both aarch64 and x86_64 compiler-rts. We
could have a separate for each, but compiler-rt is small enough that
entirely separate toolchains is not warranted.

Differential Revision: https://phabricator.services.mozilla.com/D101079
2021-01-08 00:38:37 +00:00
Mike Hommey 6ca557af7a Bug 1685599 - Build a compiler-rt for x86_64. r=firefox-build-system-reviewers,mhentges
The llvm build system does support building a universal compiler-rt for
multiple platforms at once, but as far as I know it only supports doing
so with the same SDK, while we want to use separate SDKs for each, so
build the x86_64 compiler-rt separately.

Differential Revision: https://phabricator.services.mozilla.com/D101078
2021-01-08 00:37:11 +00:00
Mike Hommey 3128330c17 Bug 1685599 - Build llvm-symbolizer separately. r=firefox-build-system-reviewers,mhentges
Only sanitizer builds require a native llvm-symbolizer executable.
Ideally, we'd build llvm-symbolizer from scratch, which would be faster,
but for now, let's go the easy route and just extract it from the
corresponding native clang builds.

We don't actually do anything with the llvm-symbolizer executable on
android builds, so we don't install it in $FINAL_TARGET, avoilding
the dependency on android builds (plus, we actually don't have an
android-native llvm-symbolizer, so even if it were already shipped, it
would be the wrong file).

Differential Revision: https://phabricator.services.mozilla.com/D101076
2021-01-07 23:53:19 +00:00
Andi-Bogdan Postelnicu d7fb68e56d Bug 1683613 - For `non-unified` build have a task that runs checks when merging to mozilla-central r=mhentges
Differential Revision: https://phabricator.services.mozilla.com/D100796
2021-01-05 19:40:23 +00:00
Mike Hommey 6e7d937be7 Bug 1682660 - Set CMAKE_RANLIB when building compiler-rt. r=dmajor
Without it, the build uses /usr/bin/ranlib, which, for some reason,
doesn't fail, but does weird things.

Differential Revision: https://phabricator.services.mozilla.com/D100073
2020-12-18 04:42:16 +00:00
Mike Hommey a734bb41a9 Bug 1682660 - Wrap clang to pass all the necessary flags when building compiler-rt. r=dmajor
When building compiler-rt for macOS, its build system assumes the
compiler used is a native macOS clang, drops all the cmake C/C++ flags,
and adds its own.

Because we do need to pass `-target $target` (otherwise we end up with
ELF x86_64 objects) and `-mcpu=apple-a12` for the correct baseline for
arm64 macOS, and because there is unfortunately no cmake variable that
the compiler-rt build system will use, and because CMAKE_C*_COMPILER
need to be a program without arguments, we need to wrap the compiler.

While here, add `-v` to the ninja call to have more useful logs.

Differential Revision: https://phabricator.services.mozilla.com/D99841
2020-12-18 01:50:07 +00:00
Mike Hommey d79dcf5161 Bug 1623520 - Switch Windows asan and fuzzing builds to cross-builds. r=decoder
Differential Revision: https://phabricator.services.mozilla.com/D79417
2020-12-11 05:06:12 +00:00
Mike Hommey b7e6c5660f Bug 1680183 - Make dump-syms binary compatible with older libstdc++. r=firefox-build-system-reviewers,mhentges
This will allow to run it on older systems without LD_LIBRARY_PATH
tricks.

Differential Revision: https://phabricator.services.mozilla.com/D98425
2020-12-02 22:26:26 +00:00
Mike Hommey 12679da6a0 Bug 1680152 - Bump macos SDK to 10.12. r=spohl,firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D98421
2020-12-02 21:50:28 +00:00
Steve Fink 3d02a92acd Bug 1680159 - Do not collect source code during automated hazard analysis. r=jonco
Differential Revision: https://phabricator.services.mozilla.com/D98409
2020-12-02 16:22:40 +00:00
Alexis Beingessner e2c5b3cbbe Bug 1680124 - Document Rust builds (and add some pointers/links for clang ones). r=dmajor
Differential Revision: https://phabricator.services.mozilla.com/D98386
2020-12-01 23:55:34 +00:00
David Major fc89cd6438 Bug 1679909 - Use PATH instead of -B in build-compiler-rt.sh r=glandium
As of version 12, clang doesn't accept `-B` for target-prefixed binaries. This is said to be for GCC compatibility: 3452a0d8c1

Differential Revision: https://phabricator.services.mozilla.com/D98261
2020-12-01 04:32:55 +00:00
Alexis Beingessner a2e4c21db2 Bug 1677593 - Add support for building rust from source. r=glandium
This adds a linux64-rust-dev toolchain and a git fetch of rust-lang/rust
that it can source from (stable tag for 1.47).

There are some issues with cross-compiling, so for now the toolchain only
builds a host build, although a lot of the machinery for cross compiling is
there for anyone brave/desperate enough to get it working.

Also note some changes were made to Rust's config.toml between 1.47 and 1.50,
so some version detection may need to be added in the future.

There is experimental support for providing patches via a new --patch flag.

Additionally, I documented the existence of the "bors-" mode.

Differential Revision: https://phabricator.services.mozilla.com/D97497
2020-11-26 00:42:27 +00:00
Mike Hommey ffd412896c Bug 1678154 - Create a clang repack including the aarch64 mac compiler-rt. r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D97699
2020-11-20 01:54:33 +00:00
Mike Hommey 323c368072 Bug 1678154 - Enable aarch64 mac support to llvm-dsymutil. r=firefox-build-system-reviewers,dmajor
While here, upgrade it to LLVM 11.

Differential Revision: https://phabricator.services.mozilla.com/D97697
2020-11-20 02:09:20 +00:00
Mike Hommey f27976b952 Bug 1678154 - Build compiler-rt for aarch64 macos. r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D97696
2020-11-20 03:18:15 +00:00
Mike Hommey d015ddb9b6 Bug 1678154 - Add aarch64-prefixed binaries to cctools. r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D97695
2020-11-20 03:19:36 +00:00
Mike Hommey 4efa8e2b00 Bug 1678154 - Pack the mac OS SDK as a private artifact. r=firefox-build-system-reviewers,nalexander
Differential Revision: https://phabricator.services.mozilla.com/D97694
2020-11-20 00:03:13 +00:00
Tom Ritter c66c67c6df Bug 1674914 - Switch the verify-updatebot script to the autoland API r=sheehan DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D96724
2020-11-12 16:33:20 +00:00
Mike Hommey 2c3e9aa3e9 Bug 1675740 - Replace the mac shippable build with a build that unifies a x86_64 and an aarch64 build. r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D96691
2020-11-12 05:40:42 +00:00
Tom Ritter 490b9e9b02 Bug 1674897 - Potentially raise an error in the updatebot verification script r=aki DONTBUILD
If we don't find any revisions in !public() - when run on autoland - then the
assumptions of the script are incorrect and we may have changed something, such
that the script starts silently succeeding even though it's not checking anything.

Differential Revision: https://phabricator.services.mozilla.com/D95591
2020-11-10 22:45:37 +00:00
Ricky Stewart 02a7b4ebdf Bug 1654103: Standardize on Black for Python code in `mozilla-central`.
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-26 18:34:53 +00:00
Bogdan Tara da1098d4aa Backed out 10 changesets (bug 1654103, bug 1672023, bug 1518999) for PanZoomControllerTest.touchEventForResult gv-junit failures CLOSED TREE
Backed out changeset ff3fb0b4a512 (bug 1672023)
Backed out changeset e7834b600201 (bug 1654103)
Backed out changeset 807893ca8069 (bug 1518999)
Backed out changeset 13e6b92440e9 (bug 1518999)
Backed out changeset 8b2ac5a6c98a (bug 1518999)
Backed out changeset 575748295752 (bug 1518999)
Backed out changeset 65f07ce7b39b (bug 1518999)
Backed out changeset 4bb80556158d (bug 1518999)
Backed out changeset 8ac8461d7bd7 (bug 1518999)
Backed out changeset e8ba13ee17f5 (bug 1518999)
2020-10-24 03:36:18 +03:00
Steve Fink 25abe08e0c Bug 1668489 - Switch to sixgill that qualifies `using`-aliased template members to avoid collisions between different types r=jonco
Differential Revision: https://phabricator.services.mozilla.com/D94356
2020-10-23 23:13:07 +00:00
Mike Hommey 5c75040f4c Bug 1672889 - Add a mac nasm toolchain. r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D94533
2020-10-23 13:54:26 +00:00
Ricky Stewart c0cea3b0fa Bug 1654103: Standardize on Black for Python code in `mozilla-central`. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-23 20:40:42 +00:00
Mike Hommey fff894926f Bug 1672837 - Don't fail to repack recent rust nightlies. r=firefox-build-system-reviewers,rstewart
The contents of the .sha256 files have changed two days ago and don't
contain the file name anymore. Considering the file name is already in
the sha256 file name, we can assume it matches. The file name check was
only an additional assurance. We could keep it conditionally, but
in only a few months, all the ones we care about will have switched to
the new format.

Differential Revision: https://phabricator.services.mozilla.com/D94490
2020-10-22 21:24:49 +00:00
sanketh 35cd8eb504 Bug 1655482 - Bump MinGW to fix the STATUS_HEAP_CORRUPTION define r=tjr
- Bump MinGW version
- Add patch to workaround MinGW's dwrite_3.h
- Remove MinGW workaround for STATUS_HEAP_CORRUPTION define
- Remove MinGW workaround in MMPolicies.h.

Differential Revision: https://phabricator.services.mozilla.com/D91157
2020-10-22 15:58:54 +00:00
Mike Hommey 74e2a2cabf Bug 1672499 - Get wrench cargo tests from the deps subdirectory. r=kats
As of cargo 1.44.0, the test binaries are not copied into
target/$target/debug, but they are in target/$target/debug/deps (they
were there too before). Cargo test runs the tests from there now
instead, so change the scripts accordingly.

Differential Revision: https://phabricator.services.mozilla.com/D94402
2020-10-22 11:25:58 +00:00
Mike Hommey 2817852926 Bug 1672328 - Allow to pull rustc builds from upstream CI. r=firefox-build-system-reviewers,rstewart
This is useful to bisect problems through our own CI.

Differential Revision: https://phabricator.services.mozilla.com/D94267
2020-10-22 01:11:17 +00:00
Dorel Luca 1ff59cb7a3 Backed out changeset 7558c8821a07 (bug 1654103) for multiple failures. CLOSED TREE 2020-10-22 03:51:06 +03:00
Ricky Stewart 50762dacab Bug 1654103: Standardize on Black for Python code in `mozilla-central`. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-21 21:27:27 +00:00
Mike Hommey 0b93a75baa Bug 1644624 - Apply the compiler_builtins hack to aarch64-linux-android too. CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D94260
2020-10-21 07:37:19 +00:00
Mike Hommey 476c7a1cb7 Bug 1644624 - Optionally postprocess the compiler_builtins rlib when repacking rust. r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D93730
2020-10-20 19:30:06 +00:00
Cosmin Sabou b8fd79f461 Backed out 5 changesets (bug 1644624, bug 1671555) for windows shippable bustage.
Backed out changeset fee83fc16940 (bug 1644624)
Backed out changeset afb2a7ff532c (bug 1671555)
Backed out changeset 609ac687f7e3 (bug 1644624)
Backed out changeset d91db0801099 (bug 1644624)
Backed out changeset ce09ad625b53 (bug 1644624)
2020-10-20 06:52:09 +03:00
Mike Hommey 1ee16dc4df Bug 1644624 - Optionally postprocess the compiler_builtins rlib when repacking rust. r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D93730
2020-10-16 15:52:15 +00:00
Mike Hommey 15db2adc30 Bug 1670156 - Switch 32-bits mingw clang to dwarf exceptions. r=tjr
That is what rust uses, and versions of rust >= 1.44 make the
discrepancy visible as a linker error on missing the _Unwind_Resume
symbol, so we need to align things.

Differential Revision: https://phabricator.services.mozilla.com/D93725
2020-10-16 12:51:22 +00:00
Mike Hommey bd3416a215 Bug 1671542 - Get rust toolchain xz archives rather than gz from upstream. r=firefox-build-system-reviewers,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D93722
2020-10-19 21:34:26 +00:00
Gregory Mierzwinski 1810afabc7 Bug 1669534 - Run chrome/chromium pageload tests in browsertime. r=perftest-reviewers,Bebe
This patch fixes various issues that prevented us from running chromium/chrom in raptor-browsertime.
(1) Chromium fetch task now also fetches the latest chromedriver.
(2) FFMPEG failures when recording on chrome/chromium.
(3) Various changes where chromium wasn't considered as a variant of chrome.

Differential Revision: https://phabricator.services.mozilla.com/D92646
2020-10-13 20:36:52 +00:00
Mark Banner d453a422a7 Bug 1666172 - Update node to 10.22.1. CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D91838
2020-09-29 20:42:10 +00:00
Tom Ritter 1dbcbeb968 Bug 1618949 - Create a job that verifies reproducibility of updatebot jobs r=aki
Differential Revision: https://phabricator.services.mozilla.com/D91175
2020-09-28 16:55:03 +00:00