Граф коммитов

8639 Коммитов

Автор SHA1 Сообщение Дата
Nathan Froyd be320d836e Bug 1569370 - add mozconfig fragments for declaring wasm sandboxing bits; r=firefox-build-system-reviewers,rstewart
This patch is not ideal: if would be better to do the defaulting in
`toolkit/moz.configure`, but doing it there runs into problems with base
toolchain configurations, as the clang there is not new enough.  So we
have this, doing everything with environment variables, which is easily
turned on or off, depending on the needs of the specific configuration.

The `mozconfig.no-compile` change is not really needed, as the wasm
sandboxing detection bits are not conditional on
`--enable-compile-environment`.  Those bits should be, and I will tackle
doing that after the holidays.

Differential Revision: https://phabricator.services.mozilla.com/D58102

--HG--
extra : moz-landing-system : lando
2020-01-02 14:50:08 +00:00
Chris Manchester c032dfee0f Bug 1596182 - Add raptor-webaudio to the pgo profile run. r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D58003

--HG--
extra : moz-landing-system : lando
2020-01-02 19:49:14 +00:00
Ricky Stewart 7d68d2a54a Bug 1605264 - "./mach package" should use Python 3 r=firefox-build-system-reviewers,mshal
Differential Revision: https://phabricator.services.mozilla.com/D57908

--HG--
extra : moz-landing-system : lando
2020-01-02 17:27:48 +00:00
Ciure Andrei b23acd28e8 Backed out changeset fe3a47b458ad (bug 1605264) for causing build bustages on central a=backout 2020-01-01 13:00:37 +02:00
Ricky Stewart 13365ed474 Bug 1605264 - "./mach package" should use Python 3 r=firefox-build-system-reviewers,mshal
Differential Revision: https://phabricator.services.mozilla.com/D57908

--HG--
extra : moz-landing-system : lando
2019-12-31 21:19:33 +00:00
Sylvestre Ledru f3a0c62f4c Bug 1605560 - Move to clang 9.0.1 r=froydnj
remove patch "r372020-r372182-profiler-linkage.patch" as
it is now applied upstream in the branch 9:
99e5b1a41a (diff-74ce7383b15a6fad853c8677f58da28a)

Differential Revision: https://phabricator.services.mozilla.com/D58076

--HG--
extra : moz-landing-system : lando
2019-12-22 21:57:04 +00:00
shindli 4f5d5bf966 Backed out changeset 008852b3720d (bug 1569370) for causing linux x64 wasm bustages CLOSED TREE
--HG--
extra : rebase_source : bb2fac5057260496f457c6466a0803c3c41b930c
2019-12-30 21:15:37 +02:00
Nathan Froyd 52c254b0e6 Bug 1569370 - add mozconfig fragments for declaring wasm sandboxing bits; r=firefox-build-system-reviewers,rstewart
This patch is not ideal: if would be better to do the defaulting in
`toolkit/moz.configure`, but doing it there runs into problems with base
toolchain configurations, as the clang there is not new enough.  So we
have this, doing everything with environment variables, which is easily
turned on or off, depending on the needs of the specific configuration.

The `mozconfig.no-compile` change is not really needed, as the wasm
sandboxing detection bits are not conditional on
`--enable-compile-environment`.  Those bits should be, and I will tackle
doing that after the holidays.

Differential Revision: https://phabricator.services.mozilla.com/D58102

--HG--
extra : moz-landing-system : lando
2019-12-24 04:27:01 +00:00
Dzmitry Malyshau 785a7cfbc2 Bug 1596126 - Github synchronization for gfx/wgpu r=Callek,tomprince
This change introduces a "github-sync" component into tools,
which aims to support synchronizing both wgpu and WebRender with github.
~~It also features a "cargo test" job for standalone wgpu (bug  1596127)~~

The code is ported from "gfx/wr/scripts/wrupdater" folder. Changes are:
  1. remove explicit WR parts and make them configurable by command line params
  2. detect "mozilla-xxx" tags and use them in addition to the commits

As a follow up, wrupdater will be removed in favor of github-sync.

Status:
  - [x] get the CI test job working
  - [x] get @kats to fork "wgpu" github for "moz-gfx" bot
  - [x] remove the wgpu testing CI job (into separate PR)
  - [x] create new secret and reference it

Differential Revision: https://phabricator.services.mozilla.com/D57057

--HG--
extra : moz-landing-system : lando
2019-12-28 02:44:59 +00:00
Mike Hommey 57f5b8a7bf Bug 1604335 - Enable PHC on early beta. r=erahm
Differential Revision: https://phabricator.services.mozilla.com/D58285

--HG--
extra : moz-landing-system : lando
2019-12-27 04:34:33 +00:00
Mike Hommey e4a8d2ba9f Bug 1597834 - Make EARLY_BETA_OR_EARLIER available to python configure. r=rstewart
Differential Revision: https://phabricator.services.mozilla.com/D58280

--HG--
extra : moz-landing-system : lando
2019-12-27 22:18:32 +00:00
Nicholas Nethercote b692b7c5cf Bug 1599337 - Make PHC nightly-only again. r=erahm
Differential Revision: https://phabricator.services.mozilla.com/D56480

--HG--
extra : moz-landing-system : lando
2019-12-10 05:28:58 +00:00
Andreea Pavel bfb46a92de Backed out changeset c867ca4daf74 (bug 1569370) for build bustages on a CLOSED TREE 2019-12-24 05:40:35 +02:00
Nathan Froyd be203e102e Bug 1569370 - add mozconfig fragments for declaring wasm sandboxing bits; r=firefox-build-system-reviewers,rstewart
This patch is not ideal: if would be better to do the defaulting in
`toolkit/moz.configure`, but doing it there runs into problems with base
toolchain configurations, as the clang there is not new enough.  So we
have this, doing everything with environment variables, which is easily
turned on or off, depending on the needs of the specific configuration.

The `mozconfig.no-compile` change is not really needed, as the wasm
sandboxing detection bits are not conditional on
`--enable-compile-environment`.  Those bits should be, and I will tackle
doing that after the holidays.

Differential Revision: https://phabricator.services.mozilla.com/D58102

--HG--
extra : moz-landing-system : lando
2019-12-23 16:47:18 +00:00
Andreea Pavel 859dfc94b1 Backed out changeset e6e01dd97002 (bug 1605560) for causing build bustages a=backout 2019-12-22 12:14:47 +02:00
Sylvestre Ledru 6b5a637f41 Bug 1605560 - Move to clang 9.0.1 r=froydnj
remove patch "r372020-r372182-profiler-linkage.patch" as
it is now applied upstream in the branch 9:
99e5b1a41a (diff-74ce7383b15a6fad853c8677f58da28a)

Differential Revision: https://phabricator.services.mozilla.com/D58076

--HG--
extra : moz-landing-system : lando
2019-12-21 18:08:28 +00:00
Chris Manchester d068aba2ee Bug 1605110 - Adjust `import-instr-limit` on macOS to match other platforms now that we have pgo. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D58045

--HG--
extra : moz-landing-system : lando
2019-12-20 21:07:42 +00:00
Narcis Beleuzu 4784c2b263 Backed out changeset 476527cfd083 (bug 1596182) for Bpgo crashes on linux-gate.so . CLOSED TREE 2019-12-20 20:43:46 +02:00
Chris Manchester 225ec59663 Bug 1596182 - Add raptor-webaudio to the pgo profile run. r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D58003

--HG--
extra : moz-landing-system : lando
2019-12-20 17:22:53 +00:00
Jonathan Watt b53043624b Bug 1605268. Notify Xcode debugger users that the KeyError can be ignored. r=heycam
Differential Revision: https://phabricator.services.mozilla.com/D57914

--HG--
extra : moz-landing-system : lando
2019-12-20 03:41:00 +00:00
Ricky Stewart 3513bb2f84 Bug 1604881 - fail if user attempts to set CC or CXX with "mk_add_options" in .mozconfig r=firefox-build-system-reviewers,chmanchester
Differential Revision: https://phabricator.services.mozilla.com/D57656

--HG--
extra : moz-landing-system : lando
2019-12-19 21:00:43 +00:00
Sylvestre Ledru 33853fcce7 Bug 1605181 - 'if constexpr' wasn't supported in clang-tidy r=andi
Differential Revision: https://phabricator.services.mozilla.com/D57835

--HG--
extra : moz-landing-system : lando
2019-12-19 18:32:40 +00:00
shravanrn@gmail.com c9ff62b7ef Bug 1566288 - Port libGraphite usage in libThebes to use the RLBox API. r=froydnj,jfkthame
Differential Revision: https://phabricator.services.mozilla.com/D39593

--HG--
extra : moz-landing-system : lando
2019-12-19 16:05:35 +00:00
Nathan Froyd 8058ebbc5b Bug 1604814 - change the OS X SDK headers check to only run on OS X; r=rstewart
The doubling of `when` is needed: the `try_run` when ensures that we
only execute the compiler on OS X, and the `@depends` when ensures that
we don't look at the `None` result (which would normally indicate
failure) on non-OS X hosts.

Differential Revision: https://phabricator.services.mozilla.com/D57636

--HG--
extra : moz-landing-system : lando
2019-12-18 21:00:57 +00:00
Chris Manchester 6b7cde2020 Bug 1604578 - Fix pgo enable variable name in macOS mozconfig. r=firefox-build-system-reviewers,mshal
Differential Revision: https://phabricator.services.mozilla.com/D57596

--HG--
extra : moz-landing-system : lando
2019-12-18 17:53:36 +00:00
Brindusan Cristian 858cf4323e Backed out 2 changesets (bug 1569369, bug 1566288) for build bustages at rlbox_sandbox.hpp. CLOSED TREE
Backed out changeset 75d775daa792 (bug 1569369)
Backed out changeset 0bc20fd26ca0 (bug 1566288)
2019-12-18 13:53:56 +02:00
shravanrn@gmail.com 0eecffaee5 Bug 1566288 - Port libGraphite usage in libThebes to use the RLBox API. r=froydnj,jfkthame
Differential Revision: https://phabricator.services.mozilla.com/D39593

--HG--
extra : moz-landing-system : lando
2019-12-17 00:26:50 +00:00
Chris Manchester 4d12edfd8d Bug 1594538 - Require rustc 1.39 to build. r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D57396

--HG--
extra : moz-landing-system : lando
2019-12-17 17:12:21 +00:00
Ryan VanderMeulen fa1a2fe66d Backed out changeset ebbc8a9e9737 (bug 1543853) for causing bug 1603482. 2019-12-17 10:15:58 -05:00
Chris Manchester 0929dac033 Bug 1528374 - Add macOS pgo builds to the taskgraph. r=firefox-build-system-reviewers,mshal,tomprince
Differential Revision: https://phabricator.services.mozilla.com/D20409

--HG--
extra : moz-landing-system : lando
2019-12-16 23:25:07 +00:00
Oana Pop Rus b49aefd3c9 Backed out 3 changesets (bug 1528374) for build bustages failures during artifact upload: file-missing-on-worker: Could not read directory /Users/task_1576213467/artifacts on a CLOSED TREE
Backed out changeset 3c2a1cf616b4 (bug 1528374)
Backed out changeset 967d0072cd2f (bug 1528374)
Backed out changeset 0d0186ecd70e (bug 1528374)
2019-12-16 23:50:45 +02:00
Chris Manchester 23e9c6d856 Bug 1528374 - Add macOS pgo builds to the taskgraph. r=firefox-build-system-reviewers,mshal,tomprince
Differential Revision: https://phabricator.services.mozilla.com/D20409

--HG--
extra : moz-landing-system : lando
2019-12-13 05:43:44 +00:00
Emilio Cobos Álvarez 1258c314aa Bug 1604160 - Update cbindgen to do proper copy assignment on tagged enums. r=boris
This is needed to support min() / max() / clamp(), as LengthPercentage will have
a potential heap allocation and the current copy-assignment operators just do
bitwise copies.

Differential Revision: https://phabricator.services.mozilla.com/D57300

--HG--
extra : moz-landing-system : lando
2019-12-16 13:31:24 +00:00
Calixte Denizet c82c13e1a9 Bug 1603436 - Rename clang patch (critical_section_on_gcov_flush.patch) to make easier the switch to LLVM 10 r=dmajor
Cherry-picked from: 02ce9d8ef5.

Differential Revision: https://phabricator.services.mozilla.com/D56945

--HG--
rename : build/build-clang/critical_section_on_gcov_flush.patch => build/build-clang/critical_section_on_gcov_flush-rG02ce9d8ef5a8.patch
extra : moz-landing-system : lando
2019-12-12 22:13:04 +00:00
Tyson Smith f28f9e82c6 Bug 1602845 - Enable 'return' UBSan check. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D56626

--HG--
extra : moz-landing-system : lando
2019-12-15 05:13:34 +00:00
Chris Peterson 8fd7f11cb8 Bug 1583717 - Enable clang's -Wempty-init-stmt warnings. r=glandium
-Wempty-init-stmt is a new clang diagnostic that diagnoses empty C++17 init-statements of if, switch, and range-based for statements:

void test() {
  if(; // <- warning: init-statement of 'if' is a null statement
    true)
  ;

  switch (; // <- warning: init-statement of 'switch' is a null statement
    x) {
    ...
  }

  for (; // <- warning: init-statement of 'range-based for' is a null statement
    int y : S())
  ;
}

Differential Revision: https://phabricator.services.mozilla.com/D54866

--HG--
extra : moz-landing-system : lando
2019-12-12 02:18:37 +00:00
Noemi Erli 24e02f049b Backed out 3 changesets (bug 1528374) per tomprice's request for breaking macOS signing jobs CLOSED TREE
Backed out changeset 5a6fa3b5123b (bug 1528374)
Backed out changeset 32f3b1b3fe3b (bug 1528374)
Backed out changeset a412a319534c (bug 1528374)
2019-12-13 06:48:05 +02:00
Chris Manchester 3138b4cffd Bug 1528374 - Add macOS pgo builds to the taskgraph. r=firefox-build-system-reviewers,mshal,tomprince
Differential Revision: https://phabricator.services.mozilla.com/D20409

--HG--
extra : moz-landing-system : lando
2019-12-12 19:31:17 +00:00
Tom Prince 9e2fc7ebbc Bug 1596775: Import scripts for downloading macOS system symbols; r=marco
Import the code from
https://github.com/marco-c/breakpad-mac-update-symbols/
and
https://github.com/marco-c/breakpad-scrape-system-symbols

Differential Revision: https://phabricator.services.mozilla.com/D55321

--HG--
extra : moz-landing-system : lando
2019-12-12 02:05:21 +00:00
Cosmin Sabou 1b479d118b Backed out changeset f5d00d265686 (bug 1566288) for causing build bustages.
--HG--
extra : amend_source : 4151f2dfb2775bbf1fa3255d47849a818eed5b6c
2019-12-12 20:57:57 +02:00
shravanrn@gmail.com c32b58ae0e Bug 1566288 - Port libGraphite usage in libThebes to use the RLBox API. r=froydnj,jfkthame
Differential Revision: https://phabricator.services.mozilla.com/D39593

--HG--
extra : moz-landing-system : lando
2019-12-12 02:48:11 +00:00
Tom Ritter 9a59ac123c Bug 1590624 - Update the mingw-clang compiler to clang 9 r=dmajor
We can remove our backported objcopy patches, we'll need to update
llvm-mingw for toolchain fixes, and we need to add binutils to compile
this newer version of clang because the system binutils is too old.

Differential Revision: https://phabricator.services.mozilla.com/D50152

--HG--
rename : build/build-clang/clang-8-mingw.json => build/build-clang/clang-9-mingw.json
rename : taskcluster/scripts/misc/build-clang-8-mingw.sh => taskcluster/scripts/misc/build-clang-mingw.sh
extra : moz-landing-system : lando
2019-12-12 07:43:53 +00:00
Andreea Pavel a533b175dd Backed out 4 changesets (bug 1590624) for breaking gecko decision task on a CLOSED TREE
Backed out changeset 2ac8dd1d709d (bug 1590624)
Backed out changeset 8432398c212a (bug 1590624)
Backed out changeset 2b28154aacdb (bug 1590624)
Backed out changeset d305e4160ee4 (bug 1590624)

--HG--
rename : build/build-clang/clang-9-mingw.json => build/build-clang/clang-8-mingw.json
rename : taskcluster/scripts/misc/build-clang-mingw.sh => taskcluster/scripts/misc/build-clang-8-mingw.sh
2019-12-12 08:35:11 +02:00
Tom Ritter 7a2045b616 Bug 1590624 - Update the mingw-clang compiler to clang 9 r=dmajor
We can remove our backported objcopy patches, we'll need to update
llvm-mingw for toolchain fixes, and we need to add binutils to compile
this newer version of clang because the system binutils is too old.

Differential Revision: https://phabricator.services.mozilla.com/D50152

--HG--
rename : build/build-clang/clang-8-mingw.json => build/build-clang/clang-9-mingw.json
rename : taskcluster/scripts/misc/build-clang-8-mingw.sh => taskcluster/scripts/misc/build-clang-mingw.sh
extra : moz-landing-system : lando
2019-12-10 18:56:45 +00:00
Andrew Halberstadt 26e9db86f8 Bug 1583353 - [taskgraph] Implement test chunking in transforms r=gbrown
We've long handled chunks by defining the total number of chunks in our CI
configuration, and then passing that value down into the test harnesses at task
runtime (via the '--this-chunk' and '--total-chunks' parameters).  The test
harness then runs an algorithm to determine which tests should be run in "this"
chunk.

There are several problems with this approach, but by far the biggest is that
we can't use test information in our scheduling algorithms. The information
simply isn't available yet. This patch switches things around such that we
determine which tests go in which tasks during the taskgraph generation. This
means we have perfect information around which tasks are running which tests,
and if e.g a ccov or machine learning algorithm deems a particular test
important, we can make sure to *only* schedule the tasks that contain that
test.

I'm planning to enable this a couple suites at a time so we don't accidentally
stop running tests. This specifically only enables this mode for
'mochitest-media', 'mochitest-browser-chrome' and 'mochitest-devtools-chrome'.
I chose these suites because they are the ones that are already using the
'chunk_by_runtime' algorithm.

Differential Revision: https://phabricator.services.mozilla.com/D52729

--HG--
extra : moz-landing-system : lando
2019-12-11 21:10:48 +00:00
Māris Fogels 030fc0897c Bug 1590745 - Make the $PYTHON3 build var use a virtualenv r=mshal
Make the $PYTHON3 build var point to a full virtualenv bootstrapped with
the same libraries as the $PYTHON Python 2 build var. This allows us to
upgrade build tasks from $PYTHON to $PYTHON3.

This patch adds some debug logging and documentation to the Python
2 virtualenv so that it is easier to diagnose issues that may arise
from running two different Python interpreters in re-entrant
multiprocess routines.

Differential Revision: https://phabricator.services.mozilla.com/D50819

--HG--
extra : moz-landing-system : lando
2019-12-03 18:49:06 +00:00
David Major e057c099b7 Bug 1543853 - Add StyleBench to PGO training r=firefox-build-system-reviewers,rstewart
Now that we have Rust PGO, training on this set can actually make a difference (and in fact may be needed in order to see a difference from Rust PGO at all).

Differential Revision: https://phabricator.services.mozilla.com/D56751

--HG--
extra : moz-landing-system : lando
2019-12-11 15:37:01 +00:00
David Major 08274e0b6d Bug 1603141 - Remove unused option --enable-cross-pgo r=froydnj
Nothing looks at the value of this option. We seem to have settled on the `--enable-profile-{generate,use}=cross` approach instead.

Differential Revision: https://phabricator.services.mozilla.com/D56588

--HG--
extra : moz-landing-system : lando
2019-12-11 16:21:04 +00:00
Calixte Denizet f6c15104f5 Bug 1599436 - Backport LLVM patch to add a critical section in gcov_flush r=marco
In order to avoid crashes when we're dumping gcda files, we backport a llvm/compiler-rt patch which fix this issue in adding a critical section around flush.

Differential Revision: https://phabricator.services.mozilla.com/D56559

--HG--
extra : moz-landing-system : lando
2019-12-10 16:30:08 +00:00
David Major d74698c1f9 Bug 1602568 - Enable Rust PGO on linux32 and Windows r=firefox-build-system-reviewers,chmanchester
Differential Revision: https://phabricator.services.mozilla.com/D56584

--HG--
extra : moz-landing-system : lando
2019-12-10 19:48:04 +00:00