Граф коммитов

263 Коммитов

Автор SHA1 Сообщение Дата
Mitchell Hentges 725792bd05 Bug 1730712: Update "Moz site" terminology r=ahal
The existing terminology had two issues:
* `VirtualenvManager` wasn't always associated with an on-disk
  `virtualenv`: for example, when running in automation, Mach
  "activates" a `VirtualenvManager`, updating its import scope,
  but without ever creating an on-disk `virtualenv`.
* An upcoming patch splits the `VirtualenvManager` class, pulling
  "on-disk virtualenv-handling functions" from the project-wide
  interface for managing Python's import scope.

After some good discussion with Ahal, I think we've struck
the terminology that handles this distinction well: we'll call
the "import scope"-handling part the "site", and we'll continue
to call on-disk virtualenvs (and their representative classes)
as, well, virtualenvs.

Differential Revision: https://phabricator.services.mozilla.com/D130391
2021-11-17 20:54:23 +00:00
Greg Tatum 0f0b78cc1d Bug 1736907 - Add a build flag to experimentally build with ICU4X static data; r=platform-i18n-reviewers,dminor
Differential Revision: https://phabricator.services.mozilla.com/D129080
2021-11-16 15:09:09 +00:00
Marian-Vasile Laza 25a09c0d08 Backed out changeset 561c776bea20 (bug 1740042) for causing build bustages on llvm-readelf. 2021-11-16 02:51:16 +02:00
Mike Hommey 5459f879e5 Bug 1740042 - Use llvm-readelf instead of readelf when available. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D130949
2021-11-15 22:48:34 +00:00
Marian-Vasile Laza 51e3255d7c Backed out changeset bf55cb5e6b45 (bug 1740042) for causing build bustages. CLOSED TREE 2021-11-15 22:54:31 +02:00
Mike Hommey 2c9074abb8 Bug 1740042 - Use llvm-readelf instead of readelf when available. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D130949
2021-11-15 20:41:41 +00:00
Emilio Cobos Álvarez 270e255624 Bug 1738947 - Fix path to virtualenv.py. r=mhentges
It was moved in bug 1732948.

Differential Revision: https://phabricator.services.mozilla.com/D130195
2021-11-02 17:19:45 +00:00
Mike Hommey feecbbaa4f Bug 1731223 - Move wine detection to toolkit/moz.configure. r=firefox-build-system-reviewers,andi
As of now, wine is used with:
- fxc, which is detected in toolkit/moz.configure
- midl, which is detected in toolkit/moz.configure
- ml64 or armasm64, for some assembly sources that aren't used in
  projects that don't include toolkit/moz.configure.

We can thus move it there.

Differential Revision: https://phabricator.services.mozilla.com/D126166
2021-09-22 23:54:26 +00:00
Cristian Tuns afde9ef4f4 Backed out 2 changesets (bug 1731223) for likely causing localized Windows builds to break (bug 1732034) a=backout
Backed out changeset 0aa04e588a4e (bug 1731223)
Backed out changeset 59a15d9c5391 (bug 1731223)
2021-09-22 08:44:17 -04:00
Mike Hommey f2aef849b5 Bug 1731223 - Move wine detection to toolkit/moz.configure. r=firefox-build-system-reviewers,andi
As of now, wine is used with:
- fxc, which is detected in toolkit/moz.configure
- midl, which is detected in toolkit/moz.configure
- ml64 or armasm64, for some assembly sources that aren't used in
  projects that don't include toolkit/moz.configure.

We can thus move it there.

As of bug 1731195, there is no remaining use of wine for artifact
builds, so we also make it limited to builds with a compile environment.

Differential Revision: https://phabricator.services.mozilla.com/D126166
2021-09-21 20:51:24 +00:00
Noemi Erli 4e7f6a6a7e Backed out changeset e61e701731df (bug 1731223) for causing toolchains bustages 2021-09-18 02:03:28 +03:00
Mike Hommey 576ad5a0c7 Bug 1731223 - Wine is not optional on Windows cross-builds. r=firefox-build-system-reviewers,andi
Differential Revision: https://phabricator.services.mozilla.com/D125938
2021-09-17 21:34:46 +00:00
Mike Hommey e2e6bfc01f Bug 1731195 - Remove the wine-wrapping for makensis. r=firefox-build-system-reviewers,andi
Now that we have a bootstrappable linux-native makensis, we don't need
the wine-wrapping anymore.

Differential Revision: https://phabricator.services.mozilla.com/D125927
2021-09-17 09:11:22 +00:00
Mike Hommey 193d84c955 Bug 1731168 - Only look for non-versioned nsis. r=firefox-build-system-reviewers,mhentges
Now that we bootstrap it, we don't need to look for old versioned
versions from mozilla-build. While here stop looking for makensis when
not building for Windows.

Differential Revision: https://phabricator.services.mozilla.com/D125906
2021-09-17 01:19:05 +00:00
Mike Hommey 7e693067b8 Bug 1730825 - Bootstrap nsis for Windows builds. r=firefox-build-system-reviewers,andi
And at the same time, make the toolchain artifact directly usable on
cross-compiles.

Differential Revision: https://phabricator.services.mozilla.com/D125635
2021-09-15 08:33:04 +00:00
Mitchell Hentges c1f770eddb Bug 1727561: Tweak an exception's log level r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D123777
2021-08-31 15:38:40 +00:00
Mitchell Hentges fe7e7e5b9b Bug 1727561: Log exception in `bootstrap_toolchain_tasks()` r=firefox-build-system-reviewers,nalexander
This will ensure that recoverable failures in task-definition work won't
be hidden.

Differential Revision: https://phabricator.services.mozilla.com/D123638
2021-08-25 16:11:02 +00:00
Andi-Bogdan Postelnicu 0ac52aa9d7 Bug 1725125 - Make a hybrid build system combining non-unified with unified. CLOSED TREE
By hybrid unified system we understand a system that encapsulates modules that are built in the unified mode
but also other modules, like `dom/Animation`, as an example, in the non unified environment.

This approach is desirable since we already have most of the modules transitioned to the non unified system but there are
still some that are not yet compatible, but in the long term this will be done by each module owner and can be also tested
locally using the build system.

If a module can't be built outside the unified method it's `moz.build` config file needs to have `REQUIRES_UNIFIED_BUILD = False`

To also enable this we need to have a flag from `mozconfig`, like:

```
ac_add_options --disable-unified-build
```

Differential Revision: https://phabricator.services.mozilla.com/D122328
2021-08-25 11:21:42 +00:00
Narcis Beleuzu 50dd0540cd Backed out changeset 29d7e91fe721 (bug 1725125) for plain Bp-hybrid bustages 2021-08-25 14:42:09 +03:00
Andi-Bogdan Postelnicu 4b8a4fc95a Bug 1725125 - Make a hybrid build system combining non-unified with unified r=firefox-build-system-reviewers,mhentges,glandium
By hybrid unified system we understand a system that encapsulates modules that are built in the unified mode
but also other modules, like `dom/Animation`, as an example, in the non unified environment.

This approach is desirable since we already have most of the modules transitioned to the non unified system but there are
still some that are not yet compatible, but in the long term this will be done by each module owner and can be also tested
locally using the build system.

If a module can't be built outside the unified method it's `moz.build` config file needs to have `REQUIRES_UNIFIED_BUILD = False`

To also enable this we need to have a flag from `mozconfig`, like:

```
ac_add_options --disable-unified-build
```

Differential Revision: https://phabricator.services.mozilla.com/D122328
2021-08-25 10:46:18 +00:00
Mike Hommey b5fdfe98af Bug 1725855 - Don't default to system-zlib on macOS. r=firefox-build-system-reviewers,andi
pkg-config is not available by default on macOS, and we might as well
avoid configure defaults that may require it.

Differential Revision: https://phabricator.services.mozilla.com/D122794
2021-08-17 09:38:24 +00:00
Mike Hommey 170547001c Bug 1725092 - Change how --enable/disable-gtest-in-build is handled. r=firefox-build-system-reviewers,andi
So that --enable-gtest-in-build works in local builds.

Differential Revision: https://phabricator.services.mozilla.com/D122312
2021-08-11 05:45:06 +00:00
Mike Hommey dda1875bdd Bug 1721514 - Add a few more debugging logs about configure bootstrap. r=firefox-build-system-reviewers,andi
Differential Revision: https://phabricator.services.mozilla.com/D120416
2021-07-21 21:00:13 +00:00
Mike Hommey 5ac51ef77d Bug 1720806 - Avoid multiple calls to toolchain_task_definitions during configure. r=firefox-build-system-reviewers,mhentges
Bug 1692137 added code that would end up calling
toolchain_task_definitions twice, once for each of host and target.
With the recent changes from bug 1719229, that is not useful anymore.
We also don't need the toolchain prefixes for toolchains on unsupported
hosts (which were useful before bug 1719229 for the target sysroots).

Differential Revision: https://phabricator.services.mozilla.com/D120044
2021-07-16 20:59:35 +00:00
Mike Hommey 162f9b6800 Bug 1719229 - Rename the bootstrappable sysroot toolchains. r=firefox-build-system-reviewers,andi
In cross-compilation setups (x86_64 host, i686 or aarch64 target), we're
going to need two sysroots. Obviously, we need the sysroot paths to be
different in that case, so the sysroot path themselves need to contain
some distinctive name, and we'll use the `target.toolchain` name for
that (the target triplet with the vendor/machine stripped out).

Because the path name needs to be reflected in the artifact name as well
as the toolchain name, we also change them.

And because the current prefix in the toolchain name is now redundant
with the suffix, we remove the prefix, and allow the bootstrapping
mechanism to try toolchains without the prefix.

Differential Revision: https://phabricator.services.mozilla.com/D119846
2021-07-14 08:54:43 +00:00
Mike Hommey 8da6bc9f03 Bug 1719229 - Don't replace _ with - in toolchain names to bootstrap. r=firefox-build-system-reviewers,andi
This was originally done to avoid renaming the dump_syms toolchain, but
is going to cause problems for the next change.

Differential Revision: https://phabricator.services.mozilla.com/D119845
2021-07-14 08:54:42 +00:00
Mike Hommey 841e1d8a06 Bug 1717585 - Switch --enable-bootstrap on by default on central. r=firefox-build-system-reviewers,mhentges
As there are some things to solve first for the sysroot, we don't enable
the sysroot bootstrap unless --enable-bootstrap is given explicitly. The
default will still bootstrap everything else when building on central.

Differential Revision: https://phabricator.services.mozilla.com/D118450
2021-06-22 23:36:28 +00:00
Mike Hommey 9540e9a37c Bug 1716912 - Switch --enable-bootstrap on by default on Windows builds on central r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D118108
2021-06-22 02:16:47 +00:00
Emilio Cobos Álvarez 2a2dd88339 Bug 1717248 - Remove non-existing file from moz.configure. r=firefox-build-system-reviewers,nalexander
This fixes it for me. I believe this is right because the file it was inlined
into in D117711 is also on this list.

Differential Revision: https://phabricator.services.mozilla.com/D118277
2021-06-18 23:05:28 +00:00
Mike Hommey 83c4b6a318 Bug 1716911 - Switch --enable-bootstrap on by default on macos builds on central. r=firefox-build-system-reviewers,nalexander
Differential Revision: https://phabricator.services.mozilla.com/D118107
2021-06-17 04:59:42 +00:00
Butkovits Atila 4a58ea14fe Backed out changeset 5e287042c278 (bug 1716911) for causing failures at test_toolchain_configure.py. CLOSED TREE 2021-06-17 07:47:07 +03:00
Mike Hommey e6564e5935 Bug 1716911 - Switch --enable-bootstrap on by default on macos builds on central. r=firefox-build-system-reviewers,nalexander
Differential Revision: https://phabricator.services.mozilla.com/D118107
2021-06-17 03:45:56 +00:00
Nick Alexander 03b1e6ddba Bug 1714397 - Apply `mach lint --fix` to `/moz.configure`. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D116741
2021-06-03 18:04:23 +00:00
Mike Hommey c2908b2bf8 Bug 1712350 - Use the mozmake toolchain for CI Windows builds. r=firefox-build-system-reviewers,mhentges
As well as local builds with --enable-bootstrap.

Differential Revision: https://phabricator.services.mozilla.com/D116065
2021-05-27 22:27:25 +00:00
Mitchell Hentges fc799c0fab Bug 1706774: Add tools to VisualStudio backend exclusions r=firefox-build-system-reviewers,nalexander
"memory" and "tools/update-programs" do not require
the VisualStudio backend.

Differential Revision: https://phabricator.services.mozilla.com/D114651
2021-05-18 15:00:39 +00:00
Mike Hommey 8189f56cd9 Bug 1599574 - Avoid re-running clang-plugin tests. r=firefox-build-system-reviewers,andi,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D114320
2021-05-05 21:21:11 +00:00
Mike Hommey 6736f91ada Bug 1704580 - Move various rust-related configure items to rust.configure. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D112157
2021-04-20 00:33:58 +00:00
Mike Hommey b1f45b497d Bug 1697098 - Default to --enable-bootstrap for arm64 mac builds. r=firefox-build-system-reviewers,andi,sheehan,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D107601
2021-03-09 21:27:52 +00:00
Mike Hommey 1afcdbc6aa Bug 1693725 - Make --enable-bootstrap install missing toolchains. r=firefox-build-system-reviewers,andi,sheehan,mhentges
This means --enable-bootstrap now is the same as what
--enable-bootstrap=install currently does. --enable-bootstrap=install is at the
same time desupported.
We also remove --enable-bootstrap=update, which is not worth supporting.

Differential Revision: https://phabricator.services.mozilla.com/D105719
2021-02-24 02:13:10 +00:00
Mike Hommey 34ada26a0e Bug 1693723 - Avoid bootstrapping when an explicit path is given for tools. r=firefox-build-system-reviewers,mhentges
This changes things such that setting e.g. NASM=/usr/bin/nasm will avoid
bootstrapping nasm even when bootstrapping is enabled.

This is not applied to CC/CXX/HOST_CC/HOST_CXX because things are more
complicated.

This also simplifies how check_prog is called for a bootstrapped tool,
and avoids the repetition of when.

CBINDGEN handling needs the pattern being applied manually because it
currently doesn't use check_prog. Once --enable-bootstrap=install
becomes the default on developer builds, it will be possible to simplify
this.

Differential Revision: https://phabricator.services.mozilla.com/D105718
2021-02-24 02:01:33 +00:00
Mike Hommey dfb8c396a6 Bug 1693723 - Pass bootstrap path in one piece to bootstrap_{,search_}path. r=firefox-build-system-reviewers,andi,mhentges
It will make upcoming changes simpler.

Differential Revision: https://phabricator.services.mozilla.com/D105717
2021-02-24 02:01:32 +00:00
Mike Hommey c4ae566143 Bug 1692416 - Allow --enable-bootstrap=install to look for aarch64 mac artifacts. r=firefox-build-system-reviewers,andi,dmajor
There aren't any currently, but it's coming in the following commits.

Differential Revision: https://phabricator.services.mozilla.com/D104975
2021-02-12 22:28:01 +00:00
Mike Hommey 5f86b697af Bug 1692137 - Allow local linux builds to use a bootstrapped sysroot. r=firefox-build-system-reviewers,andi,mhentges
Bug 1690930 added sysroots that can be bootstrapped. With this change,
we allow --enable-bootstrap=install to pull the right sysroot for the
configured target, and --enable-bootstrap to update it if it was already
there.

Differential Revision: https://phabricator.services.mozilla.com/D104797
2021-02-12 20:31:49 +00:00
Mike Hommey 571f8f5c17 Bug 1690712 - Allow --enable-bootstrap in all configurations. r=firefox-build-system-reviewers,mhentges
And make it prioritize the bootstrap directory over system paths.

Differential Revision: https://phabricator.services.mozilla.com/D103981
2021-02-09 22:01:25 +00:00
Mike Hommey 4da42ddfb5 Bug 1690454 - Allow configure --enable-bootstrap to optionally install instead of updating. r=firefox-build-system-reviewers,mhentges
We still default to updates only, though, because all the details of
only installing what's needed are not ironed out yet.

Differential Revision: https://phabricator.services.mozilla.com/D103865
2021-02-03 21:27:04 +00:00
Mike Hommey 21d7cbaac5 Bug 1687421 - Avoid error with --enable-bootstrap on platforms with no bootstrap artifacts. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D102259
2021-01-19 14:10:16 +00:00
Cosmin Sabou f6ebc1a8b7 Bug 1553230 - Fix mbu failures on configure/lint.py. r=glandium 2021-01-17 00:29:26 +02:00
Mike Hommey 66a79a59fe Bug 1553230 - Allow to opt-in to automatically update some bootstrapped toolchains. r=firefox-build-system-reviewers,nalexander,mhentges
This adds a --enable-bootstrap build flag that will automatically update
cbindgen, node, clang, sccache, nasm, wine, lucetc, dump_syms, pdbstr,
and winchecksec if they are already installed in ~/.mozbuild.

Eventually, we'll want to allow to install toolchains that weren't
already install, but one step at a time.

This explicitly doesn't cover rustc, which is its own can of worms, or
android-{ndk,sdk}, which are not installed via toolchain artifacts
currently.

Differential Revision: https://phabricator.services.mozilla.com/D101723
2021-01-15 22:15:51 +00:00
Mike Hommey 4ed35480e2 Bug 1686646 - Look for more tools in MOZ_FETCHES_DIR. r=firefox-build-system-reviewers,dmajor
This will allow to find them on automation without setting anything in
mozconfigs.

Differential Revision: https://phabricator.services.mozilla.com/D101720
2021-01-15 04:33:01 +00:00
Mike Hommey 758c53a631 Bug 1686646 - Automatically find tools in MOZ_FETCHES_DIR. r=firefox-build-system-reviewers,dmajor
When MOZ_FETCHES_DIR is set, use that instead of ~/.mozbuild. This will
allow to find them on automation without explicit mozconfig help.

Differential Revision: https://phabricator.services.mozilla.com/D101719
2021-01-15 04:33:00 +00:00