Граф коммитов

7119 Коммитов

Автор SHA1 Сообщение Дата
Csoregi Natalia 39a0f07a9d Backed out changeset 4d19ea5594d2 (bug 1635548) for assertion failures on ErrorResult.h. CLOSED TREE 2021-08-23 22:26:31 +03:00
Niklas Baumgardner 78f3c52e0b Bug 1635548 - Migrated browser-context.inc to Fluent. r=emalysz,flod
Differential Revision: https://phabricator.services.mozilla.com/D123233
2021-08-23 18:46:11 +00:00
Erik Nordin 69ae00db76 Bug 1725502 - Create DTD migration for strings in main-popupset.inc.xhtml r=flod,fluent-reviewers
Creates a migration for browser.tfl to unify strings in browser.dtd and broser.properties
that are used in main-popupset.inc.xhtml

Differential Revision: https://phabricator.services.mozilla.com/D122538
2021-08-19 17:22:24 +00:00
Mike Hommey 909d7d6787 Bug 1726315 - Force `mach build` to be verbose on automation. r=firefox-build-system-reviewers,andi
Differential Revision: https://phabricator.services.mozilla.com/D122953
2021-08-18 22:01:32 +00:00
Mike Hommey 50c875f45c Bug 1725855 - Don't set PKG_CONFIG_* on macOS. r=firefox-build-system-reviewers,andi
The sysroot setup on macOS is different from Linux, and pkg-config
files, if there are, would be coming from e.g. homebrew rather than
the macOS SDK.

Differential Revision: https://phabricator.services.mozilla.com/D122793
2021-08-17 09:38:23 +00:00
Tom Ritter 616bff5b05 Bug 1712817: Do not add newly added header files to EXPORTS automatically r=jewilde
Differential Revision: https://phabricator.services.mozilla.com/D122238
2021-08-14 02:28:09 +00:00
Tom Ritter ba6db969f0 Bug 1712817: Add tests for mozbuild file editing r=jewilde
Depends on D120481

Differential Revision: https://phabricator.services.mozilla.com/D121379
2021-08-14 02:28:08 +00:00
Tom Ritter e603a5f57c Bug 1712817: Support adding header files to EXPORTS in mozbuild rewriting r=jewilde
Depends on D120480

Differential Revision: https://phabricator.services.mozilla.com/D120481
2021-08-14 02:28:08 +00:00
Tom Ritter efc5d64593 Bug 1721247: Lift some repeated code into a function r=jewilde
Depends on D120479

Differential Revision: https://phabricator.services.mozilla.com/D120480
2021-08-14 02:28:07 +00:00
Tom Ritter 2ef8731b6b Bug 1721247: Ensure that only failure to add/remove exceptions are swallowed r=jewilde
Depends on D120478

Differential Revision: https://phabricator.services.mozilla.com/D120479
2021-08-14 02:28:07 +00:00
Tom Ritter 97d1270362 Bug 1721247: Improve the mozbuild rewriting logic for different path types r=jewilde
libdav1d only has relative paths. Like ../../third_party/foo/bar.c
libjpeg-xl has absolute paths like /third_party/bar/foo.c

This handles the second case by not doing our relative path
correction logic if we don't need to.

It will find all of the types of ways a file is included in a
moz.build file* and iterate over them, trying the slightly
different logic.  This is okay, because the failure scenario
for trying an incorrect mode is just that we don't get a match.

By trying all the modes we can increase our chances of finding a
match.

* For SOURCES/UNIFIED_SOURCES there aren't actually any situations
where we have mixed-modes in a moz.build file. But a future patch
will add support for editing EXPORTS and they do have mixed-modes.

Depends on D120477

Differential Revision: https://phabricator.services.mozilla.com/D120478
2021-08-14 02:28:07 +00:00
Tom Ritter f96ded73c8 Bug 1721247: Improve/fix the local testing logic for mach vendor mozbuild rewriting r=jewilde
Differential Revision: https://phabricator.services.mozilla.com/D120477
2021-08-14 02:28:06 +00:00
Mitchell Hentges ecfc259f09 Bug 1723944: Install `perl-FindBin` on Fedora for android builds r=firefox-build-system-reviewers,glandium
I couldn't find a `perl-FindBin` package for CentOS Stream or Rocky
Linux, so I've only added the install for Fedora.

Differential Revision: https://phabricator.services.mozilla.com/D121883
2021-08-13 14:55:43 +00:00
Nick Alexander 7d7e4d990b Bug 1724885 - Fix broken icons; differentiate Beta. r=mhowell
When relanding Bug 1709697, all of the icons ended up as 0-byte files.
I can't explain this; it's hard to achieve this with a rebase.  We
regenerate `Resources.pri` following the instructions in the
documentation.

This commit also moves to represent the package as "Mozilla Firefox",
which is consistent with how unpackaged versions appear in the Windows
UI.  In the start menu, the application continues to be represented as
"Firefox" (no "Mozilla" vendor).

Finally, this commit also differentiates "Firefox Beta" from "Firefox"
in a few select places (while not changing branding and iconography).

Differential Revision: https://phabricator.services.mozilla.com/D122411
2021-08-12 16:18:32 +00:00
Molly Howell b8d1fa35e3 Bug 1724793 - Update casing of the toolbar overflow menu customize button. r=flod,fluent-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D122394
2021-08-12 16:00:26 +00:00
Mike Hommey a054bdd0de Bug 1723953 - Fix using the bootstrapped sysroot with GCC. r=firefox-build-system-reviewers,andi
While some custom builds of GCC work successfully, system GCC builds
usually don't, because of several factors:
- they don't use the C++ headers or libstdc++.so from the sysroot
- they don't necessarily know to use the multiarch directories in the
  sysroot

Differential Revision: https://phabricator.services.mozilla.com/D121946
2021-08-11 21:51:11 +00:00
Mike Hommey e5492f70e1 Bug 1723953 - pre: Add min/max to the python configure sandbox. r=firefox-build-system-reviewers,andi
Differential Revision: https://phabricator.services.mozilla.com/D121945
2021-08-11 21:51:11 +00:00
Marian-Vasile Laza 2585ca8b0d Bug 1724606 - Fix lint failure a=lint-fix CLOSED TREE 2021-08-11 11:21:50 +03:00
Mike Hommey a673ae0901 Bug 1724374 - Handle the macos SDK through the same code paths as sysroots. r=firefox-build-system-reviewers,andi
Differential Revision: https://phabricator.services.mozilla.com/D121944
2021-08-11 07:47:14 +00:00
Mike Hommey d784654760 Bug 1724374 - Use --sysroot on mac builds. r=firefox-build-system-reviewers,andi
We're currently using -isysroot as a preprocessor flag and
-Wl,--syslibroot/-Wl,--sysroot as a linker flag, but --sysroot is
generalization of both, so we can use that instead.

Differential Revision: https://phabricator.services.mozilla.com/D121943
2021-08-11 07:47:13 +00:00
Mike Hommey d873082139 Bug 1724606 - Replace uses of MACOSX_DEPLOYMENT_TARGET env variable with -mmacosx-version-min flag. r=firefox-build-system-reviewers,andi
They are equivalent, except for the fact that MACOSX_DEPLOYMENT_TARGET
may apply to more processes in a normal build. In practice, all the
processes that matter are covered through compiler flags.

On the opposite end, MACOSX_DEPLOYMENT_TARGET isn't necessary passed in
all cases (like clangd, mach static-analysis, etc.), while compiler
flags are.

Differential Revision: https://phabricator.services.mozilla.com/D122145
2021-08-11 07:40:57 +00:00
Butkovits Atila 1213e1bc84 Bug 1724830 - Lint fix. a=lint-fix 2021-08-11 01:01:12 +03:00
Mike Hommey e54462618c Bug 1724830 - Remove MOZ_LIBSTDCXX_*_VERSION. r=firefox-build-system-reviewers,andi
Differential Revision: https://phabricator.services.mozilla.com/D122197
2021-08-10 21:16:18 +00:00
Mike Hommey 139b1d25b2 Bug 1724830 - Don't link stdc++compat for wasm targets. r=firefox-build-system-reviewers,andi
In practice, that didn't do anything anyways because wasm libraries
don't look at linked libraries.

Differential Revision: https://phabricator.services.mozilla.com/D122196
2021-08-10 21:16:18 +00:00
Alex Lopez 58c955a470 Bug 1696251: Replace usages of self with command_context in mozbuild msix mach commands. r=mhentges
This is to keep up with changes happening in commands while still transitioning
to commands without classes.

Differential Revision: https://phabricator.services.mozilla.com/D122268
2021-08-10 18:19:39 +00:00
Nika Layzell 15880d1df1 Bug 1722832 - Streamline UX for `./mach ide vscode` with existing settings or in remote shells, r=andi
This patch has a few minor improvements to `./mach ide vscode` to make
it nicer to use in various situations. Specifically:

 * Tries to locate the `code` using `shutil.which` in addition to the
   existing methods so that the binary is found when being run from
   within a vscode remote shell.

 * If locating the code binary fails, only prompts to ask whether or not
   to continue, rather than requiring entering the complete path. The
   only use of the vscode command is to start an instance connected to the
   correct path, so if no binary was found, a message is logged instead.
   (bug 1699943)

 * When changes need to be made to the settings.json file, a full diff is
   shown between the old and new files, rather than just showing the
   computed state before and after.

 * If parsing the existing settings.json file fails (e.g. because there
   were c-style comments in it - see bug 1670997), the diff is shown and
   an additional warning is emitted to ask if the change should be made.

Differential Revision: https://phabricator.services.mozilla.com/D121157
2021-08-10 15:34:44 +00:00
Brindusan Cristian 10c5583558 Backed out 4 changesets (bug 1724372, bug 1724374) for causing macos non-unified build bustages in BlockingResourceBase.h.
CLOSED TREE

Backed out changeset a8d4d6248454 (bug 1724374)
Backed out changeset 030e725b4799 (bug 1724374)
Backed out changeset 9c32dfd8b694 (bug 1724374)
Backed out changeset d1096773021b (bug 1724372)
2021-08-07 05:49:03 +03:00
Alexandru Michis b81a777aee Bug 1724374 - Fix lint error in test_toolchain_configure.py a=lint-fix 2021-08-07 02:53:30 +03:00
Mike Hommey ab833087f4 Bug 1724374 - Handle the macos SDK through the same code paths as sysroots. r=firefox-build-system-reviewers,andi
Differential Revision: https://phabricator.services.mozilla.com/D121944
2021-08-06 23:31:50 +00:00
Nick Alexander 8299caa95c Bug 1724247 - Post: Make test publisher subject more than CN; use `universal_newlines=True`. r=firefox-build-system-reviewers,mhentges
This commit does three things:

1. It makes thes MSIX test publisher subject "CN=..., OU=...".  This
   is more like the actual Firefox signing certificates".

2. It moves to use `universal_newlines=True` rather than decoding manually.

3. It fixes an oversight where a particular Powershell invocation
   would fail when a certificate was missing.

Differential Revision: https://phabricator.services.mozilla.com/D121902
2021-08-05 18:42:19 +00:00
Nick Alexander b71169f3ce Bug 1724247 - Specify full publisher subject in MSIX repackages. r=bhearsum
Installing the Nightly MSIX packages, signed with Mozilla's Nightly
key, yields an error: "Error in parsing the app package."  Unpacking
with `makeappx.exe` yields:
```
MakeAppx : error: Error info: error 8007000B: The app manifest publisher name (CN=Mozilla Corporation) must match the subject name of the signing certificate (CN=Mozilla Corporation, OU=Firefox Engineering Operations, O=Mozilla Corporation, L=Mountain View, S=California, C=US).
```

Previously, we allowed just the `CN` to vary; in this patch we make
the publisher be the entire publisher subject, and we update the
publisher details in the task definitions.

Differential Revision: https://phabricator.services.mozilla.com/D121896
2021-08-05 17:21:50 +00:00
Mitchell Hentges 73710e3148 Bug 1717051: Move global mach dependencies to requirements definition r=ahal
After removing `optional` in Bug 1712804, we need to add a variant back
here because there's fallible dependencies. However, I've tweaked the
re-introduction of the feature to require a specific repercussion
message as well. This seemed like a decent tradeoff - the developer
becomes aware that the failure is bad, it has repercussions, but it's
not a blocking issue. Additionally, since we're printing pip's output,
the developer will be able to see the underlying error causing the
warning.

I also added comment functionality to requirements definitions to allow
adjacent documentation of why some requirements are fallible. (Related:
I'm looking forward to `mach_bootstrap` not needing to parse
requirements definitions. Almost there!)

Note that we'll temporarily lose the "pinned" nature of the
three moved dependencies until dependency locking is implemented
for Mach requirements definitions. Also note that the pinned
`zstandard_requirements.txt` can't be removed like the other
files because it still has a dangling usage.

Finally, in preparation for review: I didn't make
`PypiOptionalSpecifier` extend `PypiSpecifier` because I figured that
the benefit of flexibility (easier to allow implementations to diverge
without needing to untangle an inheritance relationship) was larger than
the cost of needing to add properties to both specifiers.
If we wanted re-use, I'd probably have `PypiOptionalSpecifier` _contain_
 a `PypiSpecifier`, but then you have to reach deeper into the object to
 get data, so *shrug*.

Differential Revision: https://phabricator.services.mozilla.com/D119835
2021-08-05 15:14:20 +00:00
Mitchell Hentges 258f0d081e Bug 1717051: Only use stdlib for installing pip packages r=ahal
`_install_pip_package()` may be run from `populate()`, which
is invoked from a child Python process that doesn't
have in-tree Python modules in its sys.path.

An alternate solution would be to add in-tree modules
to the sys.path, but that seemed more costly than
simply using `tempfile` and `shutil`.

Differential Revision: https://phabricator.services.mozilla.com/D119834
2021-08-05 15:14:19 +00:00
Mitchell Hentges 78fecb6128 Bug 1720215: Remove MACOSX_DEPLOYMENT_TARGET virtualenv workaround r=firefox-build-system-reviewers,andi
Now that the upstream Python bug has been resolved since Python 3.4 (at
the latest), we can safely remove the environment variable workaround.

Differential Revision: https://phabricator.services.mozilla.com/D119687
2021-08-05 15:14:18 +00:00
Mitchell Hentges 656826ef2f Bug 1717645: Fix up_to_date for Python 3.6 r=ahal
Python 3.6 doesn't support the `capture_output` option, so use
`stdout=subprocess.PIPE` instead.

Differential Revision: https://phabricator.services.mozilla.com/D120027
2021-08-05 15:14:18 +00:00
Mitchell Hentges d47142f492 Bug 1717645: Check virtualenv pths are up-to-date r=ahal
It's possible for a virtualenv to have an incorrect list of directories
to add to the sys.path, such as the following cases:
* Its creation got cancelled halfway through
* The list of pths changed in a new revision
* It got modified by an external tool

By validating the list of provided pths against the list of required
pths, we can ensure that the virtualenv is more dependably up-to-date.

Differential Revision: https://phabricator.services.mozilla.com/D119686
2021-08-05 15:14:17 +00:00
Mitchell Hentges 66978f234e Bug 1717645: Resolve nested virtualenv requirements up-front r=ahal
This simplifies consumer logic, since they get the parsed list of pypi
and pth requirements, as well as the list of input files that were
parsed.

One benefit of this simplification is that we no longer
recursively create VirtualenvManagers.

Note that mach_bootstrap cannot (yet) take advantage
of `ParseMachEnvRequirements` because of a dependency cycle:
* `mach_bootstrap` must set up the `sys.path` to import
  `ParseMachEnvRequirements`.
* `mach_bootstrap` would want `ParseMachEnvRequirements` to
  determine which paths to add to the `sys.path`.

Differential Revision: https://phabricator.services.mozilla.com/D119685
2021-08-05 15:14:17 +00:00
Nick Alexander be04781fb4 Bug 1709697 - Post: Make it easy to sign repackaged MSIX files. r=mhowell,firefox-build-system-reviewers,andi
This is strictly a convenience for local developer testing.  In
automation, we'll use the regular signing process via `autograph`,
etc.

Differential Revision: https://phabricator.services.mozilla.com/D116181
2021-08-05 02:58:15 +00:00
Nick Alexander 39a58b572b Bug 1709697 - Allow to repackage into MSIX. r=firefox-build-system-reviewers,mhowell,bhearsum,glandium
Differential Revision: https://phabricator.services.mozilla.com/D116180
2021-08-05 02:58:14 +00:00
Nick Alexander 0929d73f85 Bug 1709697 - Pre: Allow to extract string(s) from "application.ini" in a `Finder`. r=firefox-build-system-reviewers,glandium
This makes it possible to extract multiple strings from an
`application.ini` in a package presented as an archive.

Differential Revision: https://phabricator.services.mozilla.com/D121039
2021-08-05 02:58:14 +00:00
Narcis Beleuzu 00e6b46d6a Backed out 9 changesets (bug 1724030, bug 1721864, bug 1722980, bug 1712164, bug 1720190, bug 1712328, bug 1709697) for Windows repack bustages. CLOSED TREE
Backed out changeset bc7dff1c6f2c (bug 1724030)
Backed out changeset 9520d11c1ff4 (bug 1722980)
Backed out changeset 5d9ef490612f (bug 1712328)
Backed out changeset aaec04ed5ecb (bug 1720190)
Backed out changeset 3c5fbac7cc7f (bug 1721864)
Backed out changeset 3c1bccc04fb8 (bug 1709697)
Backed out changeset 6293b6ed5695 (bug 1709697)
Backed out changeset d824b2347ffd (bug 1709697)
Backed out changeset 888359c1dcc5 (bug 1712164)
2021-08-05 04:35:18 +03:00
Nick Alexander 8922b25708 Bug 1724030 - Fix `Rpk` tasks after Bug 1709697: "TypeError: expected str, bytes or os.PathLike object, not generator". r?#build CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D121755
2021-08-04 16:54:54 +00:00
Nick Alexander c25d449a4c Bug 1709697 - Post: Make it easy to sign repackaged MSIX files. r=mhowell,firefox-build-system-reviewers,andi
This is strictly a convenience for local developer testing.  In
automation, we'll use the regular signing process via `autograph`,
etc.

Differential Revision: https://phabricator.services.mozilla.com/D116181
2021-08-04 13:54:35 +00:00
Nick Alexander 2608f3e51f Bug 1709697 - Allow to repackage into MSIX. r=firefox-build-system-reviewers,mhowell,bhearsum,glandium
Differential Revision: https://phabricator.services.mozilla.com/D116180
2021-08-04 13:54:35 +00:00
Nick Alexander 2b087e223b Bug 1709697 - Pre: Allow to extract string(s) from "application.ini" in a `Finder`. r=firefox-build-system-reviewers,glandium
This makes it possible to extract multiple strings from an
`application.ini` in a package presented as an archive.

Differential Revision: https://phabricator.services.mozilla.com/D121039
2021-08-04 13:54:34 +00:00
Butkovits Atila 7e20695984 Backed out 7 changesets (bug 1712817, bug 1721247) for causing failures at test_rewrite_mozbuild.py. CLOSED TREE
Backed out changeset 182ae38519ef (bug 1712817)
Backed out changeset d4b681a741bd (bug 1712817)
Backed out changeset 752e9fe54b3f (bug 1712817)
Backed out changeset a4056a3ad63a (bug 1721247)
Backed out changeset 5e7de3069cff (bug 1721247)
Backed out changeset 1ab48a92618e (bug 1721247)
Backed out changeset c43f86bc26a5 (bug 1721247)
2021-08-03 19:32:41 +03:00
Iulian Moraru 73c233cfb8 Bug 1712817 - fix black lint failures. a=lint-fix CLOSED TREE 2021-08-03 19:04:35 +03:00
Tom Ritter 4650289452 Bug 1712817: Add tests for mozbuild file editing r=jewilde
Depends on D120481

Differential Revision: https://phabricator.services.mozilla.com/D121379
2021-08-03 15:39:23 +00:00
Tom Ritter 7bbda2bd2f Bug 1712817: Support adding header files to EXPORTS in mozbuild rewriting r=jewilde
Depends on D120480

Differential Revision: https://phabricator.services.mozilla.com/D120481
2021-08-03 15:39:23 +00:00
Tom Ritter d001ee560d Bug 1721247: Lift some repeated code into a function r=jewilde
Depends on D120479

Differential Revision: https://phabricator.services.mozilla.com/D120480
2021-08-03 15:39:23 +00:00