Граф коммитов

6435 Коммитов

Автор SHA1 Сообщение Дата
Ted Campbell 220c2b6e90 Bug 1666873 - Add missing self.metrics argument for local MOZ_PGO build_commands r=firefox-build-system-reviewers,mhentges
This argument was recently added to the normal build invocation below but was
missed in the MOZ_PGO branch.

Differential Revision: https://phabricator.services.mozilla.com/D91184
2020-09-23 18:08:03 +00:00
Gregory Mierzwinski 05a0d1e9b3 Bug 1665972 - Parse metrics correctly from test scripts. r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D90727
2020-09-23 15:00:19 +00:00
Tarek Ziadé 7e373ac7fd Bug 1666699 - Keep the hooks module state r=sparky
Some hooks modules use global variables to share state between hooks calls.
This patch makes sure we reuse the same module instance once it's loaded by a
Hook class.

Differential Revision: https://phabricator.services.mozilla.com/D91096
2020-09-23 17:10:19 +00:00
Botond Ballo 7fd68bc2ed Bug 1666370 - Use --log=info rather than --log=error for clangd. r=andi
Differential Revision: https://phabricator.services.mozilla.com/D90925
2020-09-23 10:15:32 +00:00
Harnaman Kaur b2d04eb931 Bug 1588185 - Show an error when an old/incorrect version of clang-format is used r=sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D86469
2020-09-23 17:02:50 +00:00
Mitchell Hentges ade8b6be08 Bug 1665232: Run "mach install-moz-phab" in bootstrap r=firefox-build-system-reviewers,rstewart
The supported way of submitting Firefox patches is via moz-phab, so
install it automatically in bootstrap rather than redirecting to docs.

Depends on D90455

Differential Revision: https://phabricator.services.mozilla.com/D90459
2020-09-22 21:06:12 +00:00
Andi-Bogdan Postelnicu d13f799bfc Bug 1666513 - Format with black the python code that generates the C++ database. r=sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D91010
2020-09-22 16:14:03 +00:00
Mitchell Hentges 0d9c3f79b6 Bug 1666585: bootstrap version parsing supports case insensitive fs r=firefox-build-system-reviewers,rstewart
Windows handles files in a case-insensitive way. So, when checking if a
file matches a certain extension, that check needs to be
case-insensitive as well.

Differential Revision: https://phabricator.services.mozilla.com/D91057
2020-09-22 20:27:32 +00:00
Tarek Ziadé c7cf4bad66 Bug 1665556 - make the try-platform option handle multiple platforms r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D90550
2020-09-22 15:59:15 +00:00
Mitchell Hentges 862d284885 Bug 1666032: ensure java from PATH == java from JDK_BIN_DIR r=rstewart
In the build process, there's two ways that java is used:
* From the path
* From the java-bin-path specified in the mozconfig

Before, to assert that both "java" usages would be consistent, the
implementation assumed that there was only a single "java" binary
per-JDK-version, and all duplicate "binaries" were symlinks to the
original.

However, in Fedora, it has two identical full binaries: one in
$JDK/bin, and one in $JDK/jre/bin. The symlink theory was incorrect.

So instead, we can assert that both "java" usages are consistent
by checking their versions and asserting that they are equivalent.

Differential Revision: https://phabricator.services.mozilla.com/D90918
2020-09-21 20:59:32 +00:00
Dorel Luca bc089edbb6 Backed out changeset fded12622108 (bug 1663837) as requested by dev. CLOSED TREE 2020-09-22 00:42:45 +03:00
Mitchell Hentges 16f13b00de Bug 1663837: ensure java from PATH == java from JDK_BIN_DIR r=firefox-build-system-reviewers,rstewart
In the build process, there's two ways that java is used:
* From the path
* From the java-bin-path specified in the mozconfig

Before, to assert that both "java" usages would be consistent, the
implementation assumed that there was only a single "java" binary
per-JDK-version, and all duplicate "binaries" were symlinks to the
original.

However, in Fedora, it has two identical full binaries: one in
$JDK/bin, and one in $JDK/jre/bin. The symlink theory was incorrect.

So instead, we can assert that both "java" usages are consistent
by checking their versions and asserting that they are equivalent.

Differential Revision: https://phabricator.services.mozilla.com/D90774
2020-09-21 17:22:15 +00:00
David Major efc436a4c8 Bug 1666004 - Use new-pass-manager flags for wasm-sandboxed code r=firefox-build-system-reviewers,rstewart
I randomly noticed in a log file that we don't apply the flags to wasm compilations. I don't have a super strong motivation for this, but eh, we might as well.

Differential Revision: https://phabricator.services.mozilla.com/D90741
2020-09-18 19:19:02 +00:00
Sylvestre Ledru dba81844c2 Bug 1666244 - Update of the wording + url at the end of the build r=mhoye
Differential Revision: https://phabricator.services.mozilla.com/D90855
2020-09-21 13:43:52 +00:00
Ricky Stewart a7be3f2b68 Bug 1665494 - In `mach python-test`, don't install requirements.txt in parallel r=ahal
If you set a `DEFAULT` `requirements` file in a Python test manifest, the current implementation of `python-test` will try (and usually fail) to install the file once for every test file in parallel. Instead, initializing the environment should be done once when the command starts up.

Differential Revision: https://phabricator.services.mozilla.com/D90475
2020-09-18 01:38:46 +00:00
Gregory Mierzwinski d0ec0cd96a Bug 1659072 - Add commit timestamps to Fenix batch-mode tests. r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D89642
2020-09-17 12:28:30 +00:00
Kris Maglione 387300d358 Bug 1662855: Remove defunct httpd.manifest file. r=mccr8,necko-reviewers,valentin
The manifest file hasn't actually done anything since XPT definitions were
moved to the libxul binary, and now just generates warnings in local builes.

Differential Revision: https://phabricator.services.mozilla.com/D89197
2020-09-17 03:15:11 +00:00
Dorel Luca d5b7a5666c Backed out changeset 0a4e7303358b (bug 1662855) for XPCshell failures in netwerk/test/httpserver/test/test_async_response_sending.js. CLOSED TREE 2020-09-17 03:31:11 +03:00
Ricky Stewart 58c8bb3559 Bug 1663367 - Use `mozfile.which` to locate Java binary r=mhentges
This avoids duplicating code to add the `.exe` suffix, which we weren't doing before.

Differential Revision: https://phabricator.services.mozilla.com/D89488
2020-09-16 21:44:31 +00:00
Kris Maglione fa5c3a435d Bug 1662855: Remove defunct httpd.manifest file. r=mccr8,necko-reviewers,valentin
The manifest file hasn't actually done anything since XPT definitions were
moved to the libxul binary, and now just generates warnings in local builes.

Differential Revision: https://phabricator.services.mozilla.com/D89197
2020-09-16 21:57:29 +00:00
Mike Hommey b297cc22e4 Bug 1664077 - Remove _NON_GLOBAL_ACDEFINES. r=firefox-build-system-reviewers,mhentges,rstewart
I think they're remnants from the past that we don't really need anymore.
And they're making things more complicated for some pending work of mine.

Differential Revision: https://phabricator.services.mozilla.com/D89687
2020-09-15 14:25:14 +00:00
Ricky Stewart f44b26911e Bug 1663748 - Use `mozfile.which` in `bootstrap` r=mhentges,glandium
We don't need the homebrewed implementation any longer after bug 1647792.

Differential Revision: https://phabricator.services.mozilla.com/D89487
2020-09-16 16:46:28 +00:00
Mitchell Hentges 648ccad85b Bug 1654074: Publish glean handle to mach commands r=firefox-build-system-reviewers,rstewart
Allows mach commands to define their own glean metrics with the `metrics_path` @CommandProvider parameter.
When `metrics_path` is defined:
* A `metrics` kwarg is provided to the decorated class. This `metrics` handle is a Glean instance, so Glean documentation should be consulted for usage information.
* When `mach doc telemetry` is run, metrics docs will be generated from all the registered metrics files.

Note: there was some consideration between making `metrics_path` a @CommandProvider or @Command parameter.
In the end, @CommandProvider seemed like a better fit because:
* Metrics seem to be more associated with the entire class than a specific command/method. This is because a class represents a "domain", and that domain may have different commands that have overlapping metrics.  Accordingly, all the metrics should be defined once as available to the entire class.
* Currently, @Command methods only take parameters that map one-to-one with CLI arguments. It could seem inconsistent to have one exception: the metrics handle

Differential Revision: https://phabricator.services.mozilla.com/D85953
2020-09-15 21:15:20 +00:00
Tarek Ziadé 5f7fe6ede4 Bug 1663937 - add options metadata r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D89922
2020-09-16 14:00:18 +00:00
Mitchell Hentges b1c1e629c0 Bug 1665164: remove unused get_command logic from CommandAction r=firefox-build-system-reviewers,rstewart
In the patch for bug 1656993, the case in which
get_command was being set was removed.
Accordingly, its usage in CommandAction will always be evaluated to
`False`, and it can be deleted.

Differential Revision: https://phabricator.services.mozilla.com/D90198
2020-09-15 18:56:03 +00:00
Mitchell Hentges 1a5995b622 Bug 1663837: bootstrap should store java path in mozconfig r=firefox-build-system-reviewers,rstewart
When multiple java versions are in use, some OSes have a mechanism to
change the "default"/system Java.
This can cause unexpected build failures if the system Java changes.
So, in bootstrap, if the Java version found is valid, then its path
should be encoded into mozconfig.

Differential Revision: https://phabricator.services.mozilla.com/D90163
2020-09-15 17:56:55 +00:00
Ricky Stewart b9f69c11b9 Bug 1663786 - Remove "copy" support from `virtualenv` handling r=ahal
This is unused.

Differential Revision: https://phabricator.services.mozilla.com/D89509
2020-09-10 12:54:49 +00:00
Ricky Stewart 4822d7dd4c Bug 1663755 - Remove `inherit-from-parent-environment` implementation r=ahal
This was originally meant to allow `virtualenv`s to use packages from a parent Python environment without having to re-install them. This turned out to not pan out as we would have liked, so we're going another way to solve the same problem. Bug 1660351 walked back a bunch of this logic; this patch deletes the rest of it.

Differential Revision: https://phabricator.services.mozilla.com/D89492
2020-09-11 22:14:41 +00:00
Razvan Maries f46af2adfc Backed out changeset ee6dbeaf8852 (bug 1664077) for build bustages on gfxFontUtils.h. CLOSED TREE 2020-09-15 04:02:01 +03:00
Mike Hommey 3fd47263f8 Bug 1664077 - Remove _NON_GLOBAL_ACDEFINES. r=firefox-build-system-reviewers,mhentges,rstewart
I think they're remnants from the past that we don't really need anymore.
And they're making things more complicated for some pending work of mine.

Differential Revision: https://phabricator.services.mozilla.com/D89687
2020-09-14 16:31:31 +00:00
Ricky Stewart 9ca5df0699 Bug 1664408 - Don't delete `~/.mozbuild/mozboot` directory after use in `bootstrap` r=mhentges,nalexander
The idea here was that we keep the NDK's downloaded in this directory as a "cache", such that if the download gets interrupted, then we can resume the download from an earlier point. This logic was walked back by bug 1637379, which deletes the cache.

In the spirit of the original version of the code, remove the `os.rmdir()` that was introduced by that bug.

An alternative fix for this is to download the NDK to a temporary directory and just clean that up entirely after every call to `mach bootstrap`, but then we would be forgoing the build cache behavior, which I'm not sure makes sense at this point in time.

Differential Revision: https://phabricator.services.mozilla.com/D90125
2020-09-14 21:16:49 +00:00
Ricky Stewart 821d955268 Bug 1664581 - Explicitly recommend putting `hg` in your `PATH` if `bootstrap` can't find it r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D90171
2020-09-14 21:18:27 +00:00
Tom Ritter 559727d2a0 Bug 1657952 - When ./mach vendor adds/removes files, also edit the moz.build files r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D86393
2020-09-14 18:44:49 +00:00
Alexis Beingessner e7aa36447a Bug 1647582 - add new version checks to mach vendor rust. r=njn
Differential Revision: https://phabricator.services.mozilla.com/D87337
2020-08-24 04:46:51 +00:00
Andi-Bogdan Postelnicu 286dbe9634 Bug 1664540 - when using `mach ide vscode` on MacOs also look in Applications folder. r=marco
VSCode doesn't install by default it's command line integration toolset on MacOS
 so w don't have a link to `/usr/local/bin/code` instead we must use the binary from the
 `Applications` folder.
 Also extens this to other platforms even though it's improbable that we are going to use it
 there.

Differential Revision: https://phabricator.services.mozilla.com/D90088
2020-09-14 12:30:02 +00:00
Mark Banner 02ae3b9de6 Bug 863474 - Centralise OpenSearch install failure prompts into SearchUIUtils. r=daleharvey,flod,geckoview-reviewers,esawin
Differential Revision: https://phabricator.services.mozilla.com/D89879
2020-09-14 11:08:43 +00:00
Gijs Kruitbosch b2dee52fd3 Bug 1663879 - migrate fullscreen and pointer lock warnings to fluent, r=jaws,fluent-reviewers,flod
Differential Revision: https://phabricator.services.mozilla.com/D89675
2020-09-12 20:09:26 +00:00
Razvan Maries e3020a8f57 Backed out 2 changesets (bug 863474) for build bustages on search.properties. CLOSED TREE
Backed out changeset 5f00eaaa4e2d (bug 863474)
Backed out changeset 42d66b1f9b82 (bug 863474)
2020-09-12 19:41:12 +03:00
Mark Banner d1abbfeaf8 Bug 863474 - Centralise OpenSearch install failure prompts into SearchUIUtils. r=daleharvey,flod
Differential Revision: https://phabricator.services.mozilla.com/D89879
2020-09-12 14:57:34 +00:00
Mitchell Hentges 82521cb272 Bug 1663838: Refresh pacman before installing Arch Linux deps r=firefox-build-system-reviewers,rstewart
In bootstrap, pacman should ensure its database is up-to-date.
Otherwise, when installing packages, pacman will slowly query every
mirror when attempting to download an out-of-date package.

Differential Revision: https://phabricator.services.mozilla.com/D89958
2020-09-11 19:20:51 +00:00
Tarek Ziadé 3021e5b216 Bug 1662706 - add a fuzzy runner r=sparky,necko-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D89123
2020-09-11 08:13:27 +00:00
Tarek Ziadé 9c8bb6e963 Bug 1663417 - make scriptinfo compatible with xpcshell tests r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D89372
2020-09-10 23:15:09 +00:00
Tarek Ziadé 0bf97a3ebc Bug 1661809 - use mach lint r=sparky
Removed our custom linter calls and use mach lint

Differential Revision: https://phabricator.services.mozilla.com/D89703
2020-09-10 23:15:07 +00:00
Narcis Beleuzu f837964009 Backed out 3 changesets (bug 1661809, bug 1662706, bug 1663417) for SM bustages. CLOSED TREE
Backed out changeset 96e69574f7ee (bug 1662706)
Backed out changeset a584b11a503a (bug 1663417)
Backed out changeset 655ce94f20f3 (bug 1661809)
2020-09-11 01:50:09 +03:00
Mitchell Hentges 565f11ba0a Bug 1651424: Report build telemetry using Glean r=firefox-build-system-reviewers,Dexter,rstewart
In addition to the existing build telemetry, also gather the stats and
report with Glean. This new telemetry is reported in tandem with the existing
telemetry to allow testing and confidence before a full roll-out.

Additionally, Glean isn't compatible with Python 2, so the new telemetry only runs
on Python 3 mach commands.

Differential Revision: https://phabricator.services.mozilla.com/D83572
2020-09-09 23:51:57 +00:00
Mihai Alexandru Michis b1839ed65d Merge mozilla-central to autoland a=merge on a CLOSED TREE 2020-09-10 18:15:20 +03:00
Mihai Alexandru Michis 8b42ade55d Merge autoland to mozilla-central. a=merge 2020-09-10 18:12:07 +03:00
Csoregi Natalia 7909e86bd0 Backed out 2 changesets (bug 1663755, bug 1663786) for causing bustages in Bug 1664106. a=backout
Backed out changeset 972df2adcffa (bug 1663786)
Backed out changeset f97f4ae8e721 (bug 1663755)
2020-09-10 15:50:24 +03:00
Mitchell Hentges 76523a630e Bug 1651424: Bump glean version to 32.3.1 r=firefox-build-system-reviewers,rstewart
32.3.0 was missing Python wheels for macOS.

Differential Revision: https://phabricator.services.mozilla.com/D89641
2020-09-09 22:28:16 +00:00
Tarek Ziadé 282632b3a0 Bug 1662706 - add a fuzzy runner r=sparky,necko-reviewers,rstewart DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D89123
2020-09-10 11:36:29 +00:00