Граф коммитов

7189 Коммитов

Автор SHA1 Сообщение Дата
Mitchell Hentges 09c7c7c9dc Bug 1720591: Remove unused patch_main() for Python < 3.4 on Windows r=ahal
Now that we use Python 3.6+, this code is obsolete.

Differential Revision: https://phabricator.services.mozilla.com/D119929
2021-07-16 16:34:42 +00:00
Alex Lopez 190e03aaab Bug 1696251 - Replace self with command_context where possible in existing mach commands. r=mhentges,webdriver-reviewers,perftest-reviewers,whimboo
This step removes all the dependencies of mach commands to
having a MachCommandBase as the `self` by using the `command_context`
argument instead. This also removes any remaining statefulness from those
classes that implement mach commands, ultimately making it easier to move
existing commands out of classes in a follow-up.

Differential Revision: https://phabricator.services.mozilla.com/D118058
2021-07-16 15:51:29 +00:00
Mike Hommey 43e5bb336f Bug 1720822 - Don't install lucetc during mach bootstrap. r=firefox-build-system-reviewers,andi
At the moment, lucetc is not useful by default, only when enabling wasm
sandboxed libraries manually, and in that case, configure knows to
bootstrap lucetc itself. Furthermore, lucetc is set to be replaced with
wasm2c, which is in-tree and doesn't require bootstrapping at all.

Differential Revision: https://phabricator.services.mozilla.com/D120051
2021-07-16 08:36:26 +00:00
Sandor Molnar c40ce62c3c Backed out 10 changesets (bug 1718341) for causing wrench bustages. CLOSED TREE
Backed out changeset e5bd150a58b2 (bug 1718341)
Backed out changeset e82e752b8f44 (bug 1718341)
Backed out changeset d9462c727c8f (bug 1718341)
Backed out changeset 2bd647754780 (bug 1718341)
Backed out changeset 31dfce45985f (bug 1718341)
Backed out changeset 03266cea345d (bug 1718341)
Backed out changeset 3920b27acecb (bug 1718341)
Backed out changeset 2b17603c5e65 (bug 1718341)
Backed out changeset ebc0d5d4f537 (bug 1718341)
Backed out changeset 1c8844157b8d (bug 1718341)
2021-07-16 03:40:56 +03:00
Agi Sferro ea13a76521 Bug 1718341 - Download Android AVD from TL job artifact. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D119542
2021-07-15 23:22:18 +00:00
Agi Sferro 3c257f8ca5 Bug 1718341 - Update Android cmdtools to 4.0. r=nalexander,glandium
The SDK Tools version we're currently using is deprecated and was last released
in 2017. It's time for an upgrade!

Differential Revision: https://phabricator.services.mozilla.com/D119226
2021-07-15 23:22:17 +00:00
Agi Sferro 36dcc7ce37 Bug 1718341 - Remove redundant override in MobileAndroidBootstrapper. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D119998
2021-07-15 23:22:17 +00:00
Agi Sferro 9ee3064894 Bug 1718341 - Prewarm AVD before packaging r=nalexander
The very first time an Android AVD starts it runs some one time jobs to
properly set up the AVD.

To avoid running the setup every time we run tests in automation, we can boot
the AVD before packaging it so that the testing jobs can use a "prewarmed" AVD
instead.

Differential Revision: https://phabricator.services.mozilla.com/D119225
2021-07-15 23:22:17 +00:00
Agi Sferro 164fc2191d Bug 1718341 - Generate Android AVD in TL job instead of using tooltool r=aklotz,nalexander
Tooltool images are hard to update because we don't provide a script to
generate the image and documentation is often inaccurate.

This patch makes it so we generate the AVD in the android-sdk TL job instead.

Differential Revision: https://phabricator.services.mozilla.com/D119221
2021-07-15 23:22:15 +00:00
Cosmin Sabou 3cd7630738 Backed out changeset 2c1257a95130 (bug 1720591) for causing build bustages complaining about patch_main. CLOSED TREE 2021-07-16 02:49:45 +03:00
Mitchell Hentges b5d3b00394 Bug 1720591: Remove unused patch_main() for Python < 3.4 on Windows r=ahal
Now that we use Python 3.6+, this code is obsolete.

Differential Revision: https://phabricator.services.mozilla.com/D119929
2021-07-15 21:44:37 +00:00
surajeet310 ec79e93bd5 Bug 1717651 - Removed instances of 'ensure_subprocess_env' from python/mozversioncontrol r=mhentges
Since Python 2 is no longer used in python/mozversioncontrol, hence 'ensure_subprocess_env' is obsolete.

Differential Revision: https://phabricator.services.mozilla.com/D119905
2021-07-15 21:34:08 +00:00
amy churchwell 0c7d4a9357 Bug 1719727 - Change "Personalize" on New Tab to gear icon. r=prathiksha,fluent-reviewers,Gijs,thecount
Differential Revision: https://phabricator.services.mozilla.com/D119657
2021-07-15 19:36:50 +00:00
Anuj Gautam 557acb4135 Bug 1720761: Added kali to the list of debian configurations. r=mhentges
Differential Revision: https://phabricator.services.mozilla.com/D120003
2021-07-15 19:06:10 +00:00
Mike Hommey 77f0b36028 Bug 1720595 - Don't install dump_syms during mach bootstrap. r=firefox-build-system-reviewers,nalexander
Bug 1719229 broke the install by accident, but configure takes care of
it by default since bug 1716911, bug 1716912 or bug 1717585 depending on
the platform, so we can just stop installing it from mach bootstrap.

Differential Revision: https://phabricator.services.mozilla.com/D119933
2021-07-15 04:47:10 +00:00
surajeet310 1903d302ab Bug 1717651 - Removed instances of 'ensure_subprocess_env' from python/mozperftest r=mhentges
Since Python 2 is no longer used in python/mozperftest, hence 'ensure_subprocess_env' is obsolete.

Differential Revision: https://phabricator.services.mozilla.com/D119898
2021-07-14 16:33:46 +00:00
surajeet310 88365fbe52 Bug 1717651 - Removed instances of 'ensure_subprocess_env' from python/mozbuild r=mhentges
Since Python 2 is no longer used in python/mozbuild, hence 'ensure_subprocess_env' is obsolete.

Differential Revision: https://phabricator.services.mozilla.com/D119791
2021-07-14 15:17:27 +00:00
Mike Hommey 487119e349 Bug 1719229 - Allow the build system to use a sysroot for the host part of the build. r=firefox-build-system-reviewers,andi
Differential Revision: https://phabricator.services.mozilla.com/D119847
2021-07-14 08:54:43 +00:00
Jonathan Kew 0132f4c4df Bug 1720308 - Support VSCode installed as a snap package on Linux. r=firefox-build-system-reviewers,nalexander
Differential Revision: https://phabricator.services.mozilla.com/D119769
2021-07-13 15:04:06 +00:00
Kimberly Sereduck 210d1cc333 Bug 1705420: Report the version of the application being tested in our perfherder data r=perftest-reviewers,sparky
implementing get_browser_meta for mozperftest

Differential Revision: https://phabricator.services.mozilla.com/D113861
2021-07-13 12:13:38 +00:00
surajeet310 f2e1419d77 Bug 1717651 - Removed instances of 'ensure_subprocess_env' from python/mach r=mhentges
Since Python 2 is no longer used in python/mach, hence 'ensure_subprocess_env' is obsolete .

Differential Revision: https://phabricator.services.mozilla.com/D119185
2021-07-12 21:38:13 +00:00
Mitchell Hentges 1256637095 Bug 1720113: Temporarily add "python" to default clobber set r=firefox-build-system-reviewers,nalexander
Until virtualenvs are more dependably consistent, we should purge them
by default when "./mach clobber" is run.

Differential Revision: https://phabricator.services.mozilla.com/D119651
2021-07-12 16:43:09 +00:00
Florin Strugariu 2b3375937c Bug 1715478 - Automated recording for desktop with a list sites r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D117298
2021-07-09 07:12:27 +00:00
june wilde 7db7c6efaf Bug 1716398 - support tracking tagged releases in mach vendor; r=tjr
Differential Revision: https://phabricator.services.mozilla.com/D118422
2021-07-08 18:20:04 +00:00
Mitchell Hentges f20cdb0c12 Bug 1712804: Check if `comm` directory is empty in TB identification r=ahal
Some developers hold onto a `comm` directory as a mount point
that they conditionally populate depending on whether they're working on
Firefox or Thunderbird.
The "`comm` directory exists == is a thunderbird checkout"
assumption isn't compatible with this workflow.

The fix embraced by this patch is to check if the `comm` directory has
any contents.

Differential Revision: https://phabricator.services.mozilla.com/D119193
2021-07-06 18:33:58 +00:00
Emilio Cobos Álvarez 780f3a05d2 Bug 1719144 - Fix various imports for Python 3.10. r=firefox-build-system-reviewers,mhentges
These are enough for me to run bootstrap+configure+build.

Some touch third-party code (gyp), but per discussion in the earlier
versions of this revision that seems fine.

Differential Revision: https://phabricator.services.mozilla.com/D119080
2021-07-06 15:26:29 +00:00
Mike Hommey 544436ed03 Bug 1718156 - Avoid some configure tests creating the common virtualenv. r=firefox-build-system-reviewers,mhentges,andi
When running `mach python-test` on a clobbered tree, we create both the
python-test and common virtualenvs, but the former should be enough. The
latter is only created when running tests that use the BaseConfigureTest
class, when it indirectly includes init.configure, which makes the
configure sandbox run the virtualenv_python3 function, which ends up
initializing the common virtualenv. We only don't end up re-executing
that virtualenv python thanks to 6680ca0acc27 which was a workaround
that would allow any virtualenv in $objdir/_virtualenvs, while still
creating a virtualenv it won't use.

Tests now tell virtualenv_python3 to not use the normal virtualenv
manager, and remove the workaround.

Differential Revision: https://phabricator.services.mozilla.com/D118775
2021-07-05 22:33:56 +00:00
Mitchell Hentges c25aec1f74 Bug 1717104: Update "pth" docs for virtualenvs r=ahal
The "pth" action no longer has a customizable filename, and the docs
should be updated accordingly.

Depends on D118609

Differential Revision: https://phabricator.services.mozilla.com/D118610
2021-07-05 22:10:35 +00:00
Mitchell Hentges 86ae5fbc84 Bug 1717104: Remove obsolete "set-variable" notes from virtualenv docs r=ahal
Since https://phabricator.services.mozilla.com/D115921, "set-variable"
is no longer a valid action. Looks like that patch forgot to remove the
associated docs

Differential Revision: https://phabricator.services.mozilla.com/D118609
2021-07-05 22:10:35 +00:00
surajeet310 498013ddc6 Bug 1717651 - Removed instances of 'ensure_subprocess_env()' from virtualenv.py r=mhentges
Since Python 2 is no longer used in virtualenv.py ,hence 'ensure_subprocess_env()' is obsolete.

Differential Revision: https://phabricator.services.mozilla.com/D118883
2021-07-05 19:59:53 +00:00
Sandor Molnar fe63cb08df Backed out 2 changesets (bug 1719144) for causing build bustages. CLOSED TREE
Backed out changeset 8e4b00b9d57c (bug 1719144)
Backed out changeset d2a88c5423a0 (bug 1719144)
2021-07-05 21:15:50 +03:00
Emilio Cobos Álvarez 52a85aaca1 Bug 1719144 - Fix various imports for Python 3.10. r=firefox-build-system-reviewers,mhentges
These are enough for me to run bootstrap+configure+build.

Some touch third-party code (gyp), but per discussion in the earlier
versions of this revision that seems fine.

Differential Revision: https://phabricator.services.mozilla.com/D119080
2021-07-05 17:55:41 +00:00
Mitchell Hentges 9ee9a69ade Bug 1717905: M1 Macs don't support Android targets r=glandium
Also filter out bootstrapping for Android targets.

Differential Revision: https://phabricator.services.mozilla.com/D118727
2021-07-05 17:44:20 +00:00
Mitchell Hentges 733d1bb939 Bug 1717905: Fix M1 Mac bootstrap choice offset r=glandium
When we customized the list of possible `applications` for M1 Macs, the
change was only applying to the displayed list, but not the actual
list that the choice was indexed against.

This is fixed by properly using `applications` instead of
`APPLICATIONS` where relevant.

Note that it's still possible to manually request an
`artifact_mode` if you provide it as an argument for `./mach bootstrap`,
but this workflow is usually only done by devs who are familiar with all
the applications, and therefore likely know what they're doing.

Differential Revision: https://phabricator.services.mozilla.com/D118625
2021-07-05 17:44:19 +00:00
june wilde 68adbeeae5 Bug 1703066 - add tracking key to mozyaml file schema; r=tjr
Differential Revision: https://phabricator.services.mozilla.com/D110829
2021-06-29 14:01:58 +00:00
Mike Hommey 81228f00cd Bug 1717947 - Remove packager support for brotli in Jars. r=firefox-build-system-reviewers,nalexander
This was added ing bug 1352595. It has only been used briefly, and we
since then have gone all the way to never compress omni.ja. Even if we
did go back to compressing, we'd probably go with zstd rather than
brotli.
The gecko-side support for this has only ever been nightly-only.

Differential Revision: https://phabricator.services.mozilla.com/D118655
2021-06-25 00:20:10 +00:00
Mitchell Hentges b7dde05a8d Bug 1717786: Update mozperfest runner's list of in-tree Python packages r=kimberlythegeek
After replacing a bunch of vendored source packages with wheels, the
paths to the raw source changed.

Differential Revision: https://phabricator.services.mozilla.com/D118723
2021-06-24 18:02:53 +00:00
Mitchell Hentges 43949e4a1c Bug 1717702: Resolve `print-checks` python unpacking typo r=andi
`_get_infer_config()` returns 3 items, but the existing code expects 2.
Add a third `_` to capture the other unwanted item.

Differential Revision: https://phabricator.services.mozilla.com/D118535
2021-06-24 13:21:57 +00:00
Alexander J. Vincent b12c2e5817 Bug 1717650 - Support RockyLinux 8.4. r=mhentges
Differential Revision: https://phabricator.services.mozilla.com/D118539
2021-06-22 20:34:13 +00:00
Alexander J. Vincent 2c7ff94a69 Bug 1717650 - Drop requirement for wireless-tools-devel package. r=mhentges
wireless-tools-devel isn't available on Rocky Linux. Fortunately, it doesn't appear to be needed for the build anymore, and it was added almost a decade ago, so it should be safe to remove.

Differential Revision: https://phabricator.services.mozilla.com/D118532
2021-06-22 20:34:13 +00:00
Tarik Eshaq 453be8c6fd Bug 1716450 - Removes fxa-client rust code from Desktop. r=rfkelly
Differential Revision: https://phabricator.services.mozilla.com/D118238
2021-06-22 17:04:35 +00:00
Marian-Vasile Laza 4728ef73b2 Bug 1700534 - black lint fix r=fix CLOSED TREE 2021-06-22 09:22:33 +03:00
Mike Hommey 744db845c6 Bug 1700534 - Coalesce RLBox wasmboxed libraries. r=firefox-build-system-reviewers,shravanrn,bholley,andi,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D116440
2021-06-22 05:31:33 +00:00
Mitchell Hentges ee5a948268 Bug 1716600: Don't use node/npm that are too old or have no version r=firefox-build-system-reviewers,nalexander
In the existing behaviour, we would return a node/npm executable from
`find_executable()`, even if we couldn't extract a version from it or if
the extracted version was insufficient.

Now, we fail early if the detected node/npm is insufficient.

Differential Revision: https://phabricator.services.mozilla.com/D118377
2021-06-21 16:47:56 +00:00
Mitchell Hentges 00d96c3fed Bug 1716600: Remove looping from Node's find_executable() r=firefox-build-system-reviewers,nalexander
Since we're no longer checking for both "nodejs" and "node",
`find_executable()` can be simplified.

Differential Revision: https://phabricator.services.mozilla.com/D118376
2021-06-21 16:47:55 +00:00
Mitchell Hentges 73814a7f0f Bug 1716600: Always search for "node" instead of "nodejs" r=firefox-build-system-reviewers,nalexander
As :julienw beautifully described on Bugzilla,
we no longer need to search for "nodejs" since all
packages providing Node >= v12 will provide the `node`
binary.
See his comment here:
https://bugzilla.mozilla.org/show_bug.cgi?id=1716600#c4

Base-toolchain tasks with Node v10 should still be
happy because, unlike Debian's Node v10, they provide
a `node` binary instead of `nodejs`.

Differential Revision: https://phabricator.services.mozilla.com/D118375
2021-06-21 16:47:55 +00:00
Aki Sasaki 5b64d5df25 Bug 1659691 - Update cross-channel algorithm to not replay history. r=firefox-build-system-reviewers,releng-reviewers,bhearsum,mhentges
(Tl;dr: The original author of this patch was axel@mozilla.com (:pike).
This patch has been modified to run in production automation.)

Cross-channel takes all the en-US strings from the shipping train branches
and consolidates them into a single repository. Originally, this ran out of
https://hg.mozilla.org/users/axel_mozilla.com/cross-channel-experimental/ .
The original version was coupled tightly with specific hg internals, making
hg upgrades fragile. Axel wrote
https://bug1659691.bmoattachments.org/attachment.cgi?id=9170636 before
handing off project ownership; this is the original patch to stop replaying
history to simplify the logic.

This patch also automates the previously manual preparation steps, allows
for running both in automation and locally, and adds retries for production
robustness.

Differential Revision: https://phabricator.services.mozilla.com/D116537
2021-06-17 18:52:58 +00:00
Mitchell Hentges 2438ea8889 Bug 1712133: Validate that pypi dependencies are installed r=ahal
Check that all expected pypi packages are installed
when checking if a virtualenv is up-to-date.

Differential Revision: https://phabricator.services.mozilla.com/D117712
2021-06-17 14:58:17 +00:00
Mitchell Hentges 2fa59acd4f Bug 1712133: Adds "pypi" action to virtualenv `handle_package()` r=ahal
The `pypi` action uses `pip` to fetch a package and its dependencies

Differential Revision: https://phabricator.services.mozilla.com/D115925
2021-06-17 14:58:17 +00:00
Mitchell Hentges 24f634d924 Bug 1712133: Remove "pth" name customization r=ahal
Having separate `<name>.pth` files in the virtual environments
isn't providing an advantage. We can simplify configuration
by putting all `pth` adjustments into a single file: `mach.pth`.

Differential Revision: https://phabricator.services.mozilla.com/D117710
2021-06-17 14:58:16 +00:00
Mitchell Hentges 31474e8925 Bug 1712133: Make virtualenv package parsing more specific r=ahal
This has two benefits:
1. `handle_package()` becomes more clear - rather than referring to
   `action` and `package` with array index numbers, we now give
   them real names. The benefit here is also shown in `up_to_date()`.
2. This makes the top-level parser for `packages()` less opinionated
   about sub-formats: if an action has a nested structure, it should
   have the flexibility to define what it looks like.

Differential Revision: https://phabricator.services.mozilla.com/D117708
2021-06-17 14:58:16 +00:00
Mitchell Hentges 722ac646db Bug 1713857: Don't set PYTHONEXECUTABLE environment variable r=glandium
After some testing in `try` and locally, the manual
`PYTHONEXECUTABLE` definitions shouldn't be needed
anymore.

There's been some work on Brew's
Python to improve its `sitecustomize` behaviour.
The most likely improvement is:
https://github.com/Homebrew/homebrew-core/pull/65297

However, I'm not fully confident in this change.
If it fails, it's more likely to affect developers
than CI. I think it's worth attempting a landing,
because if the variable is indeed obsolete, then
deleting it will avoid some spicy "action-at-a-
distance" behaviour.

Differential Revision: https://phabricator.services.mozilla.com/D117452
2021-06-17 13:28:29 +00:00
Marian-Vasile Laza 19f23a7e8b Bug 1716911 - black lint fix r=fix CLOSED TREE 2021-06-17 09:39:54 +03:00
Mike Hommey 83c4b6a318 Bug 1716911 - Switch --enable-bootstrap on by default on macos builds on central. r=firefox-build-system-reviewers,nalexander
Differential Revision: https://phabricator.services.mozilla.com/D118107
2021-06-17 04:59:42 +00:00
Mitchell Hentges 6d154c1ed3 Bug 1713377: Change vendoring to use wheels where possible r=ahal,glandium
Vendoring wheels has three benefits:
* There's far less files, so Firefox checkouts will be smaller.
* It works around `zipp` not allowing `pip install`
  from extracted source `tar.gz` files. Now, we should
  be able to use the pip resolver against vendored
  packages, which will be needed for future
  mach virtualenv work.
* `./mach vendor python` takes far less time to execute.

Since we need the raw Python to be available to add to the `sys.path`,
we extract the wheels before putting them in tree.
Due to the structure of some wheels being less nested
than of a source `tar.gz`, `common_virtualenv_packages`
needed to be adjusted accordingly.

`install_pip_package()` had to be tweaked as well since you can't
`pip install` an extracted wheel. So, we "re-bundle" the wheel
before installing from a vendored package.

Replace python packages with wheels where possible

This contains the vendoring changes caused by the
last patch.

For reviewing, there's a couple things to note:
* A bunch of files are deleted, since there's generally
  less files in a wheel than in a source archive.
* There's a new `.dist-info` directory for each
  extracted wheel, so expect roughly 5 or
  6 new files for each wheel'd package.
* There should be no source code changes other than
  moves from package names changing from having
  `-` to having `_`.

Differential Revision: https://phabricator.services.mozilla.com/D116512
2021-06-16 15:53:16 +00:00
Mitchell Hentges c335e37407 Bug 1690870: Remove "artifact mode" from bootstrap options on M1 Macs r=firefox-build-system-reviewers,andi
As pointed out by Harry, this will help in the short-term with
onboarding new developers who will be using M1 macs.

Note that this patch doesn't leverage the "instance" classes to define
whether they're artifact-mode compatible or not, and that's because:
* Most (all except one?) of the systems support artifact mode, therefore
* Since this is a temporary workaround, it's more deletable to have
  a top-level `if/else` than to add a `supports_artifact_mode` property
  to each Bootstrapper.

Differential Revision: https://phabricator.services.mozilla.com/D117946
2021-06-16 14:31:07 +00:00
surajeet310 c3511254e0 Bug 1714688 - Removed 'if PY2'/'if PY3' logic from python/mozbuild r=mhentges
Python2 is no longer used in Mozbuild.

Differential Revision: https://phabricator.services.mozilla.com/D117561
2021-06-15 19:31:21 +00:00
Gregory Mierzwinski a5873d50c0 Bug 1716378 - Use correct test modules path in xpcshell layer. r=perftest-reviewers,kimberlythegeek
Differential Revision: https://phabricator.services.mozilla.com/D117690
2021-06-15 17:01:58 +00:00
Mitchell Hentges 9f7c330b60 Bug 1712133: Remove "windows" action support from virtualenvs r=ahal
Last year, we stopped vendoring Python packages that have native
code. Since we have only had pure-python packages since, the
Windows-specific qualifier (or excluder in the case of `!windows`)
hasn't been needed.

I don't foresee us needing it again, but if anything we can peel it
back from `hg` history if this assumption is incorrect.

Differential Revision: https://phabricator.services.mozilla.com/D117468
2021-06-15 14:46:55 +00:00
Mitchell Hentges 1b74e5a575 Bug 1713201: Resolve test_telemetry failing locally r=ahal
On Windows, Python's temporary directories are placed in `%APPDATA%`.
Unfortunately, the failing tests want to assume that some "other"
path (as a subpath of a tempdir) won't be within any
`filter_args()` known top-level paths, which includes the user's home
dir.

The only reason that this assumption has passed in CI so far is due
to Windows case insensitivity: running locally had `~` evaluated
to `c:\Users\...`, while running in CI had it be `c:\users\...`.
Since the tempdir path started with `C:\Users`, `filter_args()`
would `<path omitted>` in CI but would `$HOME/...` locally.

By not basing the `other_path` on `tempdir`, we now consistently get the
same results across platforms.

Differential Revision: https://phabricator.services.mozilla.com/D117698
2021-06-15 14:45:53 +00:00
Alexandru Michis 542a65a629 Bug 1715282 - Fix black py lint in test_toolchain_configure.py a=lint-fix
CLOSED TREE
2021-06-15 18:04:43 +03:00
Mike Hommey 7f9a51a8f5 Bug 1715282 - Bump minimum Rust version to 1.51. r=firefox-build-system-reviewers,andi
Also update the estimated rust versions for future releases, based on
the updated Firefox release dates.

Differential Revision: https://phabricator.services.mozilla.com/D117737
2021-06-15 09:23:20 +00:00
Iulian Moraru 952b525e6f Backed out changeset 55a7556ae185 (bug 1715282) for causing base-toolchain bustages and python failures on test_toolchain_configure.py. CLOSED TREE 2021-06-15 10:46:39 +03:00
Jeff Muizelaar e5c5ce020a Bug 1715282 - Bump minimum Rust version to 1.50. r=glandium
Various people want 1.50 and it's been out for a while so let's require it.

Differential Revision: https://phabricator.services.mozilla.com/D117158
2021-06-15 05:46:02 +00:00
surajeet310 ec19bcfbf2 Bug 1714688 - Removed 'if PY2' logic from python/mozrelease r=mhentges
Python2 is no longer used in Mozrelease

Differential Revision: https://phabricator.services.mozilla.com/D117583
2021-06-14 20:41:31 +00:00
Csoregi Natalia 6b0106d5b1 Backed out changeset 15c6a16f5828 (bug 1714688) for docker images bustage. CLOSED TREE 2021-06-14 20:51:29 +03:00
Csoregi Natalia 5136d2de85 Bug 1714684 - Fix linting. r=fix CLOSED TREE 2021-06-14 20:47:59 +03:00
surajeet310 0ac7b98b51 Bug 1714688 - Removed 'if PY2'/'if PY3' logic from python/mozbuild r=mhentges
Python2 is no longer used in Mozbuild.

Differential Revision: https://phabricator.services.mozilla.com/D117561
2021-06-14 16:10:11 +00:00
Mitchell Hentges b685c830d4 Bug 1714684: Resolve `assert_has_calls()` usage error r=ahal
The `calls` parameter is expected to be an iterable
container of calls, not a singular call.

This was working in `mock-1.0.0` because `calls`
was (confusingly) allowed to be a single item
if `any_order==False`. This behaviour isn't
the same in the standard library.

Differential Revision: https://phabricator.services.mozilla.com/D117074
2021-06-14 15:34:47 +00:00
Mitchell Hentges e389cc4cc4 Bug 1714684: Remove usages of vendored "mock" library r=perftest-reviewers,ahal,sparky
Python 3 has access to `unittest.mock` in the standard library.

Differential Revision: https://phabricator.services.mozilla.com/D117073
2021-06-14 15:34:46 +00:00
Butkovits Atila ce6e97604b Backed out changeset 7648560f810d (bug 1715282) for causing build bustages. CLOSED TREE 2021-06-11 22:47:34 +03:00
Jeff Muizelaar 5ca0d5fb13 Bug 1715282 - Bump minimum Rust version to 1.50. r=glandium
Various people want 1.50 and it's been out for a while so let's require it.

Differential Revision: https://phabricator.services.mozilla.com/D117158
2021-06-11 19:27:22 +00:00
surajeet310 6ea83c8ef9 Bug 1714788 - Fixed more Sphinx warnings in 'mach doc' r=sylvestre DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D117419
2021-06-10 19:33:53 +00:00
Mitchell Hentges dc2fa7819c Bug 1713610: Require PyPI-vendored packages be added to requirements.in r=ahal
`./mach vendor python <package>` was already adding its new package
to `requirements.txt`, so we were getting full resolver support, which
is good. However, it caused our `requirements.in` file to start
getting out-of-date, and therefore made it harder to identify the
top-level dependencies.

Arguably, we could have `./mach vendor python <package>` automatically
update `requirements.in`, too, but then we need to solve the edge cases,
such as "What if the package is already in `requirements.in`? What if
that existing item has a different version?"

The hardest part of updating `requirements.in` was finding it, so I've
also modified the `./mach vendor python` help text to make it more
identifiable.

Differential Revision: https://phabricator.services.mozilla.com/D116386
2021-06-10 19:19:06 +00:00
Nick Alexander bef7042147 Bug 1524662 - Add --enable-path-remapping producing compiled objects with generic paths. r=glandium
For "c" (i.e., gcc, clang, and clang-cl), this configures the
`-f{debug,macro}-path-prefix` flags.  We'd prefer to use
`-ffile-path-prefix`, but it seems that `clang-cl` does not recognize
that flag.

For "rust" (i.e., rustc/cargo), this configures `--remap-path-prefix`.

This is one step toward getting `sccache` hits across source and
object directories.

Differential Revision: https://phabricator.services.mozilla.com/D113065
2021-06-10 17:08:06 +00:00
Mike Conley f6ae5b2c2e Bug 1682022 - Convert to Fluent and / or fork the remainder of the AppMenu strings for sentence casing. r=flod,fluent-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D117067
2021-06-09 18:01:24 +00:00
Butkovits Atila b140242f9d Backed out 3 changesets (bug 1682022) for causing failures on browser_sync.js. CLOSED TREE
Backed out changeset 9ec189804055 (bug 1682022)
Backed out changeset 3a93fa0ba8ce (bug 1682022)
Backed out changeset 2fca4f56df6f (bug 1682022)
2021-06-09 19:54:44 +03:00
Mitchell Hentges b9531f2856 Bug 1714641: Remove usages of vendored "pathlib2" library r=ahal
Based on the docs and the code within `pathlib2`, it seems to focus
only on backporting the main features of `pathlib` to be available for
Python 2. It does _not_ provide features in newer Python versions
of `pathlib` (such as `is_mount`, new in Python 3.7). Therefore, it
doesn't provide anything that the standard library of Python 3.6+
doesn't have.

Differential Revision: https://phabricator.services.mozilla.com/D117071
2021-06-09 15:48:55 +00:00
Mitchell Hentges 70806e17b5 Bug 1714641: Remove usages of vendored "wptserve_py2" library r=jgraham,ahal
We should only be using the Python3 "wptserve" library at this point.

Differential Revision: https://phabricator.services.mozilla.com/D117062
2021-06-09 15:48:51 +00:00
Mitchell Hentges eca9f5e421 Bug 1714641: Remove `pythonX` actions from virtualenv config r=ahal
The actions are no longer used, so we can delete the associated
logic.

Differential Revision: https://phabricator.services.mozilla.com/D117060
2021-06-09 15:48:51 +00:00
Paul Adenot 36dc6db808 Bug 1714577 - Part 1 - Include the Gecko Profiler include directory in WebRTC.org files. r=ng
Differential Revision: https://phabricator.services.mozilla.com/D116838
2021-06-09 15:43:37 +00:00
Mike Conley e00cda2b95 Bug 1682022 - Convert to Fluent and / or fork the remainder of the AppMenu strings for sentence casing. r=flod,fluent-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D117067
2021-06-09 13:37:12 +00:00
Emilio Cobos Álvarez 2c99123249 Bug 1715493 - Update callers of should_replace_task to pass a missing deadline argument. r=ahal a=bustage-fix
Differential Revision: https://phabricator.services.mozilla.com/D117280
2021-06-09 10:58:31 +00:00
Greg Tatum 1a7c5a8df1 Bug 1714099 - Locally enable the console layer by default in perftest; r=sparky
This will only turn it on locally, but not when run in CI.

Differential Revision: https://phabricator.services.mozilla.com/D116655
2021-06-08 20:27:15 +00:00
Greg Tatum e2b8e6c87b Bug 1713384 - Raise an exception when no perftest results are found; r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D116654
2021-06-08 20:27:15 +00:00
Florin Strugariu 39b334597c Bug 1702659 - Update mozperftest proxy service r=sparky,perftest-reviewers
Make mozperftest work with the new mozproxy command line
Add ability to run proxy on mobile browser
Add ability to use record and playback modes
Add unit tests

Differential Revision: https://phabricator.services.mozilla.com/D115544
2021-06-08 18:00:12 +00:00
Andrey Bienkowski 888618300d Bug 1714376 - Replace a number of "exception.message" usages. r=mhentges,jgraham
Differential Revision: https://phabricator.services.mozilla.com/D116723
2021-06-08 15:50:10 +00:00
Connor Sheehan 632d552e70 Bug 1702017: add a mach doctor check for `invalid locale: UTF-8` r=mhentges
Adds a `mach doctor` check to assert Python's locale is not set to
`UTF-8`, an invalid value due to a Python bug in most pre-3.8 versions.

Differential Revision: https://phabricator.services.mozilla.com/D117081
2021-06-08 15:24:00 +00:00
Connor Sheehan ff302e46aa Bug 1713988: add a check for ssh access to `hg.mozilla.org` to mach doctor r=mhentges
Adds a check that SSH access to hg.mozilla.org is properly configured.
Attempt to run `ssh hg.mozilla.org` which will authorize to hgmo over
SSH via `pash`, without running any commands on the service. In the case
the user has properly configured SSH we will see a success message and
information on the SCM levels granted to the user. If we don't see
a successful connection, parse the output to ensure the user is using
an email address as their username (which is required on hg.mozilla.org).
If the user couldn't connect yet does have an email address as their
username, notify them that they do not have permission to push to hgmo.

Differential Revision: https://phabricator.services.mozilla.com/D117080
2021-06-08 15:23:59 +00:00
Connor Sheehan dc08a2c897 Bug 1713988: add a check that `mozilla.org` is reachable over https r=mhentges
Adds a simple check that a Mozilla domain is reachable over HTTPS.

Differential Revision: https://phabricator.services.mozilla.com/D117079
2021-06-08 15:04:06 +00:00
Connor Sheehan 9f03fdf3e4 Bug 1713988: add a `mach doctor` check for a DNS query r=mhentges
Adds a simple DNS query to `mozilla.org` as a doctor check.
We use `socket.getaddrinfo` to resolve the hostname to IP.

Differential Revision: https://phabricator.services.mozilla.com/D117078
2021-06-08 15:04:06 +00:00
Steve Fink 084cf95676 Bug 1714680 - Implement `mach gtest --list-tests` r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D116904
2021-06-07 20:55:05 +00:00
Mitchell Hentges f548bc89cc Bug 1713818: Require Python 3.6+ to run Mach r=ahal
This will both:
* Ensure that developers aren't accidentally using Mach with Python 2
  in the year 2021.
* Confirm that CI tasks aren't still using Python 2 with Mach.
* Remove support for Python 3.5, which is EOL'd.

Differential Revision: https://phabricator.services.mozilla.com/D116484
2021-06-07 19:46:17 +00:00
Mitchell Hentges c2d548efc9 Bug 1712819: Remove redundant pip warning suppression r=ahal
Now that we configure pip within mach virtualenvs to turn off
its "outdated" warning, we no longer need to apply the suppression
as a CLI argument.

Differential Revision: https://phabricator.services.mozilla.com/D116891
2021-06-07 14:46:09 +00:00
Agi Sferro 65b64cb3e0 Bug 1709640 - Rename android-api-16 to android-arm. r=marionette-reviewers,firefox-build-system-reviewers,nalexander,whimboo,aklotz,releng-reviewers,mhentges,glandium,mtabara
We don't offer API splits any more, and with the separation of GeckoView with
the rest of the front-end it's increasingly unlikely that we will in the
future.

This change makes it so that the build name doesn't contain the API version so
that we can update it without breaking all the automation that relies on the
build name.

Differential Revision: https://phabricator.services.mozilla.com/D114369
2021-06-04 22:31:14 +00:00
Scott 38ea934bb8 Bug 1691762 - Save to Pocket button panels to fluent r=gvn,flod,fluent-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D113133
2021-06-04 22:00:53 +00:00
Sandor Molnar 2a126fe036 Backed out changeset 453cb34e4a4a (bug 1709640) for causing linting failures in perfdocs/config. CLOSED TREE 2021-06-05 01:00:19 +03:00
Agi Sferro ecf4f5f0ad Bug 1709640 - Rename android-api-16 to android-arm. r=marionette-reviewers,firefox-build-system-reviewers,nalexander,whimboo,aklotz,releng-reviewers,mhentges,glandium,mtabara
We don't offer API splits any more, and with the separation of GeckoView with
the rest of the front-end it's increasingly unlikely that we will in the
future.

This change makes it so that the build name doesn't contain the API version so
that we can update it without breaking all the automation that relies on the
build name.

Differential Revision: https://phabricator.services.mozilla.com/D114369
2021-06-04 21:20:56 +00:00
Mitchell Hentges 6ac951e5aa Bug 1713613: Assert unmodified PyPI-vendored packages r=ahal
Adds test to ensure that we don't modify files that are vendored
with PyPI.

If a modification needs to happen to a vendored library, we should
instead:
* Modify the library upstream and vendor the new version, or
* Remove the library from requirements.in and requirements.txt so that
  it's now a "manually-vendored" library. Note that there many be
  issues if this occurs to a library depended on by 3rd-party
  libraries.

Differential Revision: https://phabricator.services.mozilla.com/D116428
2021-06-04 21:19:35 +00:00
Mitchell Hentges b8c530e2f1 Bug 1713613: Require Python 3.6 to update vendored packages r=ahal
Generating Python lockfiles is system-dependent, and this currently
mostly affects us just on the Python 3.6 <=> 3.7 boundary - 3.6 requires
a few additional packages like `importlib_metadata` and `iso8601`.

If a different Python version is used, the test in CI is guaranteed to
fail. By validating in advance, we help future vendoring developers
by helping them avoid the wait before CI failure and the time it
takes to troubleshoot.

Differential Revision: https://phabricator.services.mozilla.com/D116773
2021-06-04 21:19:35 +00:00
Sandor Molnar 2207fdd99a Backed out changeset 6591aff2047f (bug 1691762) for causing mochitest failures in browser_pocket_AboutPocketParent. CLOSED TREE 2021-06-04 21:02:59 +03:00
Scott 07e7f25565 Bug 1691762 - Save to Pocket button panels to fluent r=gvn,flod,fluent-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D113133
2021-06-04 15:15:20 +00:00
Dorel Luca f021feb29f Backed out changeset 68f73772f51e (bug 1714376) for Xpcom failures in builds/worker/checkouts/gecko/xpcom/idl-parser/xpidl/runtests.py. CLOSED TREE 2021-06-04 02:19:33 +03:00
Connor Sheehan 34cac10551 Bug 1713988: rewrite `mach doctor` to be function based, simplify some things r=mhentges
Rewrite `doctor.py` from an object-oriented paradigm to a simpler
function-based architecture. Each check is a function that returns
or yields `DoctorCheck`s. `DoctorCheck`s contain a status that describes
the status of the check (success, warning, fatal error etc), a string
of text with useful information for display to the terminal, and may
optionally attach a callable which can be executed to fix issues found
by the checks.

`mach doctor` is updated to use the new `run_doctor` function instead
of creating a `Doctor` object. The default value of `verbose` in `run_doctor`
is `False`, meaning only issues with the users system are printed to the
screen.

Most of the existing check logic is left intact from the previous
implementation. Checks for `platform` are changed to use the
`sys.platform.startswith` pattern. The latest MozillaBuild version is
pulled by querying the `tip` commit on hg.mozilla.org instead of using
a hard-coded variable.

Differential Revision: https://phabricator.services.mozilla.com/D116539
2021-06-03 22:11:10 +00:00
Mike Hommey d6e973ee86 Bug 1714244 - Use HEAD instead of master by default for `mach vendor yaml` r=releng-reviewers,bhearsum
HEAD is a symbolic ref that points to the default branch of the
repository, it will point to master, main, or anything else that the
repository is using as its default branch.

Differential Revision: https://phabricator.services.mozilla.com/D116678
2021-06-03 20:45:05 +00:00
Andrey Bienkowski a7a4542e20 Bug 1714376 - Replace a number of "exception.message" usages. r=mhentges,jgraham
Differential Revision: https://phabricator.services.mozilla.com/D116723
2021-06-03 20:08:51 +00:00
Dorel Luca be3cb0088b Backed out 3 changesets (bug 1713818, bug 1714116, bug 1714118) for XPCshell in toolkit/modules/subprocess/test/xpcshell/test_subprocess.js. CLOSED TREE
Backed out changeset be4847abe491 (bug 1713818)
Backed out changeset 3e7ff2f21cbf (bug 1714118)
Backed out changeset da6994a236c9 (bug 1714116)
2021-06-03 22:07:56 +03:00
Mitchell Hentges 75f1a25537 Bug 1713818: Require Python 3.6+ to run Mach r=ahal
This will both:
* Ensure that developers aren't accidentally using Mach with Python 2
  in the year 2021.
* Confirm that CI tasks aren't still using Python 2 with Mach.
* Remove support for Python 3.5, which is EOL'd.

Differential Revision: https://phabricator.services.mozilla.com/D116484
2021-06-03 15:54:28 +00:00
Nick Alexander cba669901b Bug 1713173 - Add `--profile-command` flag for profiling `mach` commands. r=firefox-build-system-reviewers,mhentges
I chose to do this at the level of the outer Python invocation because:

1. `python -m cProfile ...` handles writing the file and some other
   details.  It's possible to rebuild the functionality -- the tools
   are there -- but the APIs are awkward.

2. this allows to profile `mach` internals, instead of just the
   invoked command's implementation.

This uses the return code of the `get_command` subshell to transmit
the single bit of information "is the flag present".

The Python-level argument is required in order to have `--help` know
about the option and to avoid the `mach` shell script having to filter
arguments.

Differential Revision: https://phabricator.services.mozilla.com/D116151
2021-06-02 21:28:56 +00:00
Nick Alexander e11d5cd04e Bug 1714159 - Handle `c:/...` and `C:/...` when making relative paths in `mozlint`. r=ahal
Depends on D116151

Differential Revision: https://phabricator.services.mozilla.com/D116637
2021-06-02 21:27:40 +00:00
Alexandru Michis fd44fe5ee5 Bug 1714156 - Fix lint failures in test_manifest.py
CLOSED TREE
2021-06-02 21:25:07 +03:00
june wilde bece79b87e Bug 1714156 - Disallow 0 weeks in frequency in moz.yaml schema; r=tjr
Differential Revision: https://phabricator.services.mozilla.com/D116626
2021-06-02 18:05:49 +00:00
Mike Hommey 2733dbe0dc Bug 1713733 - Remove WASM_LDFLAGS. r=firefox-build-system-reviewers,mhentges
It's not practically make a difference (the flags we end up setting it
to don't do anything when linking all the wasm files into one).

Differential Revision: https://phabricator.services.mozilla.com/D116437
2021-06-02 04:34:20 +00:00
Butkovits Atila 1b7d8eac8e Backed out changeset a9562036bedd (bug 1713818) for causing wrench bustages. 2021-06-02 02:19:35 +03:00
Mitchell Hentges 271c19459a Bug 1713818: Require Python 3.6+ to run Mach r=ahal
This will both:
* Ensure that developers aren't accidentally using Mach with Python 2
  in the year 2021.
* Confirm that CI tasks aren't still using Python 2 with Mach.
* Remove support for Python 3.5, which is EOL'd.

Differential Revision: https://phabricator.services.mozilla.com/D116484
2021-06-01 20:03:38 +00:00
Nick Alexander a8f3540069 Bug 1713178 - Make `black` linter setup avoid updating the virtualenv if it's installed. r=ahal
This could be easily generalized to avoid the updating the virtualenv
more generally, but I think this functionality should be in the
`virtualenv_manager` -- something like `install_pip_binary(...)` -- so
I've just done the most impactful example here.

Differential Revision: https://phabricator.services.mozilla.com/D116148
2021-05-31 21:44:05 +00:00
Alex Lopez 1ee8086c02 Bug 1696251 - Refactor constructors in MachCommandBase subclasses to remove them. r=mhentges,remote-protocol-reviewers
Another step towards avoiding the need for classes in mach commands;
here we are removing constructors either by changing them into helpers
or by simple refactorings.

Differential Revision: https://phabricator.services.mozilla.com/D112434
2021-05-28 18:30:03 +00:00
Steve Fink 6497489f40 Bug 1713235 - Use python3-devel for CentOS 8 r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D116184
2021-05-28 14:32:07 +00:00
Mitchell Hentges 06a214573a Bug 1712819: Avoid pip's "outdated" warning in virtualenvs r=ahal
Now, when running mach commands that invoke `pip`, it will no longer
inform the user that it needs an update.

We reach into `distutils` to determine the "site-packages" directory
pattern, then apply it to our virtualenv.

Differential Revision: https://phabricator.services.mozilla.com/D115940
2021-05-27 23:04:06 +00:00
Mitchell Hentges 79c56399e1 Bug 1712819: Fix VirtualenvManager not being expandable in debugger r=ahal
At least in PyCharm, expanding a `VirtualenvManager` instance means
resolving all the properties and fields of the instance.
However, if that property is doing non-trivial work, the debugger
wouldn't run that subprocess while we're stopped at a breakpoint.
So, the instance would sit there with the "Collecting data..." text.

Differential Revision: https://phabricator.services.mozilla.com/D115935
2021-05-27 23:04:06 +00:00
Mike Hommey 95e6d3cd22 Bug 1712350 - Stop guessing where make is in python code. r=firefox-build-system-reviewers,mhentges
This was necessary before because we first started the build by invoking
make with client.mk, which would then invoke configure. But that changed
in bug 1671424, and we now never need make before configure has run
(except in tests, for which we implement a fallback).

Differential Revision: https://phabricator.services.mozilla.com/D116064
2021-05-27 22:27:25 +00:00
Butkovits Atila 6bb47ac424 Backed out changeset 4b889750da57 (bug 1696251) for causing lint failures. CLOSED TREE 2021-05-28 01:43:11 +03:00
Alex Lopez 2e8613720d Bug 1696251 - Refactor constructors in MachCommandBase subclasses to remove them. r=mhentges,remote-protocol-reviewers
Another step towards avoiding the need for classes in mach commands;
here we are removing constructors either by changing them into helpers
or by simple refactorings.

Differential Revision: https://phabricator.services.mozilla.com/D112434
2021-05-27 21:03:46 +00:00
Mitchell Hentges c329fa104b Bug 1713060: Don't override "substs" to fetch it fallibly r=ahal
A clobber must be able to run, even if `substs` (configure output)
is not available.
However, when this behaviour was implemented, it was set up to replace
all usages.

Since we're trying to make mach commands no longer objects, this
kind of overriding won't be possible in the future. Fortunately, it's
not needed: only `Clobberer` needs a fallible substs, the other
consumers don't!

Differential Revision: https://phabricator.services.mozilla.com/D116128
2021-05-27 21:00:42 +00:00
Mitchell Hentges 78fcd81e02 Bug 1712382: `./mach clobber gradle` works if directory already gone r=nalexander
Back-to-back `./mach clobber gradle` invocations were failing
because `shutil.rmtree(..)` would complain that the target directory
didn't exist.

Differential Revision: https://phabricator.services.mozilla.com/D116129
2021-05-27 18:04:32 +00:00
Mitchell Hentges de10b8114b Bug 1712382: Includes virtualenvs when clobbering Python r=glandium
No longer includes `python` in the `./mach clobber` defaults since
python cache files should no longer be affecting `./mach artifact`.

Removes `third_party/python` purging from `./mach clobber python`
since we don't build native Python modules there.

Moves virtualenv-purging from `./mach clobber objdir` to
`./mach clobber python`.

Differential Revision: https://phabricator.services.mozilla.com/D115728
2021-05-27 18:04:32 +00:00
Dorel Luca 61aa3325c5 Backed out 2 changesets (bug 1712819) for Python failures. CLOSED TREE
Backed out changeset f51d72e5f0b8 (bug 1712819)
Backed out changeset 40c109bb5f9a (bug 1712819)
2021-05-27 19:05:15 +03:00
Mitchell Hentges 20d4059a6f Bug 1712133: Simplify virtualenv "sitecustomize" writing r=ahal
Child `handle_package(...)` invocations don't need to modify
`sitecustomize.py`, so don't pass it to them.

Differential Revision: https://phabricator.services.mozilla.com/D115924
2021-05-27 15:18:37 +00:00
Mitchell Hentges 17f68a38c4 Bug 1712133: Use if/else chain instead of early-return in handle_package r=ahal
Accidentally missing a `return` in a code path could mean that
`handle_package(...)` would accidentally do an action _and_
raise the "Unknown action" error.

This change resolves that, and it simplifies the code a bit.

Differential Revision: https://phabricator.services.mozilla.com/D115923
2021-05-27 15:18:37 +00:00
Mitchell Hentges 0d1d6ed813 Bug 1712804: Change comm action to be specific to Thunderbird r=rjl,ahal
Avoid the "Error processing command" warning when building virtualenvs
in a Firefox checkout

Differential Revision: https://phabricator.services.mozilla.com/D115922
2021-05-27 15:18:37 +00:00
Mitchell Hentges 9522e92323 Bug 1712382: Remove "set-variable" action support from virtualenvs r=ahal
`MACH_VIRTUALENV` was never used, and `MOZBUILD_VIRTUALENV` was never
set (the virtualenv was always activated during the build, rather
than before).

Differential Revision: https://phabricator.services.mozilla.com/D115921
2021-05-27 15:18:36 +00:00
Mitchell Hentges 04a6f9736c Bug 1712382: Remove "setup.py" action support from virtualenvs r=ahal
The `setup.py` action is no longer used, so we can safely remove it.

Depends on D115641

Differential Revision: https://phabricator.services.mozilla.com/D115913
2021-05-27 15:18:36 +00:00
Mitchell Hentges 5eb07cd570 Bug 1712133: Remove build VIRTUALENV_NAME customization r=glandium
This was originally set up so that tests wouldn't "create a new
`virtualenv` for no reason." However, virtual environments now will have
different packages installed, and therefore the separation is necessary.

So, for the virtual environment used for builds (regular or for tests):
* We want it to be able to reuse the build venv, if it already exists.
* We don't want to pollute a `pytest` virtualenv with build-specific
  packages.

Differential Revision: https://phabricator.services.mozilla.com/D115641
2021-05-27 15:18:35 +00:00
Mitchell Hentges 846e25c93b Bug 1712133: Rename default virtualenv to "common" r=ahal
We had split up `init` from `init_py3` because `mach` had
traditionally been invoked by either Python 2 or Python 3, and
the two couldn't share the same virtualenv.

Now that the same context isn't shared by both Python 2 and 3
3
(developers always use Python 3, and the remaining Python 2
usages are CI jobs that never reuse the objdir with Python 3),
We can centralize on a single default virtualenv.

I've called this "common" instead of "init" to clarify its
existing position as the virtualenv that's used by many different
commands. As we associate virtualenvs with requirement definitions,
it'll also make the file less confusing: it's a "common" requirement
definition as opposed to an "init" one.

Differential Revision: https://phabricator.services.mozilla.com/D115635
2021-05-27 15:18:35 +00:00
Mitchell Hentges d41a0b2774 Bug 1712819: Avoid pip's "outdated" warning in virtualenvs r=ahal
Now, when running mach commands that invoke `pip`, it will no longer
inform the user that it needs an update.

We reach into `distutils` to determine the "site-packages" directory
pattern, then apply it to our virtualenv.

Differential Revision: https://phabricator.services.mozilla.com/D115940
2021-05-27 15:16:16 +00:00
Mitchell Hentges f8ce33772c Bug 1712819: Fix VirtualenvManager not being expandable in debugger r=ahal
At least in PyCharm, expanding a `VirtualenvManager` instance means
resolving all the properties and fields of the instance.
However, if that property is doing non-trivial work, the debugger
wouldn't run that subprocess while we're stopped at a breakpoint.
So, the instance would sit there with the "Collecting data..." text.

Differential Revision: https://phabricator.services.mozilla.com/D115935
2021-05-27 15:16:16 +00:00
Tom Ritter 2b1afa9921 Bug 1712815 - Fix the 'remove a file from a moz.build file' logic r=jewilde
We were raising an exception as a result of a python error
which was masked by a catch statement that thought we didn't
know how to remove the file. But we did.

Fix the python error, and add an exception at the end of the
function to be raised and then caught when we really don't know
how to remove a file.

Differential Revision: https://phabricator.services.mozilla.com/D115936
2021-05-27 14:19:25 +00:00
Tom Ritter 8bcc518a54 Bug 1712953 - Add a frequency attribute to Updatebot tasks r=jewilde
Differential Revision: https://phabricator.services.mozilla.com/D116020
2021-05-26 20:36:13 +00:00
Alex Lopez 07cf832a8a Bug 1696251 - Turn all properties in MachCommandBase subclasses into methods. r=mhentges,perftest-reviewers,sparky
As a step towards moving mach commands outside of classes, this converts all
properties into methods so that they can later become top-level helper functions.

Differential Revision: https://phabricator.services.mozilla.com/D112196
2021-05-26 18:08:02 +00:00
Henrik Skupin fa4fbb78b4 Bug 1695031 - Combine build flags --disable-marionette and --enable-cdp as --disable-webdriver. r=firefox-build-system-reviewers,Gijs,smaug,keeler,jdescottes,glandium
Differential Revision: https://phabricator.services.mozilla.com/D115583
2021-05-25 09:13:28 +00:00
Julien Cristau 1c67430110 Bug 1712150 - take branches into account in release-started email notification. r=releng-reviewers,aki
Instead of using the pushlog, grab the hg log using a revset to avoid
being confused by branches: we're looking for revisions that are
ancestors of the new revision but not of the previous tag, i.e.
"current % previous".

Differential Revision: https://phabricator.services.mozilla.com/D115624
2021-05-21 12:51:41 +00:00
Iulian Moraru 57426f492a Backed out changeset 67422384cb3e (bug 1712150) for causing release python failures on test_buglist_creator.py::test_get_bugs_in_changeset. CLOSED TREE 2021-05-21 14:22:14 +03:00
Julien Cristau 627434975b Bug 1712150 - take branches into account in release-started email notification. r=releng-reviewers,aki DONTBUILD
Instead of using the pushlog, grab the hg log using a revset to avoid
being confused by branches: we're looking for revisions that are
ancestors of the new revision but not of the previous tag, i.e.
"current % previous".

Differential Revision: https://phabricator.services.mozilla.com/D115624
2021-05-21 09:36:08 +00:00
Mike Hommey c3d194a44b Bug 1712023 - Avoid displaying truncated symbols in check_binary_compat. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D115561
2021-05-20 22:32:10 +00:00
Ed Lee 851ab05cae Bug 1710955 - Change MR1 upgrade onboarding to Pin then Default then Theme screens r=fluent-reviewers,flod,pdahiya,k88hudson
Copy / migrate strings from onboarding/defaultBrowserNotification. Add updated ltr/rtl images and show them for pin and pin+default. Dynamically adjust steps and record telemetry to identify what was shown. Handle button actions based on string ids. Alias upgradeDialog to aboutwelcome for now. Avoid oddness with scrollbars by hiding horizontal scroll.

Differential Revision: https://phabricator.services.mozilla.com/D115142
2021-05-18 03:16:34 +00:00
Alex Lopez 455d9a088b Bug 1696251 - Pass MachCommandBase object as first argument for Mach Commands. r=mhentges,remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers
As an intermediate step to allow mach commands as standalone functions, the MachCommandBase
subclass instance that currently corresponds to self has to be made available as a separate
argument (named command_context).

Differential Revision: https://phabricator.services.mozilla.com/D109650
2021-05-17 16:15:58 +00:00
Gregory Mierzwinski e8e2ef66d3 Bug 1710578 - Add missing python packages to search paths for mozperftest. r=perftest-reviewers,Bebe
This patch fixes a regression caused by bug 1698616 which made modifications to third-party/python packages.

Differential Revision: https://phabricator.services.mozilla.com/D114869
2021-05-12 14:22:28 +00:00
Mike Hommey d9c58f174d Bug 1707829 - Go back to building http3server as a rust program. r=necko-reviewers,kershaw
This mostly revert bug 1616238.

Differential Revision: https://phabricator.services.mozilla.com/D113485
2021-05-07 20:22:56 +00:00
Sandor Molnar 93e6afe93a Backed out changeset bd2c9d3fa4b0 (bug 1707829) for causing xpc failures. CLOSED TREE 2021-05-07 01:58:43 +03:00
Mike Hommey eae232636b Bug 1707829 - Go back to building http3server as a rust program. r=necko-reviewers,kershaw
This mostly revert bug 1616238.

Differential Revision: https://phabricator.services.mozilla.com/D113485
2021-05-06 21:37:01 +00:00
Andi-Bogdan Postelnicu d6010d98f2 Bug 1702172 - collect if shell is opened via vscode and if it's a remote connection through ssh. r=firefox-build-system-reviewers,mhentges
Added two fields:

1. Collect if the current shell is opened via vscode.
2. Connect if it's a remote ssh connection n the current shell.

Differential Revision: https://phabricator.services.mozilla.com/D114323
2021-05-05 14:56:32 +00:00
Marco Bonardo f1454c9308 Bug 1706334 - Improving the accessible text on Add Engine items. r=adw,Jamie,fluent-reviewers,flod
Differential Revision: https://phabricator.services.mozilla.com/D113146
2021-05-04 19:52:52 +00:00
Narcis Beleuzu 6371054f62 Bug 1709401 - Fix lint failure a=lint-fix . CLOSED TREE 2021-05-04 20:59:02 +03:00
Tom Ritter b5376d204b Bug 1709401 - Shim the python 3.8 API get_source_segment for ./mach vendor r=jewilde
Differential Revision: https://phabricator.services.mozilla.com/D114254
2021-05-04 17:33:17 +00:00
Mitchell Hentges e170f04fe1 Bug 1707546: Support git worktrees when finding ".arcconfig" r=firefox-build-system-reviewers,andi,tcampbell,glandium
A `.arcconfig` may exist in the `.git` directory. Within worktrees,
the `.git` folder isn't at `<topsrcdir>/.git`, so we have to resolve it.

Differential Revision: https://phabricator.services.mozilla.com/D113320
2021-05-04 15:06:42 +00:00
Steve Fink c0568910c7 Bug 1708048 - Ensure that bootstrap-generated mozconfigs end with newline r=mhentges
Differential Revision: https://phabricator.services.mozilla.com/D113877
2021-05-03 20:39:09 +00:00
Steve Fink 852ab33676 Bug 1708048 - Implement `mach bootstrap --app=js` for SpiderMonkey shell development r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D113598
2021-05-03 20:39:08 +00:00
Mike Hommey f2dcdd5390 Bug 1708592 - Get tools from MOZ_FETCHES_DIR on automation. r=firefox-build-system-reviewers,mhentges
While here, remove the unused clippyProcess.config. And because we need
to manipulate `$PATH` before running `cargo`, use the same wrapping
function in `get_clippy_version`.

Differential Revision: https://phabricator.services.mozilla.com/D113902
2021-04-30 21:09:11 +00:00
Mitchell Hentges f6e819dc08 Bug 1708005: Remove `target_dir` from `RustLibrary` r=firefox-build-system-reviewers,glandium
The `target_dir` is always the objdir, since we try to share compile
output. Therefore, storing it in `RustLibrary` shouldn't be necessary.

Removes the associated `RUST_LIBRARY_TARGET_DIR` moz.build option
as well.

Differential Revision: https://phabricator.services.mozilla.com/D113565
2021-04-29 15:19:09 +00:00
Mitchell Hentges 3ac1e14aec Bug 1704764: Don't warn about Defender exclusions if missing permissions r=firefox-build-system-reviewers,glandium
Newer versions of Windows don't allow un-elevated processes to access
the list of Windows Defender exclusions.
Rather than incorrectly falling back to assuming that there's no
exclusions, we now instead skip the exclusion check.

Differential Revision: https://phabricator.services.mozilla.com/D112648
2021-04-27 20:16:15 +00:00
Mitchell Hentges 7ce2d6da4d Bug 1704764: Remove OSError catch for fetching nonexistent registry key r=sheehan
Since Python 3, attempting to fetch a registry key that doesn't exist
throws `FileNotFoundError`, not `WindowsError: [Error 2]`.

Differential Revision: https://phabricator.services.mozilla.com/D112647
2021-04-27 20:16:14 +00:00
Butkovits Atila 2e34e363b9 Backed out 2 changesets (bug 1696251) for causing js-bench-sm failures. CLOSED TREE
Backed out changeset 1c84c9a34575 (bug 1696251)
Backed out changeset e169193b7423 (bug 1696251)
2021-04-23 02:53:36 +03:00
Alex Lopez 41687360e8 Bug 1696251 - Turn all properties in MachCommandBase subclasses into methods. r=mhentges,perftest-reviewers,sparky
As a step towards moving mach commands outside of classes, this converts all
properties into methods so that they can later become top-level helper functions.

Differential Revision: https://phabricator.services.mozilla.com/D112196
2021-04-22 19:44:52 +00:00
Alex Lopez d1a82b8092 Bug 1696251 - Pass MachCommandBase object as first argument for Mach Commands. r=mhentges,remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers
As an intermediate step to allow mach commands as standalone functions, the MachCommandBase
subclass instance that currently corresponds to self has to be made available as a separate
argument (named command_context).

Differential Revision: https://phabricator.services.mozilla.com/D109650
2021-04-22 18:56:15 +00:00
Steve Fink 768eac28f5 Bug 1706197 - Avoid Python version dependent line number issues r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D112760
2021-04-22 14:30:49 +00:00
Kershaw Chang f9a2c05f44 Bug 1616238 - Enable http3 tests on windows, r=necko-reviewers,valentin
Differential Revision: https://phabricator.services.mozilla.com/D112528
2021-04-22 11:53:32 +00:00
Mike Hommey 9437efddc8 Bug 1706557 - Stop installing rosetta in mach bootstrap. r=firefox-build-system-reviewers,andi,mhentges
The last thing that needed rosetta was node, which is native as of
bug 1706545.

Differential Revision: https://phabricator.services.mozilla.com/D112902
2021-04-22 00:03:29 +00:00
Mitchell Hentges cb92d64d4d Bug 1507272: Enable build telemetry for Mozilla devs by default r=firefox-build-system-reviewers,glandium
Check if a user is a Mozilla employee by checking their
Bugzilla groups, or checking if their VCS email ends
with "@mozilla.com".

When a user is setting up a new build environment, telemetry
will be automatically enabled for them if they are an
employee. If they're not an employee, they'll be asked
if they want to opt in.

Differential Revision: https://phabricator.services.mozilla.com/D106315
2021-04-20 13:58:51 +00:00
championshuttler 7ce5bcb8bc Bug 1577908 - Re-enable mach's autocorrect/excution feature.r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D112340
2021-04-20 06:15:44 +00:00
imoraru 44819cf83e Backed out changeset f2203cb8ec98 (bug 1616238) for build bustages on Android. CLOSED TREE 2021-04-20 09:51:19 +03:00
Mike Hommey 79e8df83dd Bug 1377445 - Remove build dependencies on gtk+2. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D111997
2021-04-20 01:57:03 +00:00
Emma Malysz 7a1cb8a1b1 Bug 1703012: fix control center and identity panel proton styling r=desktop-theme-reviewers,fluent-reviewers,mconley,flod,pbz,Itiel
Migrates two strings to fluent and uses sentence casing.
Places identity security block into a toolbar button.
Fixes margin spacing.
Removes green color from secure connection.

Differential Revision: https://phabricator.services.mozilla.com/D111368
2021-04-19 18:51:37 +00:00
Kershaw Chang 9e4dc813a7 Bug 1616238 - Enable http3 tests on windows, r=necko-reviewers,valentin
Differential Revision: https://phabricator.services.mozilla.com/D112528
2021-04-19 18:34:05 +00:00
Cosmin Sabou 785f9b8a87 Backed out changeset d4a5d8567977 (bug 1696251) for non-unified build bustages. CLOSED TREE 2021-04-19 19:43:31 +03:00
Alex Lopez 75dfe35468 Bug 1696251 - Pass MachCommandBase object as first argument for Mach Commands. r=mhentges,remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers
As an intermediate step to allow mach commands as standalone functions, the MachCommandBase
subclass instance that currently corresponds to self has to be made available as a separate
argument (named command_context).

Differential Revision: https://phabricator.services.mozilla.com/D109650
2021-04-19 16:15:11 +00:00
Steve Fink 06fa1e33cc Bug 1697929 - Make mach work in the spidermonkey release package r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D108129
2021-04-19 14:21:43 +00:00
Bogdan Tara b88a6d9d04 Backed out 2 changesets (bug 1704827, bug 1703012) for screenshots mochitest timeouts CLOSED TREE
Backed out changeset 95a07d286cd7 (bug 1704827)
Backed out changeset 5e8a1732b021 (bug 1703012)
2021-04-16 22:40:48 +03:00
Emma Malysz 4f7010a85c Bug 1703012: fix control center and identity panel proton styling r=desktop-theme-reviewers,fluent-reviewers,mconley,flod,pbz,Itiel
Migrates two strings to fluent and uses sentence casing.
Places identity security block into a toolbar button.
Fixes margin spacing.
Removes green color from secure connection.

Differential Revision: https://phabricator.services.mozilla.com/D111368
2021-04-16 16:38:02 +00:00
Brindusan Cristian e2c4d3a898 Backed out 2 changesets (bug 1704827, bug 1703012) for causing bc failures in browser_parsable_css.js. CLOSED TREE
Backed out changeset e3567ea32072 (bug 1704827)
Backed out changeset 43bb3216b816 (bug 1703012)
2021-04-16 18:53:26 +03:00
Emma Malysz ae77fc5e90 Bug 1703012: fix control center and identity panel proton styling r=desktop-theme-reviewers,fluent-reviewers,mconley,flod,pbz,Itiel
Migrates two strings to fluent and uses sentence casing.
Places identity security block into a toolbar button.
Fixes margin spacing.
Removes green color from secure connection.

Differential Revision: https://phabricator.services.mozilla.com/D111368
2021-04-16 14:42:57 +00:00
Noemi Erli 40d417bd3c Bug 1704126 - Fix lint failure r=fix CLOSED TREE 2021-04-16 04:20:52 +03:00
Mike Hommey f2dafefef4 Bug 1704126 - Make mach create-mach-environment fail when running under Rosetta. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D112151
2021-04-16 01:03:56 +00:00
Mike Hommey 3b212b0272 Bug 1705296 - Don't create a python2 mach virtualenv. r=firefox-build-system-reviewers,mhentges
No mach command uses python2 anymore, so we don't need to create a
virtualenv for python2.

Differential Revision: https://phabricator.services.mozilla.com/D112148
2021-04-16 01:00:09 +00:00
Andrew Halberstadt 002c099fc4 No Bug - [mozversioncontrol] xfail 'test_branch.py' with git < 2.22.0, r=bhearsum
The 'git branch --show-current' flag didn't exist prior to that version.

Differential Revision: https://phabricator.services.mozilla.com/D112043
2021-04-14 20:49:26 +00:00
Andrew Halberstadt 408f22ce3b No Bug - [mozversioncontrol] Add a test for vcs.branch, r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D112015
2021-04-14 14:03:10 +00:00
Ben Hearsum 93969911bd No bug: ensure ./mach taskgraph --diff returns you to your starting branch when using git. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D111848
2021-04-14 13:49:01 +00:00
Claudia 69e599d847 Bug 1651012 - Organize certerror code into its own directory in browser/base/content/ r=prathiksha,Gijs
Differential Revision: https://phabricator.services.mozilla.com/D110951
2021-04-14 10:24:38 +00:00
Alexandru Michis 9b58a1c6f5 Backed out changeset 8a21200047bb (bug 1651012) for causing bc failures in browser_parsable_script.js
CLOSED TREE
2021-04-14 01:52:26 +03:00
Claudia d6b7c6e76b Bug 1651012 - Organize certerror code into its own directory in browser/base/content/ r=prathiksha,Gijs
Differential Revision: https://phabricator.services.mozilla.com/D110951
2021-04-13 18:54:28 +00:00
Nick Alexander faad7e9113 Bug 1391106 - Support `mach watch` for non-artifact builds. r=firefox-build-system-reviewers,mhentges
I manually compared `$TOPOBJDIR/faster/unified_install_dist_bin` for
an artifact and a non-artifact build, and found only a few
pre-processing differences.  I can't recall why this wasn't supported
initially; I think it used to be that manifests overlapped and that
the interaction with the RecursiveMake backend was more complicated.
But I see no reason why this shouldn't work, and would like to get
some folks to test it in the wild.

Differential Revision: https://phabricator.services.mozilla.com/D110311
2021-04-13 16:02:21 +00:00
Mike Hommey 9bce63da4f Bug 1704685 - Remove leftover from bug 1686888. r=firefox-build-system-reviewers,nalexander
Differential Revision: https://phabricator.services.mozilla.com/D111765
2021-04-13 04:57:48 +00:00
Nisarg 4b18d50091 Bug 1698838 - Create a format command as an alternative to lint --fix. r=ahal
***
Bug 1698838 - Restrict the list of linters to valid formatters r=ahal

***
Bug 1698838 - Abort formatting even if one of the linters passed is invalid r=ahal

***

***

Differential Revision: https://phabricator.services.mozilla.com/D109231
2021-04-12 18:01:14 +00:00
Kagami Sascha Rosylight d9f6cded53 Bug 1704375 - Close tar file after use in vendor_manifest.py r=firefox-build-system-reviewers,nalexander
Differential Revision: https://phabricator.services.mozilla.com/D111566
2021-04-12 03:14:06 +00:00
Nick Alexander 29fc399d04 Bug 1703886 - Let `MOZ_BACKGROUNDTASKS` and `MOZ_UPDATE_AGENT` ride the trains. r=application-update-reviewers,firefox-build-system-reviewers,mhentges,bytesized
This also makes `MOZ_UPDATE_AGENT` depend on `MOZ_BACKGROUNDTASKS`.

There's no need to lint the `tools/update-programs` project, since
it's not a supported configuration.  The next consumer can
rehabilitate it or remove it.

Differential Revision: https://phabricator.services.mozilla.com/D111313
2021-04-11 20:50:15 +00:00
Cosmin Sabou 79873d0515 Bug 1703664 - Fix linting opt failure on mozlint/roller.py.
CLOSED TREE
2021-04-09 18:56:25 +03:00
Marco Castelluccio 2f5bc535f6 Bug 1703664 - Enable showing all warnings from mozlint-based linters in reviewbot. r=ahal DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D111166
2021-04-09 15:08:57 +00:00
Chris Fallin e888f83b57 Bug 1701603 part 1 - Support WASI as a new target for compilation. r=glandium
Add new OS - WASI and new processor - wasm32 to the SM's build system.

Differential Revision: https://phabricator.services.mozilla.com/D110067
2021-04-08 08:02:15 +00:00
Csoregi Natalia bd01562887 Backed out changeset 3ec9f9951ffe (bug 1377445) for bustage due to missing file. CLOSED TREE 2021-04-08 11:04:47 +03:00
Bryan Quigley a1b5fde57c Bug 1377445 - Drop gtk2 depends r=stransky
Differential Revision: https://phabricator.services.mozilla.com/D111121
2021-04-08 07:38:40 +00:00
Nicklas Boman 2722651b9d Bug 1702896 - Mach bootstrap does not work on openSUSE Leap 15.2 (anymore) r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D110771
2021-04-07 19:21:54 +00:00
Nicklas Boman 361cf9d1e8 Bug 1703305 - Mach bootstrap for openSUSE will try to install pip/mercurial as root. maby use --user instead? r=firefox-build-system-reviewers,mhentges
To me this sounds like a good idea, but im not sure :)

Differential Revision: https://phabricator.services.mozilla.com/D110960
2021-04-07 19:21:17 +00:00
Steve Fink b5836beb66 Bug 1702763 - Fix check for verbose flag in mozperftest r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D110677
2021-04-06 19:46:00 +00:00
Francesco Lodolo (:flod) 830a1bba6e Bug 1703003 - Migrate Bookmark panel Cancel/Remove buttons to Fluent and fix capitalization, r=mconley
Differential Revision: https://phabricator.services.mozilla.com/D110894
2021-04-06 17:15:31 +00:00
Emma Malysz fb284a526f Bug 1702461, set fxa submenu header correctly when opening the panel r=mconley,fluent-reviewers,flod
Differential Revision: https://phabricator.services.mozilla.com/D110633
2021-04-02 15:27:01 +00:00
Cosmin Sabou f06d692475 Backed out changeset 23251cfb884e (bug 1616239) for causing windows aarch bustages. 2021-04-01 23:03:29 +03:00
Kershaw Chang 93423e9aa1 Bug 1616239 - Enable http3 tests for asan r=necko-reviewers,dragana
Differential Revision: https://phabricator.services.mozilla.com/D108635
2021-04-01 18:31:23 +00:00
Mitchell Hentges 66008bc119 Bug 1702279: Sentry should patch absolute paths without leading slash r=sheehan
Due to strange module-name generation we do (e.g.:
`mach.commands.be68b9824a51408e815262b2e8f21d6b`), Sentry's conversion
of absolute paths to local paths fails - instead, the path remains
absolute, but without the leading forward slash. (Except on Windows,
where `c:/` is maintained).

We resolve this by not requiring the leading slash when patching
absolute paths.

Differential Revision: https://phabricator.services.mozilla.com/D110436
2021-04-01 16:30:57 +00:00
Mitchell Hentges 9511c83afa Bug 1702353: Don't submit exception to Sentry if revision can't be found r=sheehan
This can occur if the user is using cinnabar and it fails to find the
equivalent hg revision for their current base commit.

It's significantly less valuable to have exceptions with an "anonymous
release", so we skip these exceptions instead.

Differential Revision: https://phabricator.services.mozilla.com/D110481
2021-04-01 16:23:57 +00:00
Emma Malysz caad0a1fe9 Bug 1698062: set app menu width and ensure text can wrap r=fluent-reviewers,mconley,flod
Differential Revision: https://phabricator.services.mozilla.com/D110461
2021-04-01 14:58:05 +00:00
Gabriele Svelto 831c355e81 Bug 1701576 - Improve openSUSE detection during bootstrap r=glandium,mhentges DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D110059
2021-04-01 10:04:31 +00:00
june wilde 9a74eac849 Bug 1699448 - Allow any valid git reference in moz.yaml revision field; r=tjr
Differential Revision: https://phabricator.services.mozilla.com/D108953
2021-03-31 14:17:19 +00:00
Francesco Lodolo (:flod) 454d8daa57 Bug 1702118 - Migrate more FxA toolbar button strings to Fluent, r=fluent-reviewers,Gijs
Differential Revision: https://phabricator.services.mozilla.com/D110366
2021-03-31 13:39:10 +00:00
Mitchell Hentges 9043e515e9 Bug 1645425: Annotate Sentry reports with base revision r=sheehan
To track whether issues being reported are for old versions, we attach
an hg revision hash as a release version with each report.

We use the base_ref because:
* It's a public revision that we can look up, and
* Since we only submit Sentry events when mach is unmodified,
  it's essentially acting as a version identifier.

Differential Revision: https://phabricator.services.mozilla.com/D108307
2021-03-30 16:22:58 +00:00
Chris H-C ea2a18d757 Bug 1697555 - Remove Telemetry portions of Accounts Ecosystem Telemetry r=Dexter
Differential Revision: https://phabricator.services.mozilla.com/D110091
2021-03-29 20:03:38 +00:00
Andrew Halberstadt a0922d0765 Bug 1700632 - [mach] Fix bug in zsh completion script generation, r=tjr
We want to make sure to only strip a single leading or trailing quote, and
not all of them.

Differential Revision: https://phabricator.services.mozilla.com/D109804
2021-03-29 19:14:30 +00:00
Agi Sferro 674d630320 Bug 1697844 - Remove unused FENNEC_NIGHTLY. r=esawin
Differential Revision: https://phabricator.services.mozilla.com/D108049
2021-03-24 20:06:24 +00:00
Alexandru Michis ced948f22d Backed out 10 changesets (bug 1697844) for causing mpu failures in test_visualmetrics.py
CLOSED TREE

Backed out changeset 63b3268b0d2d (bug 1697844)
Backed out changeset 875b2aa342d9 (bug 1697844)
Backed out changeset 4fb528aaf7d5 (bug 1697844)
Backed out changeset 6ef5e1c9ca21 (bug 1697844)
Backed out changeset 430d6c940eb9 (bug 1697844)
Backed out changeset 7a306f28dc64 (bug 1697844)
Backed out changeset 871a40e2fc00 (bug 1697844)
Backed out changeset 083e9ce71d14 (bug 1697844)
Backed out changeset b53930a3f065 (bug 1697844)
Backed out changeset 24326d04dd37 (bug 1697844)
2021-03-24 21:59:28 +02:00
Emilio Cobos Álvarez 22061e8965 Bug 1697053 - Let non-native-theme ride the trains in Firefox 89. r=cpeterson,mstange
Differential Revision: https://phabricator.services.mozilla.com/D109555
2021-03-24 19:11:05 +00:00
Agi Sferro a6f7203643 Bug 1697844 - Remove unused FENNEC_NIGHTLY. r=esawin
Differential Revision: https://phabricator.services.mozilla.com/D108049
2021-03-24 18:54:45 +00:00
Tom Ritter 7d6a463f12 Bug 1700621: Add needinfo field to the moz.yaml schema r=jewilde
Differential Revision: https://phabricator.services.mozilla.com/D109615
2021-03-24 17:17:11 +00:00
Mike Conley f7505a1445 Bug 1697617 - Update Synced Tabs menu for Proton. r=emalysz,flod,desktop-theme-reviewers,harry
Differential Revision: https://phabricator.services.mozilla.com/D109404
2021-03-24 07:20:46 +00:00
Scott 1e202523c4 Bug 1693376 - Move save to Pocket to the toolbar. r=Gijs,fluent-reviewers,gvn,flod
Differential Revision: https://phabricator.services.mozilla.com/D107744
2021-03-23 20:06:03 +00:00
Mike Hommey 8e4cf752da Bug 1699613 - Allow the build resources usage report to display arbitrary resource usage json files. r=firefox-build-system-reviewers,sheehan,mhentges
AFAIK, while mochitests have resource-usage.json data with the same
format as build_resources.json, there isn't much of anything to display
that data in a human-friendly manner. As a helper of sort for all the
tasks that already expose their json data without a nice way to display
it, allow the build resources usage report UI that `mach resource-usage`
displays (or build_resources.html on build tasks on treeherder), to load
arbitrary json files if their url is dropped on the page (from e.g.
drag-and-dropping the link to the file from treeherder).

Differential Revision: https://phabricator.services.mozilla.com/D109030
2021-03-22 21:46:53 +00:00
june wilde e1938af8e9 Bug 1699453 - Check if exclude is populated from moz.yaml before accessing it; r=tjr
Differential Revision: https://phabricator.services.mozilla.com/D108956
2021-03-22 20:06:01 +00:00
Tom Ritter b33f2f2170 Bug 1699808: Fix test exception to use quotes r=jewilde
Differential Revision: https://phabricator.services.mozilla.com/D109345
2021-03-22 14:42:10 +00:00
Andrew Creskey b70829a366 Bug 1695252 - Add a pageload test that reports PerfStats r=sparky,perftest-reviewers
This commit adds a simple pageload test, a warm pageload of https://www.google.com.
Low-level perfstats are collected.

All platforms were included. Not running as a cron job.

The motivation is that we can now collect low-level perfStats timings and determine how useful they will be for performance work.

Differential Revision: https://phabricator.services.mozilla.com/D109072
2021-03-22 13:50:32 +00:00
Francesco Lodolo (:flod) dd2b688041 Bug 1700036 - Remove Fluent migration recipes for Firefox 83-87, r=Gijs
Differential Revision: https://phabricator.services.mozilla.com/D109267
2021-03-22 13:23:12 +00:00
Tom Ritter d68a653330 Bug 1691975: Take into account that the vendoring directory may be different from the moz.yaml directory r=andi
Differential Revision: https://phabricator.services.mozilla.com/D104791
2021-03-19 19:23:06 +00:00
Tom Ritter c781fce5dd Bug 1691975: Wire up removing files from moz.build files r=andi
Differential Revision: https://phabricator.services.mozilla.com/D104758
2021-03-19 19:23:06 +00:00
Tom Ritter 51f7eb3ae9 Bug 1691975: Add logic to remove a file from a moz.build file r=andi
Differential Revision: https://phabricator.services.mozilla.com/D104757
2021-03-19 19:23:05 +00:00
Tom Ritter c459ca2966 Bug 1691975: Integrate the new code into ./mach vendor r=firefox-build-system-reviewers,mhentges
This does not address files that should be removed from the moz.build file

Differential Revision: https://phabricator.services.mozilla.com/D104756
2021-03-19 19:23:05 +00:00
Tom Ritter 015084cc33 Bug 1691975: Extend the algorithm to actually rewrite the moz.build file r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D104755
2021-03-19 19:23:04 +00:00
Tom Ritter b4a8c15931 Bug 1691975: Logic for editing moz.build files r=firefox-build-system-reviewers,mhentges
This commit adds the core algorithm for editing moz.build files, tests for a few
pieces of it, and the code to manually run the algorithm over the gecko codebase
and see dynamically how well it performs at trying to assigning existing source
files back into their original locations.

Differential Revision: https://phabricator.services.mozilla.com/D104754
2021-03-19 19:23:04 +00:00
Tom Ritter 09a3343784 Bug 1695311: If Updatebot tasks are present, enforce certain values in the moz.yaml schema r=jewilde
Differential Revision: https://phabricator.services.mozilla.com/D106659
2021-03-19 19:02:34 +00:00
Molly Howell ce9daf2f2a Bug 1695792 - Update copy for accounts error notifications. r=mconley,fluent-reviewers
Also take the opportunity to convert these two strings to Fluent,
since we're changing the text here anyway.

Differential Revision: https://phabricator.services.mozilla.com/D108530
2021-03-18 21:45:09 +00:00
Andrew Creskey e439b1e266 Bug 1698620 - Update perftest browsertime r=sparky,perftest-reviewers
Update to the latest browsertime so we can collect PerfStats

Differential Revision: https://phabricator.services.mozilla.com/D108499
2021-03-18 13:26:34 +00:00
Emma Malysz 07e9a5b088 Bug 1691140, add Task Manager to browser tools menu for proton r=mconley,fluent-reviewers,flod
Revert changes that added Task Manager to help menu.
With proton disabled, it should remain in the "More" section

Differential Revision: https://phabricator.services.mozilla.com/D108055
2021-03-17 15:44:17 +00:00
Connor Sheehan 17a15ff0aa Bug 1697956: install `m4` as a common package on Debian/Ubuntu r=firefox-build-system-reviewers,mhentges DONTBUILD
During `mach bootstrap` for Firefox desktop, m4 is installed via `libgtk2.0-dev`.
Since we don't install that package for Android bootstrap, this causes
configure failures.

Install `m4` as a common package to fix configure on Android. Since we plan
to remove `libgtk2.0-dev` soon, this will also avoid breakage when that change
lands.

Differential Revision: https://phabricator.services.mozilla.com/D108692
2021-03-17 14:19:35 +00:00
Alex Lopez 9de1a47962 Bug 1696251 - Move metrics_path parameter from @CommandProvider to @Command/@SubCommand . r=mhentges
As a step to remove the need to use @CommandProvider, we are moving
the metrics_path parameter to @Command.

Differential Revision: https://phabricator.services.mozilla.com/D108092
2021-03-17 14:14:14 +00:00
Mike Hommey 0ea5ad6742 Bug 1698706 - Always add PIC flags to C{,XX}FLAGS. r=firefox-build-system-reviewers,andi,sheehan,mhentges
The build always uses them anyways, but configure tests don't, and some
of them fail as a consequence in some cases (example: when UBsan is
enabled, all AC_LANG_CPLUSPLUS + AC_CHECK_FUNCS tests fail). We also had
similar problems in the past, such as bug 1513605.

By adding the PIC flags to CFLAGS and CXXFLAGS, we ensure old-configure
tests use the flags as well.

While here, we also remove DSO_CFLAGS, which was always empty, and we
stop passing -fPIC to wasm compiles, because it has no effect there.

Differential Revision: https://phabricator.services.mozilla.com/D108560
2021-03-17 02:27:22 +00:00
Mike Hommey f74f871db7 Bug 1697950 - Partial support for mach bootstrap on arm64 mac. r=firefox-build-system-reviewers,sheehan,mhentges
This is enough to make the instructions on the Google doc unnecessary.

Differential Revision: https://phabricator.services.mozilla.com/D108132
2021-03-17 02:11:51 +00:00
Csoregi Natalia 1fe0f680de Backed out changeset 86089c4629b5 (bug 1698706) for spidermonkey bustage. CLOSED TREE 2021-03-17 03:48:31 +02:00
Mike Hommey 473d31abfb Bug 1698706 - Always add PIC flags to C{,XX}FLAGS. r=firefox-build-system-reviewers,andi,sheehan,mhentges
The build always uses them anyways, but configure tests don't, and some
of them fail as a consequence in some cases (example: when UBsan is
enabled, all AC_LANG_CPLUSPLUS + AC_CHECK_FUNCS tests fail). We also had
similar problems in the past, such as bug 1513605.

By adding the PIC flags to CFLAGS and CXXFLAGS, we ensure old-configure
tests use the flags as well.

While here, we also remove DSO_CFLAGS, which was always empty, and we
stop passing -fPIC to wasm compiles, because it has no effect there.

Differential Revision: https://phabricator.services.mozilla.com/D108560
2021-03-17 01:27:39 +00:00
Mitchell Hentges c7550c57b3 Bug 1698889: Consistently alias paths in Sentry reports r=sheehan
When Sentry slurps context, it doesn't normalize os path separators for
us. So, we adapt our path aliasing to always catch both forward slashes
and backslashes.

Removed the `needle is None` guard because it because obsolete after
1695366, which removed the case where `topsrcdir` was `None`.

Differential Revision: https://phabricator.services.mozilla.com/D108667
2021-03-16 20:30:30 +00:00
Mitchell Hentges 4672929606 Bug 1695366: Only submit Sentry events when Mach is unmodified r=sheehan
If the "mach" file and all "*.py" files are unchanged, then the reported
exception is likely legitimate and can be reproduced on the public tree.

Differential Revision: https://phabricator.services.mozilla.com/D108262
2021-03-12 22:29:28 +00:00
Emma Malysz 6e4c1b1588 Bug 1694678: update fxa and remote tabs sync now buttons r=fluent-reviewers,mconley
This patch:
-Maintains consistency between the fxa and remote tabs' panels "sync now" buttons
-Removes a fluent string no longer in use
-Restores tooltip functionality

Differential Revision: https://phabricator.services.mozilla.com/D106651
2021-03-12 21:41:46 +00:00
Mike Hommey a34d14071f Bug 1697960 - Don't prompt for telemetry when glean couldn't be installed. r=firefox-build-system-reviewers,mhentges,sheehan
Bootstrap runs mach create-mach-environment, which may or may not
successfully install glean. When it doesn't, it's not useful to ask
whether to enable telemetry when it's not going to work.

Differential Revision: https://phabricator.services.mozilla.com/D108131
2021-03-12 21:14:40 +00:00
Mitchell Hentges 9501e0ca97 Bug 1507272: Removes unused parameter in bootstrap function r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D106813
2021-03-12 16:07:12 +00:00
Mitchell Hentges b7e0dfe1d1 Bug 1695272: Move `--no-interactive` to global mach args r=firefox-build-system-reviewers,glandium
Updates `./mach bootstrap` to use `--no-interactive` from global args.
Ensures all bootstrap prompts have a default option.

Differential Revision: https://phabricator.services.mozilla.com/D106814
2021-03-12 16:07:11 +00:00
Mitchell Hentges 8133abcb41 Bug 1695973: Remove retry limit from bootstrap prompt r=firefox-build-system-reviewers,sheehan,glandium
The retry limit doesn't add much value - if user doesn't want
to answer a prompt, they can CTRL-C.

Additionally, `prompt_yesno` doesn't have a retry limit, so
this increases prompt behaviour consistency.

Differential Revision: https://phabricator.services.mozilla.com/D107122
2021-03-12 16:07:11 +00:00