Граф коммитов

6010 Коммитов

Автор SHA1 Сообщение Дата
Gregory Mierzwinski 7a9ed37810 Bug 1643103 - Fix how system layers work with the test layers. r=mozperftest-reviewers,tarek
This patch fixes how the system and browser/test layers are run. With this fix, the system layer no longer fully runs its setup and teardown stages before the browser layer has started and finished. Now the setup/teardown happens before/after the full test layer run.

Depends on D78016

Differential Revision: https://phabricator.services.mozilla.com/D78128
2020-06-05 13:42:14 +00:00
Tarek Ziadé 18f9ccd8f2 Bug 1642615 - Renamed the browser layer to test r=sparky
This patch renames the browser layer to test, since
it could be something else than a browser

Differential Revision: https://phabricator.services.mozilla.com/D78016
2020-06-04 18:31:54 +00:00
Tarek Ziadé 9bcf786abb Bug 1643621 - add moz.build r=Bebe
forgot to add this file, so mozperftest docs are added in the sphinx sparse profile

Differential Revision: https://phabricator.services.mozilla.com/D78465
2020-06-05 09:46:15 +00:00
Mitchell Hentges a8304147a8 Bug 1643158: remove mozboot/util.py dependency on six r=rstewart
bootstrap.py depends on mozboot/util.py, but bootstrap needs to run in a bare environment without `six`.

Differential Revision: https://phabricator.services.mozilla.com/D78352
2020-06-04 18:59:51 +00:00
Valentin Gosu 9e9b45920a Bug 1643370 - Add POP!_OS to supported debian distros r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D78316
2020-06-04 15:45:15 +00:00
Andi-Bogdan Postelnicu affacf5510 Bug 1639406 - for `code-review` generate the propper patch when dealing with `clang-format` issues. r=marco
Differential Revision: https://phabricator.services.mozilla.com/D78060
2020-06-04 08:53:02 +00:00
emcminn de56c3d325 Bug 1637617 - Adjusted message margins to prevent panel closing; added panel header to main view panel & updated fluent strings r=andreio,fluent-reviewers,flod
Differential Revision: https://phabricator.services.mozilla.com/D76162
2020-06-03 18:25:02 +00:00
John Paul Adrian Glaubitz e1b5790f4d Bug 1325771 - build: Add m68k as target architecture to mozbuild r=glandium
Adds the basic definitions for m68k to mozbuild, allowing to build Spidermonkey.

Differential Revision: https://phabricator.services.mozilla.com/D77285
2020-06-03 18:30:50 +00:00
Ricky Stewart 1914a51fc8 Bug 1643026 - Squash stray reference to deleted global variable in virtualenv.py r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D78069
2020-06-03 17:23:30 +00:00
Mitchell Hentges 651dec64b7 Bug 1632429: Makes mozrelease compatible with python 3 r=aki
Differential Revision: https://phabricator.services.mozilla.com/D77962
2020-06-03 18:16:09 +00:00
Ed Lee 96ed60b4bd Bug 1641863 - Upgrade Node 10.x (in preparation for ESR 78) r=Standard8. CLOSED TREE
Node v10.21.0 (LTS) just released https://nodejs.org/en/blog/release/v10.21.0/

Differential Revision: https://phabricator.services.mozilla.com/D77904
2020-06-03 18:00:52 +00:00
Tom Prince 9eac413f54 Bug 1642446: Add an attribute to annotate toolchain tasks used by `mach bootstrap`; r=firefox-build-system-reviewers,rstewart
Toolchains that are used for local development need to be built on a level-3
branch to installable via `mach bootstrap`. Add an attribute to track the fact
that a toolchain is used that way, and:
- ensure that everything installed via `mach boostrap` has that attribute set
- ensure that everything with that attribute set is built on trunk projects

We could additionally verify that attribute is only set on things used by
bootstrap, but bootstrap doesn't currently have an exhaustive list of things
that it might install, making that difficult.

Differential Revision: https://phabricator.services.mozilla.com/D77706
2020-06-03 15:55:26 +00:00
Dorel Luca 0154691eae Backed out 5 changesets (bug 1325771) for Spidermonkey failures and build bustage in build/src/mfbt/tests/TestCompactPair.cpp. CLOSED TREE
Backed out changeset ace40545b46c (bug 1325771)
Backed out changeset b3e0fb410a1c (bug 1325771)
Backed out changeset d69ac62c063f (bug 1325771)
Backed out changeset 24e6299e112d (bug 1325771)
Backed out changeset 393a6ff847ce (bug 1325771)
2020-06-03 20:23:08 +03:00
John Paul Adrian Glaubitz 25481ca65b Bug 1325771 - build: Add m68k as target architecture to mozbuild r=glandium
Adds the basic definitions for m68k to mozbuild, allowing to build Spidermonkey.

Differential Revision: https://phabricator.services.mozilla.com/D77285
2020-06-02 07:00:48 +00:00
xuanqi xu 33b538ca48 Bug 1636534 - Added test for notebook layer and perftestnotebook. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D77386
2020-06-02 21:35:03 +00:00
xuanqi xu 2b9bf62319 Bug 1636534 - Separate perftestetl from perftestnotebook r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D75684
2020-06-02 21:34:49 +00:00
Tarek Ziadé 7c486e2ce0 Bug 1641834 - started a Sphinx doc r=sparky,acreskey
Initial Sphinx structure with minimal content.
This is mostly to get started in writing doc

Differential Revision: https://phabricator.services.mozilla.com/D77440
2020-06-03 08:17:06 +00:00
Bogdan Tara 979c77d94e Backed out changeset 83ee79caab92 (bug 1622963) for python related bustages CLOSED TREE 2020-06-03 10:23:57 +03:00
Mike Hommey 323ea73e5a Bug 1622963 - Require python 3.6 for the build system. r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D77754
2020-06-03 02:16:48 +00:00
Tom Prince 581eba974b Bug 1641971: Pass `mach perftest` options explicitly, rather than inpsect parameters; r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D77548
2020-06-03 02:35:09 +00:00
Narcis Beleuzu 479c45bbea Backed out 7 changesets (bug 1641971) for breaking Gecko Decision Task opt . CLOSED TREE
Backed out changeset a039e60a26d2 (bug 1641971)
Backed out changeset e7d4c490c31a (bug 1641971)
Backed out changeset f2322981b294 (bug 1641971)
Backed out changeset d123b08d2c20 (bug 1641971)
Backed out changeset 57772c0b9b3e (bug 1641971)
Backed out changeset 11a887f73dbb (bug 1641971)
Backed out changeset e9c7a59d4bc5 (bug 1641971)
2020-06-03 05:30:51 +03:00
Tom Prince 11aedca9b2 Bug 1641971: Pass `mach perftest` options explicitly, rather than inpsect parameters; r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D77548
2020-06-02 18:23:07 +00:00
Andy Grover 95b90fb23e Bug 1633006 - Update to Neqo 0.4.0 r=dragana,necko-reviewers
Document qlog uses 2 clause bsd license.

Adapt to API changes in glue and http3server

Differential Revision: https://phabricator.services.mozilla.com/D77903
2020-06-02 21:28:31 +00:00
Riley Byrd ad82a96dad Bug 1518234 - Migrate migration wizard to Fluent r=flod,Gijs,fluent-reviewers
Based on a patch originally written by Ian Kirkpatrick <kirkpa47@msu.edu>

Differential Revision: https://phabricator.services.mozilla.com/D17393
2020-06-02 06:46:09 +00:00
Ricky Stewart d2861db731 Bug 1642439 - Fix test_error_output.py r=froydnj
These variables were renamed in bug 1641992, and furthermore they were changed to "templates" (with inline `%s` for string formatting), so fix the tests with that in mind.

Differential Revision: https://phabricator.services.mozilla.com/D77697
2020-06-01 19:33:29 +00:00
Emily McDonough c6e4f99f13 Bug 1642040 - Add VoidLinux support to mach bootstrap r=rstewart
Differential Revision: https://phabricator.services.mozilla.com/D77571
2020-06-01 19:37:06 +00:00
Ricky Stewart 7ed5e2165a Bug 1642418 - Fix mach completion unit test by updating bad conditional r=froydnj
I misinterpreted one of the conditionals when working on bug 1641991 (the "not X or Y" formulation confused me :( ). The correct fix here is to remove this conditional which isn't relevant any more after we removed all the old pre-`mochitest` mach commands.

Differential Revision: https://phabricator.services.mozilla.com/D77692
2020-06-01 18:59:46 +00:00
Ricky Stewart 7bee84802f Bug 1641992 - Add argument to `mach busted file` to specify which component the bug should be filed against r=froydnj
With the addition of this change, a lone `mach busted file` will throw an error (since this should only ever be used by actual humans, and not in automation or anything, the backwards-compatibility breakage isn't a huge deal). Now it's expected to pass in `mach busted file $COMMAND`, where $COMMAND is the mach command that you were running when the error occurred, and we'll figure out which bugzilla component to file the bug against for you instead of directing it to `Firefox Build System :: General` regardless of whether the issue has *anything* to do with the build system. We preserve `mach busted file general` as a backup command that doesn't do any of this heavy logic.

Differential Revision: https://phabricator.services.mozilla.com/D77538
2020-06-01 16:23:48 +00:00
Ricky Stewart 7f3fa0551b Bug 1641991 - Remove deprecated mochitest mach commands r=ahal
These commands were removed 5 years ago (with the exception of robocop, which was removed about a year ago). We're way past the point where anyone would glean useful info from keeping the stubs here with an error message.

Differential Revision: https://phabricator.services.mozilla.com/D77536
2020-05-29 20:43:05 +00:00
Ricky Stewart 0bbaac721b Bug 1641693 - Replace a bunch of uses of `GENERATED_FILES` with the `GeneratedFile` template r=necko-reviewers,geckoview-reviewers,aklotz,dragana,froydnj
Also update documentation to suggest using the `GeneratedFile` template rather than directly referencing `GENERATED_FILES` where possible.

Differential Revision: https://phabricator.services.mozilla.com/D77496
2020-06-01 16:00:28 +00:00
Mike Hommey 9088528947 Bug 1635764 - Move --with-system-icu and --with-intl-api to python configure. r=firefox-build-system-reviewers,rstewart
At the same time, because it's now simpler to do so, set the right data
file name for big-endians, even though we don't have or produce it
(bug #1264836). Also remove USE_ICU, which is redundant with
JS_HAS_INTL_API, and actively break the build at configure time when
using --without-intl-api with Firefox because this hasn't actually
worked for close to 3 years (since bug 1402048).

Differential Revision: https://phabricator.services.mozilla.com/D77416
2020-05-29 21:29:52 +00:00
Mitchell Hentges 811fbf178f Bug 1640064: Don't attempt to install python-pip (py2) on Debian Sid r=rstewart
Differential Revision: https://phabricator.services.mozilla.com/D77517
2020-05-29 20:17:40 +00:00
Mitchell Hentges 1b525e3c0c Bug 1640815: Raise helpful error if no non-public commits on bootstrap r=rstewart
Differential Revision: https://phabricator.services.mozilla.com/D77505
2020-05-29 18:35:35 +00:00
Ricky Stewart 7a15c311ac Bug 1639313 - Print usage if you call a bare `mach vendor`, `mach cargo`, or `mach remote` r=remote-protocol-reviewers,froydnj,whimboo
The architecture of `mach` does not make this easy to do from within one process, not least of all due to persistent global, mutable state. :( There may be another way to do this, I'm not saying it's completely impossible (and obviously with a significant enough refactor there's a way to make this happen), but subprocessing is a foolproof way to accomplish the same.

Differential Revision: https://phabricator.services.mozilla.com/D77374
2020-05-29 16:16:31 +00:00
Gregory Mierzwinski 55c95e297a Bug 1637994 - Add a transformer for extracting times/durations from logcat logs. r=acreskey,mozperftest-reviewers,tarek
This patch adds a transformer that is capable of extracting times/entries or durations for logcat logs. Here, we also implement the ability for users to pass options to the transformers so that they can be more generic (through transformer-options). The logcat transformer makes use of this, and also shows how a custom function can be used within transformers. A new test file is added for the transformer, as well as a test in test_perfherder.py so we can test the full pipeline.

Differential Revision: https://phabricator.services.mozilla.com/D77094
2020-05-29 12:40:40 +00:00
Gregory Mierzwinski 115d1b4294 Bug 1641566 - Update in-tree browsertime to latest. r=tarek,perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D77257
2020-05-29 12:24:33 +00:00
Tarek Ziadé 3c6bbe84ba Bug 1641549 - Run the metrics layer separately r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D77292
2020-05-29 12:21:52 +00:00
Tarek Ziadé 77da205d14 Bug 1640627 - added android logs options r=sparky
--android-capture-logcat  - captures the logcat
--android-clear-logcat - clears the logcat on start
--android-capture-adb - captures the adb commands

Differential Revision: https://phabricator.services.mozilla.com/D77038
2020-05-28 16:42:37 +00:00
Nils Ohlmeier [:drno] 18ef0cb66a Bug 1641289: Bye, bye Steeplechase. r=dminor,froydnj
Differential Revision: https://phabricator.services.mozilla.com/D77114
2020-05-29 03:19:27 +00:00
Ricky Stewart d620b9e6a6 Bug 1641242 - Handle difference in API of ImportError between py2 and py3 in artifact_commands.py r=catlee
Differential Revision: https://phabricator.services.mozilla.com/D77337
2020-05-28 20:33:03 +00:00
Axel Hecht 1343d506c0 Bug 1641184, use only the merge dir for repacks, r=nalexander
l10n-merge creates a full merge dir for a while now, let's
simplify the build logic to only read from that directory
during repacks and langpacks.

Differential Revision: https://phabricator.services.mozilla.com/D77023
2020-05-27 17:04:06 +00:00
Tarek Ziadé c0c06d6f1f Bug 1641351 - raise on node error in BT r=acreskey
We forgot to check that the node command succeeded.
This patch fixes it.

Differential Revision: https://phabricator.services.mozilla.com/D77148
2020-05-27 21:43:38 +00:00
Geoff Brown 21053c0624 Bug 1638965 - Run 'mach gtest' in python 3; r=bc
Differential Revision: https://phabricator.services.mozilla.com/D77092
2020-05-27 20:53:22 +00:00
Artem 30dba11bdd Bug 1609556 - Migrate toolbar-context-menu to Fluent r=Gijs,fluent-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D76016
2020-05-27 18:09:40 +00:00
Mitchell Hentges 0482fe58ed Bug 1641073: improve BaseFile.copy() performance r=rstewart
Arrays are mutable, so appending each substring at a time and joining at the endis much faster than re-allocating
a new string on each loop.

Differential Revision: https://phabricator.services.mozilla.com/D76945
2020-05-27 16:52:51 +00:00
Ricky Stewart 1d10fc6783 Bug 1639624 - Don't import from `distutils` unless absolutely necessary in virtualenv.py r=froydnj
Similar reasoning to bug 1638780.

Differential Revision: https://phabricator.services.mozilla.com/D76221
2020-05-27 15:07:47 +00:00
Mike Hommey a97c7ebfe7 Bug 1640578 - Remove --disable-install-strip from mac mozconfigs. r=froydnj
The need for --disable-install-strip in the mac mozconfigs comes from a
discrepancy in how stripping is handled between platforms. On Windows,
there is no stripping. On non-Mac unix, `strip` removes local symbols as
well as debug info and debug symbols. On Mac, it actually removes too
much, and one has to pass flags to remove both local symbols (`-x`) and
debug symbols (`-S`). Debug info is already in a separate file
(`.dSYM`).

For profiling reasons, we do ship e.g. nightlies with local symbols but
not debug info or symbols (or at least that's the intent). On Windows,
again, nothing to do. On non-Mac unix, we pass `--strip-debug` to
`strip` so that it keeps local symbols. That's where the discrepancy
comes in for Mac: the build system doesn't handle this at all, so the
mozconfigs contain --disable-install-strip to avoid stripping.

The build system should be doing what it's expected to be doing from the
start, without mozconfigs opting into anything.

AFAIK, we only really need the local symbols, so we can `strip -S` on
Mac when profiling is enabled, rather than `strip -x -S`. This also
significantly reduces the size of the installer for nightlies.

And while we're here, move the logic out of old-configure and into
python configure.

Differential Revision: https://phabricator.services.mozilla.com/D76789
2020-05-27 01:42:07 +00:00
Andi-Bogdan Postelnicu 622cf2a71a Bug 1640878 - for `clang-tidy` static-analysis keep a deep copy of the checks. r=froydnj
`StaticAnalysisMonitor` uses `clang-tidy` config dictionary in order to
match different options for the checkers that are being used. For this `StaticAnalysisMonitor`
modifies this dictionary. The dictionary not being a deep copy of the original one, the
modifications are echoed in the initial dictionary thus having the potential to lead to
unexpected behavior from `clang-tidy` when generating the checkers list.

Differential Revision: https://phabricator.services.mozilla.com/D76834
2020-05-26 17:23:38 +00:00
egao c37762fb9f Bug 1640716 - correct string substitution in mozbuild/frontend/reader.py r=jmaher
Changes:

Current in-tree code will simply print `{path}` as many times as it reads a path.

This change will ensure that paths that have been read are output to the screen, which is much more useful.

Differential Revision: https://phabricator.services.mozilla.com/D76729
2020-05-26 09:57:17 +00:00
Tarek Ziadé bddb8551ed Bug 1640747 - Add test-level support for handling exceptions while running the tests r=acreskey
This patch adds the `on_exception` hook, that will let developers
drive the runner behavior when a layer fails.

Differential Revision: https://phabricator.services.mozilla.com/D76794
2020-05-26 13:35:00 +00:00