Граф коммитов

6287 Коммитов

Автор SHA1 Сообщение Дата
Andi-Bogdan Postelnicu 992408f681 Bug 1627484 - clang cannot understanding the mixing of double and single quotes. r=botond
Differential Revision: https://phabricator.services.mozilla.com/D70300
2020-08-06 07:54:09 +00:00
Andi-Bogdan Postelnicu 1ead43f591 Bug 1657299 - First step of refactor `static-analysis` integration, making it more modular. r=marco
Add a modular approach for the integration of `static-analysis` module in order
to be able to share components of it with other modules, like the integration of
`clangd` in `vscode` where we need to have access to the configuration of `clang-tidy`
in order to have `in-ide` `static-analysis` messages.
In this initial step we make a separate module for the clang-tidy configuration.

Differential Revision: https://phabricator.services.mozilla.com/D85979
2020-08-06 06:51:16 +00:00
Andi-Bogdan Postelnicu 9e73e83509 Bug 1657301 - Reformat `static-analysis` with `black`. r=sylvestre
# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D85985
2020-08-05 13:32:46 +00:00
Andi-Bogdan Postelnicu 60cc6f8d69 Bug 1656740 - Integrate `clangd` in `vscode` for C++ language support. r=froydnj
In order to have a cross platform ide for C++ language support we've added `clangd`
extenssion and artifact part of `vscode` suite.
To generate the configuration you simply run:
`./mach ide vscode `.

Differential Revision: https://phabricator.services.mozilla.com/D85416
2020-08-06 06:25:17 +00:00
Mike Hommey 7347ccb900 Bug 1657446 - Fix co_lnotab for large offsets in Lint._raise_from. r=nalexander
Contrary to python2, python3 considers the values in cl_lnotab to be signed
integers, so with python3, offsets larger than 127 would be encoded in a way
that would make them wrong, or worse, negative.

Differential Revision: https://phabricator.services.mozilla.com/D86122
2020-08-06 04:07:14 +00:00
Mike Hommey d0d43d8f9b Bug 1657446 - Fix noise when running mozbuild/test/configure/lint.py with unittest.main. r=nalexander
Namely:
  build/moz.configure/old.configure:21: DeprecationWarning: invalid escape sequence \s
  build/moz.configure/old.configure:26: DeprecationWarning: invalid escape sequence \s
  python/mozbuild/mozbuild/configure/__init__.py:433: ResourceWarning: unclosed file <_io.BufferedReader...>
  python/mozbuild/mozbuild/configure/lint.py:120: DeprecationWarning: inspect.getargspec() is deprecated since Python 3.0, use inspect.signature() or inspect.getfullargspec()

Differential Revision: https://phabricator.services.mozilla.com/D86121
2020-08-06 03:19:08 +00:00
Jim Porter 8e234c7598 Bug 1537763 - [mozproxy] Add a record mode; r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D84399
2020-08-05 19:43:55 +00:00
Tom Ritter 66394143e9 Bug 1601690 - Remove gcc as a supported compiler for Windows r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D56046
2020-08-05 18:55:13 +00:00
Tom Prince 4585d70c82 Bug 1657217: Remove unused test binaries; r=firefox-build-system-reviewers,glandium
elfhack is unneeded after Bug 1645842  and filedid after Bug 1619840.

Differential Revision: https://phabricator.services.mozilla.com/D85924
2020-08-05 03:59:51 +00:00
Cosmin Sabou 12db94501a Backed out changeset 3dba9cbe665b (bug 1657217) for mass failures on windows. CLOSED TREE 2020-08-05 04:59:20 +03:00
Bogdan Tara abfa3262b8 Backed out changeset 1ccda1d0c3ea (bug 1650363) for causing a serious regression in packaging time 2020-08-05 04:23:20 +03:00
Tom Prince c8dfe8b2b0 Bug 1657217: Remove unused test binaries; r=firefox-build-system-reviewers,glandium
`elfhack` is unneeded after Bug 1645842 and `fileid` after Bug 1619840.

Differential Revision: https://phabricator.services.mozilla.com/D85924
2020-08-05 01:09:27 +00:00
Ricky Stewart 5bca67c689 Bug 1657198 - Delete broken tests in `test_telemetry.py` r=dmajor
These tests depend on the `mach uuid` command which was deleted with bug 1639509, and now that `mach uuid` is gone it's broken unconditionally. We could replace the reference to `uuid` with a new no-op `mach` command, but we're in the process of replacing our telemetry code with use of the `glean` API; and the new telemetry code won't have the same semantics (namely, we are unlikely to want to continue to guarantee that sub-`mach` invocations aren't covered by telemetry), so this test might as well just be deleted now.

Differential Revision: https://phabricator.services.mozilla.com/D85911
2020-08-04 20:03:01 +00:00
Hamzah b7e6b41fc5 Bug 1594914 - Convert mach python-test to run with python 3 r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D77872
2020-08-04 17:40:58 +00:00
Yue Zhang cb36d08ccc Bug 1630611 - Remove the nested helper function in the flat() function. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D85677
2020-08-04 17:15:40 +00:00
Sylvestre Ledru d61fa8949f Bug 1656764 - Relax the version check for clang-format r=andi DONTBUILD
So that it works when CLANG_VENDOR is set

Differential Revision: https://phabricator.services.mozilla.com/D85687
2020-08-03 12:41:15 +00:00
Tarek Ziadé 03cbd4d536 Bug 1650363 - Performance testing of HTTP3 in Firefox using only xpcshell tests r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D84021
2020-08-02 17:28:57 +00:00
Gregory Mierzwinski a4e1ebe204 Bug 1656540 - Allow specifying perfherder settings on a per-metric basis. r=tarek
This patch fixes an issue where the metric settings were not being used because they don't use the test name. It also handles some changes (from a bad copy-paste) that didn't make it into the last live-site patch series.

Differential Revision: https://phabricator.services.mozilla.com/D85609
2020-08-01 16:13:28 +00:00
Mike Hommey 38cc2e0609 Bug 1654994 - Switch full symbols archive to tar.zst. r=firefox-build-system-reviewers,rstewart,tomprince
Differential Revision: https://phabricator.services.mozilla.com/D85252
2020-07-31 20:27:54 +00:00
Mike Hommey 36a8aaf1b4 Bug 1654994 - Support using .tar.zst symbol archives in mach artifact. r=nalexander,firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D85249
2020-07-31 10:01:52 +00:00
Mike Hommey 557b6e2811 Bug 1654994 - Support creating .tar.zst archives instead of .zip for symbol archives. r=firefox-build-system-reviewers,rstewart,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D85248
2020-08-01 05:33:05 +00:00
Mitchell Hentges d0ec90c4d5 Bug 1654074: Make @CommandProvider validation more specific r=firefox-build-system-reviewers,rstewart
@CommandProvider does parameter validation and collects information (such
as "pass_context") that will be needed by Registrar.

However, rather than just checking parameter length, we can make it more
specific and assert that the specific expected parameter ("context") exists.

Differential Revision: https://phabricator.services.mozilla.com/D85482
2020-07-30 22:25:05 +00:00
Yue Zhang 210c0b2307 Bug 1635930 - Activate a layer when its options are used. r=sparky,tarek
Differential Revision: https://phabricator.services.mozilla.com/D83551
2020-07-31 17:23:51 +00:00
Gregory Mierzwinski ee2aa57e5c Bug 1655031 - Fix how mozperftest metrics are parsed. r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D85318
2020-07-31 15:33:12 +00:00
Gregory Mierzwinski d93acb6b75 Bug 1655032 - Add splitting functionality to metrics module. r=tarek
This patch adds the `--<LAYER>-split-by` option to the metric layers. It allows users to split the data they obtain using a given data field name. For instance, if `browserScripts.pageinfo.url` is provided, then the data will be split based on the unique URLs that are found.

Differential Revision: https://phabricator.services.mozilla.com/D84822
2020-07-30 23:12:28 +00:00
Dorel Luca 0226b8feef Backed out 6 changesets (bug 1654994) for build bustage on fuzzy builds. DONTBUILD
Backed out changeset cd3e1074b785 (bug 1654994)
Backed out changeset 45ee50e76d61 (bug 1654994)
Backed out changeset 77f1b667baec (bug 1654994)
Backed out changeset 9fca8b0bf8c1 (bug 1654994)
Backed out changeset 7131943d8db9 (bug 1654994)
Backed out changeset 435b90f6ca70 (bug 1654994)
2020-07-31 12:36:14 +03:00
Mike Hommey 311e167747 Bug 1654994 - Switch full symbols archive to tar.zst. r=firefox-build-system-reviewers,rstewart,tomprince
Differential Revision: https://phabricator.services.mozilla.com/D85252
2020-07-30 22:21:28 +00:00
Mike Hommey 1bf0ac0aca Bug 1654994 - Support using .tar.zst symbol archives in mach artifact. r=nalexander,firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D85249
2020-07-30 15:53:26 +00:00
Mike Hommey ddea6bd3ce Bug 1654994 - Support creating .tar.zst archives instead of .zip for symbol archives. r=firefox-build-system-reviewers,rstewart,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D85248
2020-07-30 15:52:51 +00:00
Mitchell Hentges d3dfb78af4 Bug 1656303: Only print $A_SPECIFIC_TARGET warning if one of the targets is not in the allowlist r=firefox-build-system-reviewers,rstewart
The "what" value contains a list of build targets, the warning should be printed if any one of the targets is unexpected.

Differential Revision: https://phabricator.services.mozilla.com/D85462
2020-07-30 19:38:42 +00:00
Mike Hommey f70f000a4f Bug 1614626 - Move xpcshell selftests to before running actual xpcshell tests. r=gbrown
This allows to test them in the exact same environment as the tests are
going to run, which turns out to have revealed a few issues that would
only appear once xpcshell tests fail, impeding on debugging those
failures.

Differential Revision: https://phabricator.services.mozilla.com/D84781
2020-07-30 20:27:14 +00:00
Ricky Stewart 63f010c613 Bug 1646406 - Distinguish between user errors and actual reportable exceptions in `mach` r=mhentges,froydnj
Add a new `UserError` class which when thrown doesn't get reported to Sentry.

Differential Revision: https://phabricator.services.mozilla.com/D85026
2020-07-29 21:34:17 +00:00
Tarek Ziadé cb00bce720 Bug 1655956 - removed unused perf tuning code r=sparky
Removes unused API and add missing coverage

Differential Revision: https://phabricator.services.mozilla.com/D85285
2020-07-29 17:35:35 +00:00
Csoregi Natalia b0e102995f Backed out 2 changesets (bug 1646406, bug 1655529) for geckoview failures. CLOSED TREE
Backed out changeset 0630f4154c62 (bug 1655529)
Backed out changeset 18d42084d135 (bug 1646406)
2020-07-30 00:28:59 +03:00
Ricky Stewart ffd5064859 Bug 1646406 - Distinguish between user errors and actual reportable exceptions in `mach` r=mhentges,froydnj
Add a new `UserError` class which when thrown doesn't get reported to Sentry.

Differential Revision: https://phabricator.services.mozilla.com/D85026
2020-07-29 19:34:24 +00:00
Dorel Luca c24650c12a Backed out changeset 929e1acc42af (bug 1614626) for XPCshell failures in extensions/test/xpcshell/test_ext_dns.js. CLOSED TREE 2020-07-29 07:37:28 +03:00
Mike Hommey efebeaa2c6 Bug 1614626 - Move xpcshell selftests to before running actual xpcshell tests. r=gbrown
This allows to test them in the exact same environment as the tests are
going to run, which turns out to have revealed a few issues that would
only appear once xpcshell tests fail, impeding on debugging those
failures.

Differential Revision: https://phabricator.services.mozilla.com/D84781
2020-07-29 00:23:03 +00:00
Andrew Halberstadt cc0b1f8e5f Bug 985141 - [mozperftest] Fix missed instances of _activate_virtualenv in mozperftest framework, r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D85203
2020-07-28 20:54:58 +00:00
Andrew Halberstadt bef34ebc4b Bug 1408051 - Backed out changeset 7864e0d0295f
This change had a few regressions that will be easier to fix without the pressure of time.

Differential Revision: https://phabricator.services.mozilla.com/D85193
2020-07-28 19:04:53 +00:00
Ricky Stewart da3fe81bea Bug 1655781- Allow specifying that certain packages should only be included in a `virtualenv` when parsing `virtualenv_packages.txt` r=chutten,nalexander
This solves the same problem we attempted to solve in bug 1654663. That was a low-cost, sensible solution when there was only one in-build reference to `glean_parser`, but with project FOG we're about to drastically increase the in-build reliance on the library, so the ad-hoc `sys.path` manipulation is an increasingly insensible solution. Here we address this in a first-class way by specifying that `glean_parser` should be imported in `virtualenv`s, but NOT by top-level `mach` commands that run outside of an in-`objdir` `virtualenv`.

Differential Revision: https://phabricator.services.mozilla.com/D85182
2020-07-28 18:29:55 +00:00
Andrew Halberstadt d0fbcca0b6 Bug 985141 - [mozbuild] Remove leading underscore from MozbuildObject._activate_virtualenv, r=firefox-build-system-reviewers,perftest-reviewers,andi,AlexandruIonescu,rstewart
This function is used all across the tree and should be considered a public API.

Differential Revision: https://phabricator.services.mozilla.com/D85045
2020-07-28 16:06:10 +00:00
Philip Chimento c936b44447 Bug 1653560 - Fix distutils.spawn import. r=andi
Differential Revision: https://phabricator.services.mozilla.com/D84023
2020-07-28 14:54:32 +00:00
Andi-Bogdan Postelnicu f2a6f56b99 Bug 1655701 - for Coverity static-analysis do not relay on ensure exit code. r=marco
Differential Revision: https://phabricator.services.mozilla.com/D85133
2020-07-28 12:52:17 +00:00
Mike Hommey 2a4eb30ed4 Bug 1654465 - Set -Cembed-bitcode=yes instead of CARGO_PROFILE_RELEASE_LTO. r=firefox-build-system-reviewers,rstewart
It turns out setting CARGO_PROFILE_RELEASE_LTO has unwanted side
effects.

First it's not actually strictly equivalent to using `cargo rustc --
-Clto`. For instance, it apparently also enables cross-language LTO in
newer versions of cargo.

Second, it changes the rust computed hash for all the dependencies of
the crate being built with the variable set, which makes them diverge
from when the same dependencies are built through another crate in the
tree that is not LTOed. This effectively makes us build a _lot_ of
crates twice, many of which are not cacheable.

Since the original problem is that cargo >= 1.45 passes extra flags (`-C
embed-bitcode=no`) to rustc that are incompatible with `-Clto`, and while
it knows to adjust based on the `lto` setting in the build profile
(which CARGO_PROFILE_RELEASE_LTO overrides the default of), cargo
ignores flags passed via `cargo rustc -- ...` when making those
adjustments.

So, we need to override with `-C embed-bitcode=yes` on our own at the
same time we pass `-Clto`. But doing that through `cargo rustc -- ...`
is not enough because all the dependencies of the crate built with
`-Clto` need to be built with `-C embed-bitcode=yes`. So we need to
override with `RUSTFLAGS`, which will affect all the dependencies.
But we also need to do this consistently across all crates, not only the
dependencies of crates built with `-Clto`, otherwise we'd still end up
building crates twice (once with and once without the override).

Unfortunately, the `-C embed-bitcode=*` flag is also not supported in
versions older than 1.45, so we have to avoid adding it on older
versions.

We unfortunately support a large range of versions of rustc (albeit only
for tools/crashreporter), but we actually need to upgrade the smaller
supported version because rustc < 1.38 doesn't support our top-level
Cargo.lock. This makes the version check slightly less awful.

Differential Revision: https://phabricator.services.mozilla.com/D84652
2020-07-27 21:23:57 +00:00
Ricky Stewart 3e84200ad6 Bug 1655340 - Install `self.packages` in `mozboot/debian.py` r=froydnj
This got trampled in an overzealous code deletion in bug 1647814.

Differential Revision: https://phabricator.services.mozilla.com/D85004
2020-07-27 15:57:16 +00:00
Mike Hommey f8b53d8e93 Bug 1654961 - Re-enable some python tests on py2 on mac. r=dmajor
Bug 1648506 disabled tests that failed on py2 on mac. Some now pass
properly, presumably from more recent changes to
build/moz.configure/init.configure.

Differential Revision: https://phabricator.services.mozilla.com/D84776
2020-07-24 05:40:41 +00:00
Coroiu Cristina 828f2319c0 Backed out changeset 2439a32e1a06 (bug 1654961) for mbu failures 2020-07-24 08:19:33 +03:00
Mike Hommey 29e887fea7 Bug 1654961 - Re-enable some python tests on py2 on mac. r=dmajor
Bug 1648506 disabled tests that failed on py2 on mac. They now pass
properly, presumably from more recent changes to
build/moz.configure/init.configure.

Differential Revision: https://phabricator.services.mozilla.com/D84776
2020-07-24 04:19:51 +00:00
Tom Prince 97a298b135 Bug 1652503: [mozlint] Use `attrs` for `mozlint.result.Issue`; r=ahal
This gives sorting on `Issue` for free, which makes it easier to write tests
for linters.

Differential Revision: https://phabricator.services.mozilla.com/D84643
2020-07-23 14:55:45 +00:00
Andrew Creskey c6c9bc4f6f Bug 1648857 - Add applink perftest for the reference browser r=tarek,sparky
The Reference Browser represents our tech stack up to and including the Android-Components layer.
It would be useful to have an applink startup test for this browser to detect improvements and regressions.

Differential Revision: https://phabricator.services.mozilla.com/D81407
2020-07-23 14:11:38 +00:00