Граф коммитов

316 Коммитов

Автор SHA1 Сообщение Дата
Johan Lorenzo 28609ba87e Bug 1776642 - part 3: Bump virtualenv from 20.7.2 to 20.15.0 in order to run `mach boostrap` on Python 3.10 under macOS r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D150967
2022-07-08 15:58:06 +00:00
Johan Lorenzo ba74d141f7 Bug 1776642 - part 1: Bump jsmin to 3.0.0 to fix incompatibility with setuptools>=58 r=jcristau
https://github.com/tikitu/jsmin/issues/33

Differential Revision: https://phabricator.services.mozilla.com/D150968
2022-07-08 15:58:05 +00:00
Iulian Moraru 7d097875df Backed out changeset 59a5d52a3d71 (bug 1774569) for causing py3 failures. CLOSED TREE 2022-06-30 19:17:03 +03:00
Alex Hochheiden cf9344f637 Bug 1774569 - Vendor `packaging` at version 21.3 to remove `distutils` dependency r=firefox-build-system-reviewers,glandium
https://pypi.org/project/packaging/21.3/

Differential Revision: https://phabricator.services.mozilla.com/D149679
2022-06-30 14:28:59 +00:00
Csoregi Natalia b8e4820ca9 Backed out changeset 100ff469d56b (bug 1776642) for causing failures on test_site_compatibility.py. CLOSED TREE 2022-06-30 17:24:28 +03:00
Johan Lorenzo be05f1a775 Bug 1776642 - Bump virtualenv from 20.7.2 to 20.15.0 in order to run `mach boostrap` on Python 3.10 under macOS r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D150741
2022-06-30 10:18:58 +00:00
Andrew Halberstadt 5cb6993eca Bug 1775521 - Update vendored taskgraph to 1.7.1, r=releng-reviewers,gabriel
Differential Revision: https://phabricator.services.mozilla.com/D150160
2022-06-23 21:07:03 +00:00
Cristian Tuns 6d0ba065e3 Backed out changeset e863269355cd (bug 1774834) for causing python failures on test_vendor.py CLOSED TREE 2022-06-22 07:14:59 -04:00
Gabriel Bustamante 644787d34b Bug 1774834 - Use vendored treeherder util r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D149441
2022-06-21 20:22:56 +00:00
Narcis Beleuzu 04a73f74c6 Backed out changeset a372108ad727 (bug 1774834) for build bustages. CLOSED TREE 2022-06-21 19:33:13 +03:00
Gabriel Bustamante abe57a47d4 Bug 1774834 - Use vendored treeherder util r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D149441
2022-06-21 16:18:23 +00:00
Jan-Erik Rediger 51f960bd09 Bug 1773255 - Update to Glean v50.1.0 r=chutten,supply-chain-reviewers
Including glean_parser 6.1.1

Two important things in there:
* glean_parser: [data-review] Include extra keys' names and descriptions in data review template
* Glean: Derive `serde::{Deserialize, Serialize}` on `Lifetime` and `CommonMetricData`

Differential Revision: https://phabricator.services.mozilla.com/D149381
2022-06-15 15:39:33 +00:00
Jan-Erik Rediger 8182bee632 Bug 1768834 - Switch to Glean with UniFFI integration r=glandium,chutten
Upgrades to Glean v50.0.1, which comes with a rewritten core and
UniFFI-powered bindings.
Glean has some API changes, so we swap it over to that. Mostly mechanical changes.
Also upgrades to inherent v1.0 in fog.
This matches what Glean uses internally and gets rid of one duplicated crate.

Also upgrades to glean-parser==6.0.1

One crate duplication now (change in `python/mozbuild/mozbuild/vendor/vendor_rust.py` required).
Some new crates now vendored.
These are transitive dependencies of Glean dependencies, all with valid
licenses and already used in other products (mobile).

Differential Revision: https://phabricator.services.mozilla.com/D146062
2022-06-07 12:37:20 +00:00
Andrew Halberstadt a4e3dd8c6a Bug 1748929 - Upgrade taskgraph to version 1.4.0, r=releng-reviewers,jcristau
Differential Revision: https://phabricator.services.mozilla.com/D144622
2022-04-26 13:17:48 +00:00
Mike Hommey 8937b90c26 Bug 1289641 - Vendor the vsdownload script. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D143125
2022-04-12 22:52:53 +00:00
Butkovits Atila 59ebe1ff72 Backed out 7 changesets (bug 1289641) for causing Python failures. CLOSED TREE
Backed out changeset 0c1cedebf915 (bug 1289641)
Backed out changeset 575732020bd2 (bug 1289641)
Backed out changeset 55b68a71e03a (bug 1289641)
Backed out changeset 0b16a05aa405 (bug 1289641)
Backed out changeset acbff13b91b3 (bug 1289641)
Backed out changeset 2645367da7cb (bug 1289641)
Backed out changeset 8b22a8ec44fe (bug 1289641)
2022-04-12 22:23:27 +03:00
Mike Hommey bd90bf1f39 Bug 1289641 - Vendor the vsdownload script. r=firefox-build-system-reviewers,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D143125
2022-04-11 23:00:08 +00:00
Mitchell Hentges 09af1e78c9 Bug 1659593: Make `./mach vendor python` cross-platform r=ahal
Use `poetry` instead of `pip-compile`, then leverage `pip` to assert
that there's no conflicts between environments.

This enables simplifying `requirements.in`, since `colorama` is now
automatically picked up, as vendoring is no longer linux-py3.6-specific.

`poetry==1.2.0a2` was chosen because it was the first version that would
include `pip`/`setuptools`/`wheel` in the `requirements.txt`, yet it was
also the last version that supports Python 3.6 (as still used in CI in
some spots).

Sorry about the `requirements.txt` noise, that's because poetry doesn't
sort hashes yet [1]. Fortunately, you can be confident in
`requirements.txt` changes by checking that this patch doesn't include
changes to vendored packages themselves (I'm including the results of a
`./mach vendor python`).

[1] https://github.com/python-poetry/poetry/issues/5408

Differential Revision: https://phabricator.services.mozilla.com/D142884
2022-04-07 18:00:28 +00:00
Mitchell Hentges 451b086ce4 Bug 1724274: Downgrade vendored packages for poetry compatibility r=ahal
`importlib_metadata` and `packaging` need to be older versions to be
compatible with the modern version of `poetry`.

Differential Revision: https://phabricator.services.mozilla.com/D141675
2022-03-24 14:04:34 +00:00
Andrew Halberstadt 044c8ee19e Bug 1748926 - Update vendored taskgraph to 1.2.0, r=releng-reviewers,gbrown
Differential Revision: https://phabricator.services.mozilla.com/D140734
2022-03-10 16:40:33 +00:00
Andrew Halberstadt 924c639fe2 Bug 1755569 - Update vendored taskgraph to 1.1.7, r=releng-reviewers,gbrown
Differential Revision: https://phabricator.services.mozilla.com/D139157
2022-02-18 20:40:08 +00:00
Mitchell Hentges e2438c91d3 Bug 1732795: Install `coverage` using pip r=ahal
`coverage` has native code, so the vendored version was only used as
source code from which the actual package could be built.
Since its always used in a context where we can `pip install` over the
network, let's do that. This cleans up our tree a bit and allows us to
leverage the `coverage` wheels.

Differential Revision: https://phabricator.services.mozilla.com/D138816
2022-02-18 14:27:18 +00:00
Kelsey Gilbert ad3bea591a Bug 1755093 - Support repo_url with no slash. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D138609
2022-02-15 17:46:59 +00:00
Thomas Wisniewski 1e356203e9 Bug 1715900 - Bump urllib3 to version 1.26.0, boto3 to 1.16.63, and botocore to 1.19.63; r=mhentges
Differential Revision: https://phabricator.services.mozilla.com/D138383
2022-02-15 15:07:18 +00:00
Jan-Erik Rediger c6eac14b6e Bug 1754474 - Update to Glean 44.0.0 and glean_parser 5.0.1. r=janerik
Differential Revision: https://phabricator.services.mozilla.com/D138446
2022-02-15 13:35:07 +00:00
Butkovits Atila 298b987a56 Backed out 3 changesets (bug 1715900) for causing Python failures. CLOSED TREE
Backed out changeset c1bad2dbd960 (bug 1715900)
Backed out changeset 2355ea418b97 (bug 1715900)
Backed out changeset 11c95163a2f6 (bug 1715900)
2022-02-11 20:41:49 +02:00
Thomas Wisniewski dc66b2caf1 Bug 1715900 - Bump urllib3 to version 1.26.0; r=mhentges
Differential Revision: https://phabricator.services.mozilla.com/D138383
2022-02-11 17:27:44 +00:00
Marian-Vasile Laza 013d79e7e6 Backed out 4 changesets (bug 1754474) for causing bc test failures. CLOSED TREE
Backed out changeset c6dd8b681aca (bug 1754474)
Backed out changeset 596955256cc6 (bug 1754474)
Backed out changeset fc692b3c27a2 (bug 1754474)
Backed out changeset 59eb7951a5eb (bug 1754474)
2022-02-11 17:30:03 +02:00
Jan-Erik Rediger 76df6d315f Bug 1754474 - Update to Glean 44.0.0 and glean_parser 5.0.1. r=janerik
Differential Revision: https://phabricator.services.mozilla.com/D138446
2022-02-11 14:27:38 +00:00
Andrew Halberstadt 1005e618d5 Bug 1753460 - Rectify Python vendor mismatch, r=mhentges
Differential Revision: https://phabricator.services.mozilla.com/D137768
2022-02-03 16:32:51 +00:00
Andrew Halberstadt 2c93775452 Bug 1753087 - Update vendored taskgraph to version 1.1.5, r=releng-reviewers,gbrown
Differential Revision: https://phabricator.services.mozilla.com/D137683
2022-02-03 14:27:46 +00:00
Andrew Halberstadt 80e4bcc173 Bug 1753047 - Update vendored taskgraph to 1.1.4, r=releng-reviewers,jcristau
Differential Revision: https://phabricator.services.mozilla.com/D137572
2022-02-02 14:59:00 +00:00
Andrew Halberstadt 72e6ce049b Bug 1746414 - Upgrade `taskcluster-taskgraph` vendor to version 1.1.3, r=releng-reviewers,gbrown
This picks up a change that uses the repo root (when it is able to be detected)
to populate the default parameters. This is needed because there are some Gecko
invocations of `mach taskgraph` that happen outside of the srcdir, so we can't
rely on cwd to find the repository.

Differential Revision: https://phabricator.services.mozilla.com/D136517
2022-01-27 14:45:19 +00:00
Andrew Halberstadt 40d7af88ab Bug 1751474 - Vendor taskcluster-taskgraph==1.1.2 r=jcristau
This picks up a bustage fix that occurs with Python 3.10.

Differential Revision: https://phabricator.services.mozilla.com/D136690
2022-01-24 08:57:18 +00:00
Mitchell Hentges a37e7812d4 Bug 1748737: Bump attrs to be compatible with mochitest r=ahal
A bunch of modern packages (`pytest`, `twisted`, `automat`) all need
`attrs==19.2.0` (or newer).
We _could_ bump `attrs` all the way to the modern `21.4.0` version, but
I'd like to defer that upgrade risk, since there's a
lot of backwards-incompatible changes and deprecations. So, lightly bump
it to `19.2.0`.

As part of bumping it, `pytest` is no longer compatible.
The earliest candidate that seems to be compatible is `pytest` 4.6.6,
which boasts in its release notes that it's resolved some deprecation
warnings against `attrs>=19.2.0`.

Once `pytest` was bumped, it needed a newer version of `pluggy`, which
itself has dependencies.
Since we're using hashes in `tox_requirements.txt`, all dependencies
needed to be hashed as well.

Differential Revision: https://phabricator.services.mozilla.com/D135178
2022-01-21 18:21:56 +00:00
Mitchell Hentges 16951ed205 Bug 1750281: Bump `compare-locales` from 8.1.0 to 8.2.1 r=eemeli
Resolves race condition on creating parent directories when
run in parallel.

Differential Revision: https://phabricator.services.mozilla.com/D136278
2022-01-18 23:33:13 +00:00
Jan-Erik Rediger 8d108a59d0 Bug 1750544 - Upgrade to Glean v43.0.2. r=chutten
Differential Revision: https://phabricator.services.mozilla.com/D136138
2022-01-17 16:26:33 +00:00
Iulian Moraru 628f85c6c4 Backed out changeset 65842984903e (bug 1748737) for causing multiple py3 failures. CLOSED TREE 2022-01-06 09:31:20 +02:00
Mitchell Hentges a090c80922 Bug 1748737: Bump attrs to be compatible with new pytest r=ahal
A bunch of modern packages (`pytest`, `twisted`, `automat`) all need `attrs==19.2.0` (or newer).
We _could_ bump `attrs` all the way to the modern `21.4.0` version, but I'd like to defer that upgrade risk, since there's a
lot of backwards-incompatible changes and deprecations. So, lightly bump it to `19.2.0`.

Differential Revision: https://phabricator.services.mozilla.com/D135178
2022-01-06 05:08:25 +00:00
Andrew Halberstadt 20f9d435c9 Bug 1746414 - Upgrade `taskcluster-taskgraph` vendor to version 1.1.0, r=taskgraph-reviewers,jmaher
This is needed to pick up new functionality around setting parameter defaults
via `extend_parameter_schema`.

Depends on D134514

Differential Revision: https://phabricator.services.mozilla.com/D134967
2022-01-04 21:51:28 +00:00
Jan-Erik Rediger 1496adf625 Bug 1744674 - Update to Glean v42.3.0 & glean_parser v4.3.1 r=chutten
Also updates the docs on how to update the glean_parser in-tree.
Also adds a `no_lint` exception to test pings to avoid breaking the
build.

Differential Revision: https://phabricator.services.mozilla.com/D133077
2021-12-13 11:24:50 +00:00
Narcis Beleuzu 0bb26c9eda Backed out changeset 7ca282be411f (bug 1744674) for python failures on test_site_compatibility.py. CLOSED TREE 2021-12-11 01:08:45 +02:00
Jan-Erik Rediger efb09bcdb5 Bug 1744674 - Update to Glean v42.3.0 & glean_parser v4.3.1 r=chutten
Also updates the docs on how to update the glean_parser in-tree.
Also adds a `no_lint` exception to test pings to avoid breaking the
build.

Differential Revision: https://phabricator.services.mozilla.com/D133077
2021-12-09 09:30:20 +00:00
Mitchell Hentges b61d7dd71f Bug 1732946: Update vendored libraries for `black` compatibility r=ahal
This is needed because `black==21.11b1` requires `click>=7.1.2`
`pathspec<1,>=0.9.0`, and `typing-extensions>=3.10.0.0`.

Differential Revision: https://phabricator.services.mozilla.com/D127163
2021-11-24 15:23:49 +00:00
Butkovits Atila 8625ba46e5 Backed out changeset 6a2e62e9cc99 (bug 1732946) for causing failures at test_vendor.py. CLOSED TREE 2021-11-24 05:03:12 +02:00
Mitchell Hentges 9e5e6e2e0f Bug 1732946: Update vendored libraries for `black` compatibility r=ahal
This is needed because `black==21.11b1` requires `click>=7.1.2`
`pathspec<1,>=0.9.0`, and `typing-extensions>=3.10.0.0`.

Differential Revision: https://phabricator.services.mozilla.com/D127163
2021-11-23 23:46:33 +00:00
Emilio Cobos Álvarez 4963e6b250 Bug 1739486 - Hack around https://github.com/pypa/virtualenv/issues/2208. r=mhentges
The virutalenv hack is in the fedora-distributed version of
virtualenv... Presumably eventually will become unnecessary once they
provide a proper "venv" distutils?

This patch applies both before and after the bump in comment 5, so your
call.

Differential Revision: https://phabricator.services.mozilla.com/D130410
2021-11-05 15:41:55 +00:00
Alex Hochheiden d7aba7ba43 Bug 1686137 - Vendor 'colorama' library r=mhentges, g?firefox-build-system-reviewers
Colorama enables colored text on terminal windows.

'tqdm' depends on Colorama on Windows.

Project Link: https://pypi.org/project/colorama/

Depends on D129094

Differential Revision: https://phabricator.services.mozilla.com/D130121
2021-11-03 15:41:14 +00:00
Alex Hochheiden 5eab6210dd Bug 1686137 - Vendor 'tqdm' progress bar library r=mhentges
`tqdm` allows rendering and updating a single-line progress bar, which
is useful for all sorts of different work.

Our first use case for this will be replacing `wget` with a pure-python
downloader.

Source here: https://github.com/tqdm/tqdm

Differential Revision: https://phabricator.services.mozilla.com/D129094
2021-11-03 15:41:13 +00:00
Mitchell Hentges 162c7ab422 Bug 1732946: Vendor pip/setuptools/wheel instead of installing into venv r=ahal
Now that are prioritizing system over virtualenv site-packages, the
system `pip` is sometimes being used instead.
This is causing issues when the system pip is set up in a
distro-specific way, such as when "debundled":
https://github.com/pypa/pip/blob/9.0.1/pip/_vendor/__init__.py#L53-L61

However, if we vendor `pip`, `setuptools` and `wheel`, and ensure that
they're prioritized in the `sys.path` before anything is imported from
the system, then we can ensure that we're using a modern `pip` _and_
sidestep system-specific pip weirdness.

Note that `pip-compile`'s `--allow-unsafe` flag is not as dangerous as
it sounds.
There's confusion among maintainers about its origin:
https://github.com/jazzband/pip-tools/issues/522
Additionally, it's going to be enabled by default in a future
`pip-tools` release. So, it's not scary for us to embrace here.

Also, heads up that the "pip outdated warning" no longer needs
to be manually silenced, since pip avoids that code path when
not running from an "installed" context.

Differential Revision: https://phabricator.services.mozilla.com/D127182
2021-11-01 21:34:03 +00:00