Граф коммитов

16 Коммитов

Автор SHA1 Сообщение Дата
Tom Prince f6ec359625 bug 1505652: [taskgraph] Download debian packages from latest run of package task; r=dustin
If a packaging task ended up being retried for any reason, the downstream
docker tasks that depended on them would fail, since they were hard-coding the
artifacts from the initial run.

Differential Revision: https://phabricator.services.mozilla.com/D7364
2018-11-08 19:49:37 +09:00
Mike Hommey ad2fed0601 Backed out 6 changesets (bug 1504906 and bug 1505652) to give time to toolchains and docker images to build without blocking other landings.
Backed out changeset 2fe1e2b7d9c6 (bug 1504906)
Backed out changeset 27b4002951a4 (bug 1504906)
Backed out changeset f7a685b16579 (bug 1504906)
Backed out changeset f8064dbb8009 (bug 1504906)
Backed out changeset f899fbb4a5d7 (bug 1504906)
Backed out changeset 3f71db4aef73 (bug 1505652)
2018-11-08 17:18:05 +09:00
Tom Prince 2449665ce2 bug 1505652: [taskgraph] Download debian packages from latest run of package task; r=dustin
If a packaging task ended up being retried for any reason, the downstream
docker tasks that depended on them would fail, since they were hard-coding the
artifacts from the initial run.

Differential Revision: https://phabricator.services.mozilla.com/D7364
2018-11-08 17:13:19 +09:00
Tom Prince 10ef36f0d7 Bug 1492128: Add `VOLUME` definitions to base debian images; r=gps
For tasks that only need python, the base images are sufficient. The in-tree
code verifies that the caches are setup as volumes in the image being used,
so set the caches in the base images as well.

Differential Revision: https://phabricator.services.mozilla.com/D10148

--HG--
extra : moz-landing-system : lando
2018-10-30 18:26:04 +00:00
Dorel Luca 0b543eb157 Backed out changeset 3a465e6eae7d for Docker image failure. CLOSED TREE
--HG--
extra : amend_source : b4dc5cc9327e41fe822126a4751cdfbe80760133
2018-10-03 00:59:39 +03:00
Tom Prince fb9b7253d5 No bug: [taskgraph] Download debian packages from latest run of package task; r=dustin
If a packaging task ended up being retried for any reason, the downstream
docker tasks that depended on them would fail, since they were hard-coding the
artifacts from the initial run.

Differential Revision: https://phabricator.services.mozilla.com/D7364

--HG--
extra : moz-landing-system : lando
2018-10-02 21:38:23 +00:00
Mike Hommey bf8286ece7 Bug 1471103 - Add a few useful packages to the base Debian docker images. r=froydnj
--HG--
extra : rebase_source : f10f6c3d00e60ab705595250e38d5ea6d09966a0
2018-06-26 10:59:34 +09:00
Gregory Szorc 8628c39666 Bug 1466746 - Install python-zstandard in debian-base; r=glandium
Let's install python-zstandard for both Python 2 and Python 3 in
all our Debian-based images so it is readily available for use.

MozReview-Commit-ID: 1L8zDc5MYXA

--HG--
extra : rebase_source : db718891dd31d4feceff76fbce753b63049e20b1
2018-06-04 23:21:19 -07:00
Gregory Szorc a339b799f8 Bug 1460451 - Add /usr/bin/python3 to Debian images; r=glandium
The python3-minimal package provides /usr/bin/python3 on Debian.

This commit installs this package so a `python3` executable is
provided.

This required backporting the package to wheezy. The final patch
is trivial. But I wasted a bit of time figuring out why `mk-build-deps`
wasn't working. It would no-op and exit 0 and then the build would
complain about missing dependencies!

glandium's theory is that the ":any" multiarch support on wheezy
isn't complete. Removing ":any" seems to make things "just work."

MozReview-Commit-ID: FBicpK4SmkQ

--HG--
extra : rebase_source : a28ce731024e8ed6a43fb30e2ed57da2abb50d0f
2018-05-09 19:54:21 -07:00
Gregory Szorc 5d87fc997f Bug 1459737 - Move run-task into taskcluster/scripts; r=dustin
In preparation for making it usable on Windows, after which point
having it in a directory with "docker" in it doesn't make much sense.

MozReview-Commit-ID: Hgu0buFyJwF

--HG--
rename : taskcluster/docker/recipes/run-task => taskcluster/scripts/run-task
extra : rebase_source : 3c0b502d28b5aad54bd04069efbfda88e25bbb20
2018-05-04 17:23:31 -07:00
Gregory Szorc 70d55f427e Bug 1449629 - Install Python 3.5 in debian-base; r=glandium
We want Python 3.5+ to be available everywhere so various processes
can start using it.

The debian-base Dockerfile is shared by Debian 7 and 9 images.
Debian 9 ships with Python 3.5 and after the previous commit, we
have a Python 3.5 package for Debian 7. So we simply install the
"python3.5" package to get Python on all the Debian images.

MozReview-Commit-ID: 9ZmoSxtHWTZ

--HG--
extra : rebase_source : be4e62e7d731a3c39ee9ce205d75f1e525192acc
2018-04-02 16:58:21 -07:00
Tom Prince 13f8033d55 Bug 1426445: Add sanity check that worker uid/gid is 1000 in run-task; r=dustin,gps
MozReview-Commit-ID: 7T7rQpLhJIN

--HG--
extra : rebase_source : 950b111946ef3248aedb825d280754954b8f54ad
2018-01-02 14:22:36 -07:00
Mike Hommey b8fc72430b Bug 1436283 - Put package artifact repositories in different sources.lists. r=dustin
When running setup_packages in a docker image that derives from another,
we're currently overwriting the file that contains the apt sources for
the package artifact repositories that were used for the parent docker
image.

This doesn't cause practical problems for the existing docker images,
but in some cases where a user gets a one-click loaner, it might cause
problems when they try to install a package that has a dependency that
can't be fulfilled once those sources are overwritten.

To give a practical example, installing the gdb package from wheezy
requires libpython2.7, but if you try to do that on a derivative of the
debian7-base image, you don't have the deb7-python artifact repository
in your sources.list, and would fail to install gdb because apt can't
install a version of libpython2.7 that can be installed alongside the
python2.7 that is installed.

By putting easy repository in a separate file, named after the task id
of the corresponding package task, we ensure each an every one of them
is uniquely represented in /etc/apt/sources.list.d.

--HG--
extra : rebase_source : efb83b8c292a28c43ede24d5a3879dfbbfe94af7
2018-02-07 16:41:08 +09:00
Mike Hommey 9d3a568f03 Bug 1433033 - Make APT retry when it fails to download files. r=dustin
We've observed apt failures multiple times where it apparently fails to
get a file in full from snapshot.debian.org. Making it retry
automatically rather than retriggering tasks seems better.

--HG--
extra : rebase_source : f3ffb415ccc30b7e7c44e6a48b29eb20e69efdd5
2018-01-26 12:40:26 +09:00
Mike Hommey ae1ce5d571 Bug 1433033 - Workarounds for Debian stretch. r=dustin
The apt in Debian stretch doesn't allow repositories with a Release file
not being GPG signed. Setting up GPG signatures on the
taskcluster-artifact-based repositories is a tricky process, and not
strictly necessary. It turns out not creating a Release file at all
works just as well, and works across all current Debian versions. The
packages priorities remain the same, such that packages from those
repositories are still prefered over the ones from the main Debian
repository (as long as versions are higher).

See comment in cloud-mirror-workaround.sh for that part.

--HG--
extra : rebase_source : df5af330859a314285a6c1922d899489997d2f19
2018-01-25 22:26:06 +09:00
Mike Hommey db4394b257 Bug 1433033 - Create a base Debian docker image. r=dustin
That image is used to derive all the debian7-* images, and its
definition is parametrized, which will allow to create other images
based on other versions of Debian, from the same definition.

XZ_OPT is kept in each of those because we don't want to automatically
set it in all further derived images.

--HG--
extra : rebase_source : 7f4597c1ea4af83627a9373dbdc7945d20b7d996
2018-01-25 22:15:19 +09:00