Граф коммитов

276 Коммитов

Автор SHA1 Сообщение Дата
Simon Fraser d167e9637d Bug 1436369 Add docker entrypoint for periodic file udpates r=catlee
MozReview-Commit-ID: 4c8bMADQg4t

--HG--
extra : transplant_source : %BDs%8FS%9B/%B8%22%19%AE%10%C9%F1%AA%13t%84zY%BA
2018-02-21 11:18:32 +00:00
Simon Fraser 8ce28b276d Bug 1436369 Migrate HSTS and HPKP update scripts to docker image r=keeler
MozReview-Commit-ID: 6N7PqYsAXup

--HG--
rename : security/manager/tools/genHPKPStaticPins.js => taskcluster/docker/periodic_updates/scripts/genHPKPStaticPins.js
rename : security/manager/tools/getHSTSPreloadList.js => taskcluster/docker/periodic_updates/scripts/getHSTSPreloadList.js
extra : transplant_source : %19%9Ecvy%03%5E%E6T%B7%1D%A1%E7%8C%11%EC%C5%82%0A%91
2018-02-21 11:04:24 +00:00
Simon Fraser 047081e13b Bug 1436369 Docker image for periodic file updates r=catlee
MozReview-Commit-ID: E6OFCGBTttX

--HG--
extra : transplant_source : %01%FE%9C%3E%A9%60%83%C2Q%1C%C0%EE%17%0D%E9%0AUt%F7%87
2018-02-21 10:45:01 +00:00
Tom Ritter c9e805d87c Bug 1439726 Add patch to the MinGW Dockerfile r=glandium
MozReview-Commit-ID: DIzDSnNHzfM

--HG--
extra : rebase_source : c4de09802785e1802e76898d820d0d9cf87896ed
2018-02-20 14:09:07 -06:00
Ben Hearsum ede90c5816 bug 1398799: upgrade update verify docker image to Ubuntu 17.10. r=gps 2018-02-20 12:41:44 -05:00
Simon Fraser 4c3cd359d8 Bug 1438415 Re-order mbsdiff hook to allow exit values r=catlee
MozReview-Commit-ID: 9Z3DMyarcpt

--HG--
extra : rebase_source : 241dd8046f9be02e3d86b5a5b6360ed0bca77110
2018-02-15 21:59:15 +00:00
Michael Kaply 775018640e Bug 1436468 - Send downloads to the correct directory. r=jlorenzo
MozReview-Commit-ID: LSPNgFOjQhz

--HG--
extra : rebase_source : 373bccadbae13fd3df9043c8bf41950a907836f7
2018-02-07 12:46:53 -06:00
Johan Lorenzo b098ea094d Bug 1436445 - Use icon included in the snap r=mkaply
MozReview-Commit-ID: BXl5TghQpRx

--HG--
extra : rebase_source : ed80103b931c5fd45920559abf21815d500e3ed0
2018-02-12 10:31:25 +01:00
Simon Fraser ff314eda63 Bug 1437473 Don't cache smaller partials diffs r=mtabara
MozReview-Commit-ID: 7pYvEgRD382

--HG--
extra : rebase_source : 8ea798abe88d3fdea53f6e9aeaa81eb304eb1957
2018-02-12 11:02:17 +00:00
Simon Fraser c0fa76cb26 Bug 1436994 Collect S3 cache hit/miss data for partials r=rail
MozReview-Commit-ID: GQfPglY5ovz

--HG--
extra : rebase_source : d422a2cd8683e74aa8c219c9ac2622fc0b518cca
2018-02-09 16:19:20 +00:00
Tom Prince 13f8033d55 Bug 1426445: Add sanity check that worker uid/gid is 1000 in run-task; r=dustin,gps
MozReview-Commit-ID: 7T7rQpLhJIN

--HG--
extra : rebase_source : 950b111946ef3248aedb825d280754954b8f54ad
2018-01-02 14:22:36 -07:00
Tom Prince 024c479e0b Bug 1426445: Purge task caches, when an incompatible cache is found; r=gps
Differential Revision: https://phabricator.services.mozilla.com/D395

--HG--
extra : rebase_source : 1c2a16c6e851c578d3430092c8688770da5ab5b5
2018-01-15 22:00:50 -07:00
shindli a5abf843f8 Merge inbound to mozilla-central. a=merge 2018-02-08 12:04:26 +02:00
Ben Hearsum 35948d295c bug 1398799: make the update verify docker image support run-task. r=aki
--HG--
extra : amend_source : 9cfbf429c7078dd004a713ff6c6120a7b6a212cf
2018-02-07 14:50:46 -05:00
Mike Hommey b8fc72430b Bug 1436283 - Put package artifact repositories in different sources.lists. r=dustin
When running setup_packages in a docker image that derives from another,
we're currently overwriting the file that contains the apt sources for
the package artifact repositories that were used for the parent docker
image.

This doesn't cause practical problems for the existing docker images,
but in some cases where a user gets a one-click loaner, it might cause
problems when they try to install a package that has a dependency that
can't be fulfilled once those sources are overwritten.

To give a practical example, installing the gdb package from wheezy
requires libpython2.7, but if you try to do that on a derivative of the
debian7-base image, you don't have the deb7-python artifact repository
in your sources.list, and would fail to install gdb because apt can't
install a version of libpython2.7 that can be installed alongside the
python2.7 that is installed.

By putting easy repository in a separate file, named after the task id
of the corresponding package task, we ensure each an every one of them
is uniquely represented in /etc/apt/sources.list.d.

--HG--
extra : rebase_source : efb83b8c292a28c43ede24d5a3879dfbbfe94af7
2018-02-07 16:41:08 +09:00
Simon Fraser 5acab0f13e Bug 1432627 Add shellcheck linter to CI r=ahal
MozReview-Commit-ID: 2IYUsXunfab

--HG--
extra : rebase_source : 806ab4abfb1838a1b5eec279f5e93ce5c703685d
2018-01-29 15:27:04 +00:00
Mike Hommey 64dc538bff Bug 1433703 - Remove the libxss-dev package from the build image. r=gps
This will disable libxss-based code in the screenshot tool, like it was
before the switch to Debian-based build images in bug 1399679. There are
other places in the code that use libXss, but they don't require the
development headers, and use dlopen().

--HG--
extra : rebase_source : 4842361b680c70924b9fc0890a7e4f4dcbc7e338
2018-01-30 13:45:17 +09:00
Mike Hommey 1d38c4309b Bug 1432398 - Remove the desktop-build docker image and related files. r=dustin
--HG--
extra : rebase_source : 158e14474ce049343105d2be95aabc03ec0b7854
2018-01-27 11:04:23 +09:00
Mike Hommey 2edd1f5387 Bug 1432398 - Move oauth.txt and buildprops.json to taskcluster/docker/recipes. r=dustin
--HG--
rename : taskcluster/docker/desktop-build/buildprops.json => taskcluster/docker/recipes/buildprops.json
rename : taskcluster/docker/desktop-build/oauth.txt => taskcluster/docker/recipes/oauth.txt
extra : rebase_source : ac6b6c6a2394e3cd2e3be5c9bd48f3f16708eba6
2018-01-27 10:52:39 +09:00
Mike Hommey dd7448479b Bug 1432395 - Switch the valgrind build to a Debian-based docker image. r=dustin
We start from the image used for Firefox builds, and add the debug
packages for all the system libraries.

--HG--
extra : rebase_source : 2c759975d9837beabdc08a15fd926a99fd1cecf8
2018-01-27 10:25:58 +09:00
Margareta Eliza Balazs acf50fbab3 Backed out changeset 85794e045326 (bug 1432627) for shell lint failure in /builds/worker/checkouts/gecko/taskcluster/docker/firefox-snap/runme.sh:50:95 on a CLOSED TREE 2018-01-29 19:09:55 +02:00
Simon Fraser 82f0264fa1 Bug 1432627 Add shellcheck linter to CI r=ahal
MozReview-Commit-ID: 2IYUsXunfab

--HG--
extra : rebase_source : a40376ffc66e4a35d30e7e02a6ec208b1f52b021
2018-01-29 15:27:04 +00:00
Sylvestre Ledru 8238fab711 Bug 1433410 - Add codespell support for mach lint r=ahal
MozReview-Commit-ID: Ii6QjPMN0Ks

--HG--
extra : rebase_source : 854dc0994e9e204c5c5f9f25a4e956c9f51001d0
2018-01-27 10:35:31 +01:00
Mike Hommey 520f9865db Bug 1432397 - Switch mingw builds to a Debian stretch-based docker image. r=dustin
Don't build ucl when building upx, Debian stretch has a recent enough
version. In fact, the last upstream version doesn't build with GCC in
Debian stretch (http://bugs.debian.org/811707)

--HG--
extra : rebase_source : aae67773b9dd3b99f6ddf9ab7f59a628037e6925
2018-01-26 14:39:07 +09:00
shindli 4615d385bd Backed out changeset e414096f1c3b (bug 1433410) for yaml lint failures in tools/lint/codespell.yml:12:81 on a CLOSED TREE 2018-01-27 01:20:16 +02:00
Mike Hommey a5428cd701 Bug 1432392 - Switch the spidermonkey rust bindings job to a Debian-based docker image. r=dustin
This job requires cmake, which should be fixed, but in the meanwhile,
create a separate docker image with it installed, based on the image we
use for other spidermonkey builds.

--HG--
extra : rebase_source : da43a7999b6bd86dbba816358d907c902415bed4
2018-01-26 11:43:31 +09:00
Sylvestre Ledru 904937e12f Bug 1433410 - Add codespell support for mach lint r=ahal
MozReview-Commit-ID: Ii6QjPMN0Ks

--HG--
extra : rebase_source : f5aec5f35d5f882132fb09fe094dc2cfc41b1392
2018-01-26 23:58:29 +01:00
Mike Hommey 9d3a568f03 Bug 1433033 - Make APT retry when it fails to download files. r=dustin
We've observed apt failures multiple times where it apparently fails to
get a file in full from snapshot.debian.org. Making it retry
automatically rather than retriggering tasks seems better.

--HG--
extra : rebase_source : f3ffb415ccc30b7e7c44e6a48b29eb20e69efdd5
2018-01-26 12:40:26 +09:00
Mike Hommey 3ab004d966 Bug 1433033 - Derive the android-build image from a base Debian stretch image. r=dustin
--HG--
extra : rebase_source : 8be13be0a0c3979f6596514f62765a9b741fd8f7
2018-01-25 22:31:48 +09:00
Mike Hommey ae1ce5d571 Bug 1433033 - Workarounds for Debian stretch. r=dustin
The apt in Debian stretch doesn't allow repositories with a Release file
not being GPG signed. Setting up GPG signatures on the
taskcluster-artifact-based repositories is a tricky process, and not
strictly necessary. It turns out not creating a Release file at all
works just as well, and works across all current Debian versions. The
packages priorities remain the same, such that packages from those
repositories are still prefered over the ones from the main Debian
repository (as long as versions are higher).

See comment in cloud-mirror-workaround.sh for that part.

--HG--
extra : rebase_source : df5af330859a314285a6c1922d899489997d2f19
2018-01-25 22:26:06 +09:00
Mike Hommey db4394b257 Bug 1433033 - Create a base Debian docker image. r=dustin
That image is used to derive all the debian7-* images, and its
definition is parametrized, which will allow to create other images
based on other versions of Debian, from the same definition.

XZ_OPT is kept in each of those because we don't want to automatically
set it in all further derived images.

--HG--
extra : rebase_source : 7f4597c1ea4af83627a9373dbdc7945d20b7d996
2018-01-25 22:15:19 +09:00
Mike Hommey 3972032498 Bug 1433033 - Don't `apt-get clean` from Debian-based docker images. r=dustin
The base images from docker hub actually contain a
/etc/apt/apt.conf.d/docker-clean that does the equivalent of an apt-get
clean after installing packages.

--HG--
extra : rebase_source : 190de9e3b10a0309cf9cfb3260a91477a5a93ba3
2018-01-25 21:57:13 +09:00
Mike Hommey 04b424481d Bug 1433033 - Set apt defaults to avoid passing -q, -y and --no-install-recommends to it. r=dustin
--HG--
extra : rebase_source : 53c8f00ef24dc8757d8eb45d1a9e08da48539a7a
2018-01-25 22:09:56 +09:00
Mike Hommey ce90eb437b Bug 1433033 - Set Acquire::Check-Valid-Until in apt config file rather than pass it on the command line. r=dustin
Also set it in the android-build image, which is Debian-snapshot-based too.

--HG--
extra : rebase_source : a64a0d6833c98025bfe287e197a9ef255b12a9bc
2018-01-25 15:24:05 +09:00
Mike Hommey fd6008421c Bug 1433033 - Remove a few packages from the toolchain-build image. r=dustin
python-dev was required to build mercurial, but the need for that was
removed in bug 1429669.
The others were required for mingw32 toolchains, but they are using a
different docker image and will switch to another different docker image.

--HG--
extra : rebase_source : b65c586a325f220c565e79afb3d3c9acc9f922bc
2018-01-25 15:13:20 +09:00
Simon Fraser 935d2ffd99 Bug 1432763 Linting compliance for funsize docker images r=mtabara
MozReview-Commit-ID: IdHYknfUZXx

--HG--
extra : rebase_source : ae7c721938626a3a3c12d1aff084bf54cce62e81
2018-01-24 12:46:21 +00:00
Simon Fraser 54d71de730 Bug 1432763 Linting compliance for funsize docker images r=mtabara
MozReview-Commit-ID: IdHYknfUZXx

--HG--
extra : rebase_source : aa21c059c79e3c6743419ae2f5a704b463e5c7d1
2018-01-24 12:46:21 +00:00
Dorel Luca f8bc8becf5 Backed out changeset e00fb451089f (bug 1432763) for breaking nightly partial update generation a=backout 2018-01-26 03:53:42 +02:00
Mike Hommey 49993bfe85 Bug 1432390 - Allow to derive docker images from other in-tree images. r=dustin
So far, the best we've been able to do is to upload an image to the
docker hub, and point an image's Dockerfile's FROM to the version
uploaded onto the hub.

That is a cumbersome process, and makes the use of "layered" docker
images painful.

This change allows to declare a parent docker image in the
taskcluster/ci/docker-image/kind.yml definitions, which will be
automatically loaded before building the image. The Dockerfile can then
reference the image, using the DOCKER_IMAGE_PARENT argument, which will
contain the full image name:tag.

Some details are left off, for now, such as VOLUMEs. At this point,
VOLUMEs should all be defined in leaf docker images.

--HG--
extra : rebase_source : 221cff0ca5a91d694ff5c3626fe707c15ba45e23
2018-01-25 11:07:54 +09:00
Mike Hommey fd6ffda3c8 Bug 1432390 - Make `mach taskcluster-build-image` talk directly to the docker socket in the image builder. r=dustin
Now that `mach taskcluster-build-image` can, we can avoid all the manual
handling based on curl and jq in the image builder.

An additional advantage on relying on `mach taskcluster-build-image`
doing more is that less changes to the build-image.sh script will be
necessary, and thus less updates of the image builder docker image.

--HG--
extra : rebase_source : dd174d60675e41e4391894f28235c674c1840829
2018-01-25 13:36:47 +09:00
Simon Fraser 9bc38c03cc Bug 1432763 Linting compliance for funsize docker images r=mtabara
MozReview-Commit-ID: IdHYknfUZXx

--HG--
extra : rebase_source : cd86ab7af28b97c52b5cfb045b91ca3a248f1755
2018-01-24 12:46:21 +00:00
Gurzau Raul 9abd2a937c Merge mozilla-central to autoland. a=merge CLOSED TREE 2018-01-25 13:00:18 +02:00
Simon Fraser 3fb244c631 Bug 1432765 Linting compliance for docker recipes r=jlund
MozReview-Commit-ID: KbTLTU87hyI

--HG--
extra : rebase_source : a1b433b7874cd7dcf3eee3a6c8328b780153a97d
2018-01-24 12:50:04 +00:00
Simon Fraser 184caf15a0 Bug 1432768 Linting compliance for image builder scripts r=Callek
MozReview-Commit-ID: 3TmtiB47Z5W

--HG--
extra : rebase_source : c66da9713e1732be6f5a6ba26d6b2a18ca17fa34
2018-01-24 12:59:11 +00:00
Margareta Eliza Balazs 8d179d969e Backed out changeset d0dc56c1e423 (bug 1432768) for bustage taskcluster-image-build:error on a CLOSED TREE 2018-01-24 16:56:10 +02:00
Simon Fraser 5812422f52 Bug 1432756 Linting compliance for firefox-snap docker image r=jlorenzo
MozReview-Commit-ID: IyfL0Cbnkjh

--HG--
extra : rebase_source : abed84a8628b229cedc17780152683f8ec8db79f
2018-01-24 14:36:46 +00:00
Simon Fraser 0307838ca3 Bug 1432767 Lint compliance for lint system setup r=ahal
MozReview-Commit-ID: IDZYEIGI283

--HG--
extra : rebase_source : f68622602822a96efff0c66ce2c59975dd59164e
2018-01-24 12:57:25 +00:00
Simon Fraser 2789476ffa Bug 1432768 Linting compliance for image builder scripts r=Callek
MozReview-Commit-ID: 3TmtiB47Z5W

--HG--
extra : rebase_source : 7e21151be1125affdcabf2aa4876aea9a97575fd
2018-01-24 12:59:11 +00:00
Simon Fraser 7ab95eccbd Bug 1432517 Add shellcheck support for mach lint r=ahal
MozReview-Commit-ID: 1Mzg6y3JKbn

--HG--
extra : rebase_source : ceb32257265952e173ff83434395acfabb001cb4
2018-01-23 16:32:04 +00:00
Cosmin Sabou 6cfb14fd97 Merge mozilla-central to mozilla-inbound. a=merge on a CLOSED TREE 2018-01-25 00:07:47 +02:00