This was only needed because the old docker server available through
docker-in-docker didn't support ARG, but now that we use kaniko (bug
1626058), we can use ARG, which most images already use, but for some
reason debian-raw still uses %ARG.
Differential Revision: https://phabricator.services.mozilla.com/D118784
This requires a backport of valgrind to buster instead of jessie (which
we don't need a backport for anymore). Somehow the buster-based
android-build was using the backport for jessie. It now can use the
backport for buster.
We now also need a few extra packages in the valgrind docker image that
used to be installed as a side effect of installing other packages, but
aren't installed automatically anymore, while necessary.
This allows to remove the debian8-amd64-build docker image, now unused.
We add a patch to workaround an issue with rust that was fixed in older
version of valgrind but that resurfaced in a slightly different manner.
Filed upstream as https://bugs.kde.org/show_bug.cgi?id=433641.
Finally, we update the suppressions to account for system changes.
Differential Revision: https://phabricator.services.mozilla.com/D106402
This requires a backport of valgrind to buster instead of jessie (which
we don't need a backport for anymore). Somehow the buster-based
android-build was using the backport for jessie. It now can use the
backport for buster.
We now also need a few extra packages in the valgrind docker image that
used to be installed as a side effect of installing other packages, but
aren't installed automatically anymore, while necessary.
This allows to remove the debian8-amd64-build docker image, now unused.
We add a patch to workaround an issue with rust that was fixed in older
version of valgrind but that resurfaced in a slightly different manner.
Filed upstream as https://bugs.kde.org/show_bug.cgi?id=433641.
Finally, we update the suppressions to account for system changes.
Differential Revision: https://phabricator.services.mozilla.com/D106402
Cached tasks help us reuse existing tasks for toolchain, docker-image,
and fetch tasks, among others. This saves us compute cycles and
end-to-end time; it also allows us to keep these artifacts pinned
until we rebuild, which is a way to keep non-deterministic
artifacts, like docker images, in a predictable state.
However, occasionally we need to rebuild these tasks, e.g. when we
rotate the CoT key and want to invalidate the old key that we signed
the existing cached_tasks with. Until now, this process was unwieldy.
Now we have an action to allow us to do this at will.
Differential Revision: https://phabricator.services.mozilla.com/D118749
Run TV and TC tasks with python 3. Several issues are addressed for TV:
- minor Android-only str/int type confusion for mozinfo parameter;
- the type of mozlog-generated log* options changes under py3, causing
difficulty when deepcopy'ing options; avoided by removing the need
for deepcopy;
- on Windows, with py 3.6, repeated process launches trigger a python
bug; avoided by running self-tests only once per TV session.
Differential Revision: https://phabricator.services.mozilla.com/D118769
This enables the following tasks on central:
+test-linux1804-64-asan/opt-reftest-fis-e10s
+test-linux1804-64-shippable-qr/opt-reftest-fis-e10s
+test-windows10-64-qr/debug-reftest-fis-e10s
+test-windows10-64-shippable-qr/opt-reftest-fis-e10s
and the following tasks on autoland:
+test-linux1804-64-asan/opt-reftest-fis-e10s
+test-linux1804-64-qr/opt-reftest-fis-e10s
+test-windows10-64-qr/debug-reftest-fis-e10s
+test-windows10-64-qr/opt-reftest-fis-e10s
Differential Revision: https://phabricator.services.mozilla.com/D118593
We can still get multiple nightly graphs off the same revision, if
the 2nd cron task runs before the 1st one finishes. However, once
the 1st finishes, we will prevent a 2nd nightly graph. (This has the
side effect of not being able to trigger a 2nd nightly graph off the
same revision, even if the first nightly graph failed, but I think
that's still an improvement. We can work around this with a new push,
or triggering the platform-specific nightly graphs.)
Differential Revision: https://phabricator.services.mozilla.com/D118543
This enables the following configuration on autoland/central:
> test-linux1804-64-tsan/opt-web-platform-tests-reftest-fis-e10s
Differential Revision: https://phabricator.services.mozilla.com/D117369
This enables the following configuration on central / autoland:
> test-linux1804-64-tsan/opt-web-platform-tests-fis-e10s
Differential Revision: https://phabricator.services.mozilla.com/D110555
This enables the following tasks on central:
+test-linux1804-64-asan/opt-mochitest-webgl2-ext-fis-gli-e10s
+test-linux1804-64-qr/debug-mochitest-webgl2-ext-fis-gli-e10s
+test-linux1804-64-shippable-qr/opt-mochitest-webgl2-ext-fis-gli-e10s
+test-windows10-64-shippable/opt-mochitest-webgl2-ext-fis-gli-e10s
+test-windows10-64/debug-mochitest-webgl2-ext-fis-gli-e10s
and the following tasks on autoland:
+test-linux1804-64-asan/opt-mochitest-webgl2-ext-fis-gli-e10s
+test-linux1804-64-qr/debug-mochitest-webgl2-ext-fis-gli-e10s
+test-linux1804-64-qr/opt-mochitest-webgl2-ext-fis-gli-e10s
+test-windows10-64/debug-mochitest-webgl2-ext-fis-gli-e10s
+test-windows10-64/opt-mochitest-webgl2-ext-fis-gli-e10s
Depends on D118054
Differential Revision: https://phabricator.services.mozilla.com/D118056
This enables the following tasks on central:
+test-linux1804-64-asan-qr/opt-mochitest-webgl2-core-fis-gli-e10s
+test-linux1804-64-qr/debug-mochitest-webgl2-core-fis-gli-e10s
+test-linux1804-64-shippable-qr/opt-mochitest-webgl2-core-fis-gli-e10s
+test-windows10-64-qr/debug-mochitest-webgl2-core-fis-gli-e10s
+test-windows10-64-shippable-qr/opt-mochitest-webgl2-core-fis-gli-e10s
and the following tasks on autoland:
+test-linux1804-64-asan-qr/opt-mochitest-webgl2-core-fis-gli-e10s
+test-linux1804-64-qr/debug-mochitest-webgl2-core-fis-gli-e10s
+test-linux1804-64-qr/opt-mochitest-webgl2-core-fis-gli-e10s
+test-windows10-64-qr/debug-mochitest-webgl2-core-fis-gli-e10s
+test-windows10-64-qr/opt-mochitest-webgl2-core-fis-gli-e10s
Depends on D117936
Differential Revision: https://phabricator.services.mozilla.com/D118054
This adds the following tasks to central:
+test-linux1804-64-asan/opt-mochitest-webgl1-ext-fis-gli-e10s
+test-linux1804-64-qr/debug-mochitest-webgl1-ext-fis-gli-e10s
+test-linux1804-64-shippable-qr/opt-mochitest-webgl1-ext-fis-gli-e10s
+test-windows10-64-qr/debug-mochitest-webgl1-ext-fis-gli-e10s
+test-windows10-64-shippable-qr/opt-mochitest-webgl1-ext-fis-gli-e10s
And following tasks to autoland:
+test-linux1804-64-asan/opt-mochitest-webgl1-ext-fis-gli-e10s
+test-linux1804-64-qr/debug-mochitest-webgl1-ext-fis-gli-e10s
+test-linux1804-64-qr/opt-mochitest-webgl1-ext-fis-gli-e10s
+test-windows10-64-qr/debug-mochitest-webgl1-ext-fis-gli-e10s
+test-windows10-64-qr/opt-mochitest-webgl1-ext-fis-gli-e10s
Differential Revision: https://phabricator.services.mozilla.com/D117936
The `mozbase` modules were being unconditionally added to the
`sys.path` regardless of the Mach command being run, so there isn't
much value keeping them in a separate file. Besides, all other
source module paths are described in `common_virtualenv_packages`,
why is `mozbase` special?
In the future, we're going to want to make improvements here (such as:
there's a difference between informing mach of first-party code
versus defining which third_party vendored packages should be in scope,
and that workflow difference should be represented in-code).
It's useful to peel out the existing, less useful abstraction before
we can build a stronger one.
Differential Revision: https://phabricator.services.mozilla.com/D117711
Bug 1694785 upgraded diffoscope, and the new version had differences in
its output format that just made our error reporting miss everything. So
we fix the error reporting to work with the new version, as well as add
a test case to ensure that we don't upgrade diffoscope to a version that
would break out reporting again without noticing.
Differential Revision: https://phabricator.services.mozilla.com/D118137