This uses credentials stored in the Taskcluster secret service. The task should
only run on mozilla-central to avoid confusion between branches.
MozReview-Commit-ID: 31XfTg0sCht
--HG--
extra : rebase_source : d2881d6ee093d0f0c87880ba63b451fb0e54415e
extra : amend_source : 6a34a633daab264863a668aca801ce4a4ffb782b
This addresses the issue where tasks with a dependency which is already
complete started immediately, without waiting for the decision task (bug
1372817).
It does not address the issue where a re-run of a failed decision task will
allow tasks created by the first run to run, in addition to creating an
entirely new set of tasks.
MozReview-Commit-ID: EdNZSrNw3F6
--HG--
extra : rebase_source : 3a9675758841e04f2edbcdc42d148e92b5ae99a7
extra : amend_source : 350576ffbe3f6221c1aa2603833893dd27b20011
This introduces a 'try_task_config' method of scheduling. En lieu of (or in addition to) try
syntax, you can now check in a file called 'try_task_config.json' to the root of the source
tree. The format is either a list of task labels, or dict where task labels are the keys.
Taskcluster will simply schedule any tasks that are listed there.
This file is primarily meant to be generated by tools (which don't exist yet), as the json
format is much easier for tools to generate or consume. These tools should use an in-memory
commit to add the file so it is automatically removed again after the push.
A server-side hook will be added in bug 1380357 to prevent this file from accidentally
landing on non-try trees.
MozReview-Commit-ID: 2zKfZXuuDhH
--HG--
extra : rebase_source : b5d5ff47c607288657418fd041603093f8c29e85
I took the time to change jcentral (which is just wrong) to jcenter,
which is the tag used in the nexus.xml.
Order matters! Gradle resolves dependencies in the order given. That
is, jcenter is preferred to google.
MozReview-Commit-ID: CcWBukhiHa4
--HG--
extra : rebase_source : 73a3b3f013d9154ff3f5732593ba9fbe2b75d1f0
Enable Stylo tests for win32, win64, and macosx64. Talos will be considered
separately.
MozReview-Commit-ID: BvTkddDX2Kk
--HG--
extra : rebase_source : 8d4df4469d4017b12bfbd33a98cc9f38111aa210
Flip around the logic of bug 1356122, so that the default from Stylo runs is the
parallel traversal, but we can opt in to single traversal as desired.
This ensures that for testing on other desktop platforms, we use parallel
traversal as the default.
MozReview-Commit-ID: KoBe1ltHP52
--HG--
extra : rebase_source : ad96f24c9760544c5812060f26e9ca18e5bf2ba8
Previously, Servo-initiated CI only ran tasks if they were on the
Linux64 platform. Now that we compile Servo code into Firefox (Stylo),
we need to verify that Firefox at least builds on other platforms
when Servo code changes.
This commit tweaks our task filtering logic to only screen
"test" tasks. This enables builds and other task kinds for Servo
changes.
The solution isn't perfect. One can make a case that deleting the
filter completely is appropriate. But until we have more Servo
code used by Firefox, I'm inclined to keep the optimization so
it lessens CI load.
MozReview-Commit-ID: 1QMrK27439C
--HG--
extra : rebase_source : 1ba0102c0f9accf45fd154d2409f65bbe75a2a76
Allow an extra heap write hazard introduced by enabling stylo
in default builds until it can be addressed. See bug 1384625.
MozReview-Commit-ID: 2N3z6FVHa0G
--HG--
extra : rebase_source : d4c9c18c34ab829b59b9e16ec3cd8e736c418fd3
The manifest is only used for windows clang-cl toolchain jobs, and
building clang-cl doesn't use make or rustc.
--HG--
extra : rebase_source : 2209098306461cac9c2145d8d9a0f2ea096b1f08
Those jobs now have all their dependencies installed through taskcluster
artifacts.
--HG--
extra : rebase_source : de311326999ea587e6885f0cb26c2d4a14110b00
Building linux64-clang-tidy doesn't use clang, and building
macosx64-cctools-port doesn't use gcc.
--HG--
extra : rebase_source : 78d7021fb56f22b3bbf3fad61032348a0d35f98c
None of the toolchain jobs are actually using sccache, so they don't
need the dependency. Those jobs also don't run frequently enough that
sccache would be a win for them, and when they do run, they're likely
to have few cache hits, if the cache is not expired anyways.
--HG--
extra : rebase_source : bddd0d0688303f9d9b117f4e2b952f22621bf9dd
With the support added in bug 1382564, toolchains can be downloaded
without a tooltool manifest at all, and it's desirable to get rid of
tooltool manifests on jobs that don't need one.
--HG--
extra : rebase_source : 340d935034133f4f6d8aec3d15154736092859fa
This leaves out fuzzing and linux static analysis builds, which are
using, respectively, clang 4.0.1 and clang 3.8, while linux64-clang
produces a 3.9 and win*-clang a 5.0
--HG--
extra : rebase_source : 45128ac74bf4fe7e6a2ace57043c34ecdf0fe929
Before this patch, we used the Gradle sdk-manager-plugin to download
and install Android SDKs and other dependencies. This plugin is now
deprecated; the main dependency downloading functionality has been
incorporated into the Android-Gradle build plugin. Unfortunately,
it's been incorporated into newer versions that in turn require newer
toolchains than we currently support, so we can't use the new
functionality immediately.
Rather than replace sdk-manager-plugin with equivalent Gradle-based
functionality, this ticket uses recently added bootstrap functionality
to bootstrap the Android SDK during the dependencies task. It then
_uses_ that SDK to run the dependency fetching task, _produces_ an
android-sdk-linux.tar.xz, and then _uploads_ the new artifact as a
private artifact, ready to be pushed into tooltool. This avoids
engineers building this critical part of the toolchain locally
themselves, and will also feed into ongoing work to push toolchain
artifacts into build jobs in Task Cluster.
MozReview-Commit-ID: B6FC0ugaCef
--HG--
extra : rebase_source : 782719438a464b8021db58be398be9d5afb3b543
I don't understand why this is necessary, but I believe I witnessed
android-gradle-dependencies-api-15 try pushes that were optimized away
even when the underlying image builder job was run. The general
solution to this seems to be hard, so I'll just work around it in this
way.
MozReview-Commit-ID: 4ErgRlJaycv
--HG--
extra : rebase_source : d0dadc96279aff032f6c8558c3763854a42c14d7
This uses credentials stored in the Taskcluster secret service. The task should
only run on mozilla-central to avoid confusion between branches.
MozReview-Commit-ID: 31XfTg0sCht
--HG--
extra : rebase_source : c3ef4ec15ecd4fa0ec0b5af7aacddfa8d6dd90e0
extra : source : 19f92c04608cec275dab73e8acad5141de8a5c44
This is needed to populate try_test_paths in mozharness trytools.
MozReview-Commit-ID: IRJshk2MRDu
--HG--
extra : rebase_source : 87dcc2c65a4f8f539574ac53bade0cdaedb2b441
for: Land changes to flip windows nightlies on, and to tier 1 on central
MozReview-Commit-ID: EB0UVV3zQYX
--HG--
extra : rebase_source : ba31b24a93a3809c2c6f9125aa5aa7861ed0c60b
for: Land changes to flip windows nightlies on, and to tier 1 on central
MozReview-Commit-ID: Ecqd48ef01i
--HG--
extra : rebase_source : 62e89b980045f925251c6c47d7e807a14480c097
for: Land changes to flip windows nightlies on, and to tier 1 on central
MozReview-Commit-ID: 33xnmNmjYEY
--HG--
extra : rebase_source : 0b63e8eb4c9793ba67ac756b08b5c96ace5f8063
for: Land changes to flip windows nightlies on, and to tier 1 on central
MozReview-Commit-ID: FFDS8FcsvHj
--HG--
extra : rebase_source : aa28aadc98aef8bb5f7fbb1f937f7319f89f4038
for: Land changes to flip windows nightlies on, and to tier 1 on central
Also sets awsy and marionette headless to just use built-projects for what to run on, and then sets
browser-screenshots to not run on deved.
MozReview-Commit-ID: C6KbHI7Hs81
--HG--
extra : rebase_source : 2b9078497718f4b95183b41721800dcd9960a98e
for: Land changes to flip windows nightlies on, and to tier 1 on central
MozReview-Commit-ID: IBi7FR6xPPX
--HG--
extra : rebase_source : b126da0fb9b5e6f3d07c3c42346afd7b12aa07cc
for: Land changes to flip windows nightlies on, and to tier 1 on central
MozReview-Commit-ID: 2TJbt5HBGSn
--HG--
extra : rebase_source : b96841f7d6ac393d414ec0650585bff8b8128cc0
for: Land changes to flip windows nightlies on, and to tier 1 on central
MozReview-Commit-ID: 8JmEtOmPtGO
--HG--
extra : rebase_source : 0b1d4fcd43e1c9f67b5e06583eeb0053abd82884
for: Land changes to flip windows nightlies on, and to tier 1 on central
MozReview-Commit-ID: Jcguw7C7Okq
--HG--
extra : rebase_source : 8a19ce1dd776818b042a96f2e4a9b94839b15375
for: Land changes to flip windows nightlies on, and to tier 1 on central
MozReview-Commit-ID: AtBXyrPqRRI
--HG--
extra : rebase_source : a71b0c595d7b962fc150e74f3ba35445544f074d
for: Land changes to flip windows nightlies on, and to tier 1 on central
MozReview-Commit-ID: Hosoq7OD8kg
--HG--
extra : rebase_source : 0ffd553aedc226255133c864311c1cdee273bcaa
for: Land changes to flip windows nightlies on, and to tier 1 on central
MozReview-Commit-ID: 7V8lh1eCjdV
--HG--
extra : rebase_source : a06b5e9eabd4cadffbaecf0e2b4a1a1322c0ce95
for: Land changes to flip windows nightlies on, and to tier 1 on central
MozReview-Commit-ID: FnhgnU95X13
--HG--
extra : rebase_source : ed49d5ba2a0a553e2cd118b7db467b1d03afff20
for: Land changes to flip windows nightlies on, and to tier 1 on central
MozReview-Commit-ID: LSYmhcEOs2F
--HG--
extra : rebase_source : c2f0a83082047b2df0fd1ceee77c05674b6cf62e
for: Land changes to flip windows nightlies on, and to tier 1 on central
MozReview-Commit-ID: LbL5jPRhGEp
--HG--
extra : rebase_source : 149100471ebdea61cf5c3f280d5e8406b2f37146
for: Land changes to flip windows nightlies on, and to tier 1 on central
MozReview-Commit-ID: ES0rsESswq7
--HG--
extra : rebase_source : 28c5a477b073bdea95be6b155a9bb19e0f2ef5ec
for: Land changes to flip windows nightlies on, and to tier 1 on central
MozReview-Commit-ID: 4lJ777fosNI
--HG--
extra : rebase_source : c7d4684d812e698828c06d9ea604c9986e98f3f5
The MinGit tooltool package used for Windows builds comes straight from
https://github.com/git-for-windows/git/releases/
This builds the version currently used on automation.
--HG--
extra : rebase_source : dbc2a36b07611e673d6661032ad53123a688d422
We'll want chain of trust to be able to verify the toolchain artifacts
used by TC builds, which means the toolchain jobs producing them need to
output the chain of trust artifacts.
--HG--
extra : rebase_source : 6b6b6c4ac728943b46aa03ef85a0f3124bbf12e6
This implements an action to run all test tasks which were optimized out by the
decision task.
MozReview-Commit-ID: qPflBlxMg7
--HG--
extra : rebase_source : 97fee1046791a1da45f1748039718da0d1e9223f
These both have a similar form, recursing over a nested JSON structure, and are
useful outside of the modules in which they are defined.
MozReview-Commit-ID: 1bsRtlaQol7
--HG--
extra : rebase_source : 21b641e927c5004a1cc9778cbd909e4dc40ec47f
Changes to cron decision tasks:
- drops some unnecessary routes
- drops tags.createdForUser: nobody@..
- more use of environment variables within the command line
MozReview-Commit-ID: 9zoqFvwrBRs
--HG--
extra : rebase_source : 77e17089b67e5d72360d5ecb617887b7a71457fe
Bug 1374748 removed Stylo-specific builds, but there are still a few config
files left behind that are now unused. This cleans them up.
MozReview-Commit-ID: EAUx7YKQBmN
--HG--
extra : rebase_source : 7e2124f7e5625d25efc5e868e151dbdc02cfba65
Currently these are enabled for Linux and Windows, using the corresponding WPT
symbols with an "H" suffix to match the Mn->MnH convention followed by the
Marionette tests.
For Linux, the tests are set to run with a simulated 1600x1200 screen
resolution, which matches the Docker configuration. The default 1366x768 for
headless mode results in some unexpected failures due to windows not being
able to reach the full sizes the web platform tests expect.
For Windows, the simulated screen resolution is set to 1024x768, which is what
I've determined to be the resolution that Windows VMs run under within our
testing infrastructure. Setting a different screen resolution causes some web
platform tests to unexpectedly pass (in particular, several in
open-features-non-integer-height.html).
A "headless" variable is added to the environment that the WPT metadata
(.ini) files can access, indicating whether or not the test is running in
headless mode. This is used to mark the reftest bdi-neutral-wrapped.html as an
expected pass on Linux under headless mode: it normally fails (spuriously) due
to differences in scrollbar sizing, but scrollbars aren't rendered in headless
mode.
MozReview-Commit-ID: 3usazOoxx3q
--HG--
extra : rebase_source : c036070920391c30b13813e2d6282bd407a96715
The first version of the patch didn't account for the fact that if we did -p all we still couldn't do -u foo[Windows 8]
specifically: -p all means self.platforms is None
https://hg.mozilla.org/mozilla-central/file/16ffc1d05422/taskcluster/taskgraph/try_option_syntax.py#l563
Then we check if the *test* has a run_on_projects that has either `all` or `try`, it doesn't so we abort.
In new code, we merely set a flag to say don't-run-me-by-default and use that in a few places.
MozReview-Commit-ID: 6rjNVZvpYGA
--HG--
extra : rebase_source : 4c791c9e566a5eddc2bb2e820bab0090f9db1237
This affects the location of the artifacts directory, so adjust the
scripts and artifact definitions as a consequence.
--HG--
extra : rebase_source : 008b8cf33957eabfcacee61de8a260b5df146ab4
Bug 1374940 adds a MOZ_TOOLCHAINS environment variable with a list of
path@task-id strings, where task-id is corresponding to the (possibly
optimized) toolchain job, and path corresponding to the
toolchain-artifact defined for that toolchain job.
We want to use that to pull artifacts instead of tooltool packages.
--HG--
extra : rebase_source : 277daa2c83d6d197975cb4ef36ee131176afa992
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: B9S2WXHESjG
--HG--
extra : rebase_source : 19d23e52545f6002ce7da1b19dde151bd799d12b
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: 4aM7JrfdGD3
--HG--
extra : rebase_source : 83322778c37c9b228ad835d97a2068532a3f878c
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: 8AfCK50vRJc
--HG--
extra : rebase_source : 0183e58585b62d120d7ba1c9d0d48f8b500b88c5
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: 8wlzBReWe5r
--HG--
extra : rebase_source : 72def80209aefb656b236d5858d8bb1ef5a68aab
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: If1U1GrZujJ
--HG--
extra : rebase_source : d0e59313380330b71db8d494cdb013a6386af4c3
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: DLfhmUIKZYe
--HG--
extra : rebase_source : d99a7fd0a24bb458f2798c69e00141f4cca785c1
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: ANjwaLPNdqB
--HG--
extra : rebase_source : 4e3005f35bc6c4ef0951230f344d0fb3b3c101ff
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: hpWH92RtWr
--HG--
extra : rebase_source : d1338bd94977f8e00f55799ade0fb519ee35202d
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: 4HgW0D2BR8B
--HG--
extra : rebase_source : b87b1159307205cebd10e1d8598386aac3976706
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: Jt68tzpXtTx
--HG--
extra : rebase_source : 440afa273888f41b12b58ee2c085090f73cc1b03
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: 5oMSqo6JsmM
--HG--
extra : rebase_source : 9d10412d9a5a9524ba504bde4668a1a04a43343a
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: CHUMWUxbyqt
--HG--
extra : rebase_source : 29fa30145460ad5d4bbba661978c46d7fb8402af
Land date changes to support windows nightlies onto central
Supports beetmoving from the build-signing task, as well as ignoring dependencies if we have nothing to beetmove in them (e.g. build-signing for OSX)
MozReview-Commit-ID: 24byn1posKT
--HG--
extra : rebase_source : eda70c5fb3b3a83e26e2c9f1bc3c9b27df9af52d
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: Cw8x51DHIzY
--HG--
extra : rebase_source : b755c1fc3ed40e2e142bbb11f44911887cbdbe6e
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: 7Le7c1Aw1Je
--HG--
extra : rebase_source : 7c8bdcb89baa2b3667819814de8138fa1b5efc5a
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: ICgAujVGR9G
--HG--
extra : rebase_source : d86730b3fd30e3cbecef93cdda634466156d2f2e
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: 9lWSEbQznyr
--HG--
extra : rebase_source : a9236c910f5c60b4c11d9c9ff7491b42b4d6b98b
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: EK4JQI4Rqgo
--HG--
extra : rebase_source : 9a8919eb2274e808aa61a6b5f0f0e8d8230cfd2b
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: D8pWqeioF15
--HG--
extra : rebase_source : 22637e690047a87a2a3c2287205ae27ecb873d06
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: 9FbrSvyU9ny
--HG--
extra : rebase_source : c273510e657a4f07fa39b6006bcf1e42b8319e5b
Land date changes to support windows nightlies onto central
This patch also allows us to not reconfigure to run repackage on windows, which saves us both in potential pain points and execution time.
MozReview-Commit-ID: xnz98Z5N06
--HG--
extra : rebase_source : 1630a3b6b646a83abeb05000e77e0e3c3238250b
Land date changes to support windows nightlies onto central
This will be needed for windows, because if the artifact is output to a folder that is, itself, an artifact folder, we'll end up publishing the named artifact twice. Which is unhelpful.
MozReview-Commit-ID: 5S6SNul6Fm9
--HG--
extra : rebase_source : 5501d8d757c7408c9dd014bc04a8d36429bdd9b5
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: Bo0wVjGPcCN
--HG--
extra : rebase_source : 88c999c4c3a56efb8db0a7c5eed0f546987e9428
Land date changes to support windows nightlies onto central
MozReview-Commit-ID: 9b5Sc2YDL6z
--HG--
extra : rebase_source : cfe3ef17db0a85b5d8caa6a7a3382c07b2436398
Land date changes to support windows nightlies onto central
This change has the side affect of removing accidentally present funsize routes on android and on windows-on-change-signing.
MozReview-Commit-ID: GJucXu1n63i
--HG--
extra : rebase_source : 6d0b167fd8809f6d2b8c876929ed98e2dbb275fe
Sebastian Hengst
Dustin J. Mitchell
Andrew Halberstadt
Wes Kocher
Brendan Dahl
Carsten "Tomcat" Book
Nick Alexander
Tom Prince
Rail Aliiev
Aki Sasaki
Joel Maher
J. Ryan Stinnett
Gregory Szorc
Ralph Giles
Johan Lorenzo
Mike Hommey
Chris AtLee
Brian Stack
Maja Frydrychowicz
Justin Wood
Hassan Ali
Michael Smith
Kartikaya Gupta
Cameron McCormack
Rob Wood