Граф коммитов

457 Коммитов

Автор SHA1 Сообщение Дата
Dustin J. Mitchell bfbc5f350d Bug 1326547: replace get_keyed_by with resolve_keyed_by; r=Callek
MozReview-Commit-ID: FS1nbVyykXV

--HG--
extra : rebase_source : 6cddb3ecb188f2c9c6dafee98c3b0ed5bfdf1955
2017-01-05 13:42:14 -05:00
Shing Lyu a6bb0bf37f Bug 1328765 - Enable Talos on linux64-stylo platform. r=heycam
MozReview-Commit-ID: 9jO7oflVSSw

--HG--
extra : rebase_source : 67dcb1d34c40d35f4206cdf98f6da9b7c552d1cf
2017-01-04 17:26:34 +08:00
Ehsan Akhgari 7da8d19514 Bug 1328172 - Support downloading internal resources from tooltool in toolchain-script; r=dustin 2017-01-04 12:25:58 -05:00
Carsten "Tomcat" Book b4e6d275b7 merge mozilla-inbound to mozilla-central a=merge 2017-01-04 16:09:56 +01:00
Hammad Akhtar a87299a233 Bug 1326462 - Make the check for duplicate gecko v2 routes, happen during full graph; r=Callek
MozReview-Commit-ID: HkHpfvcjlQG

--HG--
extra : rebase_source : ef66ebfcf77a53cd73cfb864d7fbc5ab5bcdaf86
2017-01-02 19:39:30 +05:30
Dustin J. Mitchell 99e962d0eb Bug 1326544: remove redundant kind name from log messages; r=hammad13060+583205
MozReview-Commit-ID: DFEt4oJs3zO

--HG--
extra : rebase_source : 3a881c16f3af6fa0ae4856d7ef0d6b4eaf362676
2016-12-30 20:41:02 -05:00
Ehsan Akhgari ed0aa5ac19 Bug 1325723 - Rename Windows clang-cl builds to st-an to make them more consistent with other static analysis builds; r=froydnj,dustin 2017-01-03 22:57:47 -05:00
Joel Maher bf3239016b Bug 1326475 - fix small typo in task configuration. r=Callek
Simple typo, but possibly the root cause for scheduling talos
jobs on branches we shouldn't be.

MozReview-Commit-ID: JBSGtbeMJCd
2016-12-30 16:17:00 -05:00
Dustin J. Mitchell 6c70e46f72 Bug 1326232: correctly match tests with try syntax; r=Callek
MozReview-Commit-ID: Brh5ceeBVRk

--HG--
extra : rebase_source : a87fc44d4a23672367c31c23568634b102477c05
2016-12-29 16:46:20 +00:00
Ehsan Akhgari 457a7c1063 Bug 1328459 - Give the clang-tidy jobs names so that their artifacts can be looked up in the index; r=mshal
I'm using static-analysis as the name of the product.
2017-01-04 16:50:09 -05:00
Wes Kocher 6262320e74 Merge m-c to autoland, a=merge 2016-12-28 16:19:59 -08:00
Wes Kocher 2903c33754 Merge inbound to central, a=merge
MozReview-Commit-ID: 3AlcRAsPF0s
2016-12-28 16:08:44 -08:00
Wander Lairson Costa 642d96f221 Bug 1320756: Disable treeherder reporting for BBB jobs. r=dustin
buildbot-bridge schedules jobs on BB, which already reports to
treeherder.

MozReview-Commit-ID: 5wdMzEpXK9o

--HG--
extra : rebase_source : d544c5ca78e0fd9236060a42a1d33b7c88395ca9
2016-12-28 15:05:29 -02:00
Justin Wood 7a44b94e0e Bug 1325398 - Make the check for duplicate Treeherder symbols, happen during `full` graph not `target` graph stage. r=dustin
MozReview-Commit-ID: GfwAgERKdsL

--HG--
extra : rebase_source : 49a6375df512bc90252c7e165bbe0a06c6500307
extra : source : 3fe8f44c7af63e6b85b181e6c1116cc44d1f0975
2016-12-22 11:45:10 -05:00
Dustin J. Mitchell a9383c1d2c Bug 1269443: remove now-unnecessary scopes; r=bstack
MozReview-Commit-ID: Bbk1MPKZIPW

--HG--
extra : rebase_source : 88a9e6e432262dffda698961b250f840fe8cfc19
2016-09-27 15:57:51 +00:00
Dustin J. Mitchell 2003b77fec Bug 1302192: fix python lint; a=me
MozReview-Commit-ID: LiCkvZYHBaX
2016-12-28 15:40:47 +00:00
Dustin J. Mitchell 79d315e9c8 Bug 1302192: require headings to begin a line; r=hammad13060+583205
MozReview-Commit-ID: 4me4VI8Si0h

--HG--
extra : rebase_source : 0bcb53df1973e47d8915fd38e943633cc9706e4f
2016-12-23 22:04:45 +00:00
Dustin J. Mitchell cb6dd785e8 Bug 1302192: combine the android-test and desktop-test kinds into the test kind; r=wcosta r=jmaher
This makes heavy use of by-test-platform to distinguish the various platforms, since Android
mozharness invocations differ substantially from desktop.

MozReview-Commit-ID: GsZFij6VPTf

--HG--
rename : taskcluster/ci/desktop-test/test-platforms.yml => taskcluster/ci/test/test-platforms.yml
rename : taskcluster/ci/desktop-test/test-sets.yml => taskcluster/ci/test/test-sets.yml
rename : taskcluster/ci/desktop-test/tests.yml => taskcluster/ci/test/tests.yml
extra : rebase_source : f1e98bfa3cdf53db7a5348534875f84cccb24397
2016-12-23 22:12:17 +00:00
Dustin J. Mitchell 955d1df32a Bug 1302192: combine desktop_test and android_test transforms; r=wcosta
This combines all of the transforms into a single file, `tests.py`.

It's not quite copy/paste: the transforms have been combined in several cases.
The generated taskgraph does not change with this commit, though.

MozReview-Commit-ID: HA02M8V0SsG

--HG--
rename : taskcluster/taskgraph/transforms/tests/make_task_description.py => taskcluster/taskgraph/transforms/tests.py
extra : rebase_source : aa5979935b0db0871f54be407ca8b83f6715b160
2016-12-23 18:45:35 +00:00
Dustin J. Mitchell 68f9135bb3 Bug 1302192: ensure that only one option matches by-*; r=wcosta
If an item matches exactly, it is always selected.  This will catch the case
where multiple regular expressions match (the previous version would silently
pick one based on dictionary order).

I was worried this was occurring, but because exact matches items are selected,
it is not; still, best to be sure.

MozReview-Commit-ID: EtZBTr61SvE

--HG--
extra : rebase_source : 64300b8722709711d9be66f63f808f4e340532d9
2016-12-23 21:20:51 +00:00
Wes Kocher e28b562783 Merge m-c to inbound, a=merge
MozReview-Commit-ID: 3HW7YWDqTBQ
2016-12-23 14:40:42 -08:00
Wes Kocher 7145ee5d12 Merge inbound to central, a=merge
MozReview-Commit-ID: 56QI5RIvpXC
2016-12-23 14:34:55 -08:00
Dustin J. Mitchell c6e705e174 Bug 1316877: allow 'test-sets' in test-platforms.yml; r=jmaher
This adds a simple layer of indirection to avoid needless repetition of long
lists of tests.

MozReview-Commit-ID: 4hHyoNMwwGy

--HG--
extra : rebase_source : 7731216e9195068a5b000cc894e52d125b63049c
extra : histedit_source : dbe961a08d919284fad42e63c3730a234a3e679b
2016-12-04 15:38:14 -05:00
Brian Stack 434009fae3 Bug 1325479 - Fix repo scopes in action task r=dustin
MozReview-Commit-ID: AGfoFtjR5LI

--HG--
extra : rebase_source : 5903b03e4f3ad12e92b2c98761c2f0ea04cabd4d
2016-12-22 17:08:33 -05:00
Wes Kocher 31ced84f43 Merge m-c to autoland, a=merge 2016-12-22 18:45:10 -08:00
Carsten "Tomcat" Book 0aed7a4ac5 Merge mozilla-central to mozilla-inbound
--HG--
rename : testing/docker/base-build/HASH => taskcluster/docker/base-build/HASH
rename : testing/docker/base-test/HASH => taskcluster/docker/base-test/HASH
rename : testing/docker/centos6-build-upd/HASH => taskcluster/docker/centos6-build-upd/HASH
rename : testing/docker/centos6-build/HASH => taskcluster/docker/centos6-build/HASH
rename : testing/docker/decision/HASH => taskcluster/docker/decision/HASH
rename : testing/docker/image_builder/HASH => taskcluster/docker/image_builder/HASH
rename : testing/docker/recipes/tooltool.py => taskcluster/docker/recipes/tooltool.py
rename : testing/docker/tester/HASH => taskcluster/docker/tester/HASH
2016-12-22 16:25:35 +01:00
Brian Stack 563c66bb85 Bug 1324094 - Add correct cache scopes to action tasks r=armenzg,dustin
MozReview-Commit-ID: KxtG4cHU0Mm

--HG--
extra : rebase_source : 155b4c4b8be716443aaa493a7ed5e3e300305d81
2016-12-16 13:06:57 -08:00
Dustin J. Mitchell c523d27c98 Bug 1325465: add schema helper optionally_keyed_by; r=jmaher
MozReview-Commit-ID: 8CgYe2F3uxY

--HG--
extra : rebase_source : ca0e09762597e1087a000238dbdcd0b519860890
2016-12-22 21:02:29 +00:00
Dustin J. Mitchell d732792887 Bug 1325465: do not set --allow-software-gl-layers on macs; r=jmaher
This option is meaningless on macs, but apparently does not cause errors either.

MozReview-Commit-ID: B418sQEMrCI

--HG--
extra : rebase_source : 58c1ec86491bb6ae094f0014d6df59f0db14511e
extra : source : 0f246fc1227837375316ba0b33e1aec787d783bf
2016-12-04 19:10:19 -05:00
Dustin J. Mitchell 388f0b2d36 Bug 1325465: set the e10s attribute for android tests too; r=wcosta
This is just for consistency with the desktop-test kind, with which
android-test will soon be merged.

MozReview-Commit-ID: C9bEngGM0SZ

--HG--
extra : rebase_source : 0d92171f6f474f1f9e7ed041123bf4b48e72a1c2
extra : source : 053db0beb12a3e5d6f72e3c901a5b2277122ba13
2016-12-04 19:13:20 -05:00
Rob Wood 7e20b1d8c2 Bug 1311814 - TC linux64 talos configs (restricted to try only);r=wcosta
MozReview-Commit-ID: Chn2Pu82X4x

--HG--
extra : rebase_source : d7efb2343811462ff7046b122173a5473e5500a1
2016-11-22 12:12:44 -05:00
Hammad Akhtar fa8e1aa59f Bug 1302804 - Ensure that tasks in a taskgraph do not have duplicate gecko.v2 routes; r=dustin
MozReview-Commit-ID: B4Ok4WhqBVq

--HG--
extra : rebase_source : a2c7908714a8cff4d0eebb73010798cdebb5eb8a
2016-12-21 13:34:04 +05:30
Jonas Finnemann Jensen 1af303239b Bug 1324414 - Reference prebuilt docker images by HASH. r=dustin
This adds a HASH file next to the VERSION file in the image
context folders for prebuilt docker images. And uses the
HASH for referencing the image in the tasks created by
the decision task.

This way docker will validate the image hash when pulling it
in production. Thus, attackers won't be able to inject code
by compromising the remote docker registries we use to store
prebuilt images. Further more, this makes validation of the
Chain-Of-Trust artifacts easier as this eliminates the need
for whitelists and hash validation.

MozReview-Commit-ID: FD3B9MyeU9Q

--HG--
extra : rebase_source : e01cdbd0db06b36ba95dec3da936ee307a23aae7
2016-12-19 11:31:56 +01:00
Hammad Akhtar 1964df62df Bug 1323633 - Ensure that task graphs do not contain duplicate Treeherder symbols, also consider treeherder.collection.keys(); r=dustin
MozReview-Commit-ID: 3F0BHQQmSOg

--HG--
extra : rebase_source : 52ba5d93d689e5ca64cee04dd013dcd79919049d
2016-12-13 11:51:53 +05:30
Sebastian Hengst f3e89595f1 Backed out changeset fe7303de56be (bug 1302763) for failing webdriver tests on Linux x64 debug (geckodriver.manifest fetch failed). r=backout
--HG--
rename : taskcluster/docker/README.md => testing/docker/README.md
rename : taskcluster/docker/REGISTRY => testing/docker/REGISTRY
rename : taskcluster/docker/android-gradle-build/Dockerfile => testing/docker/android-gradle-build/Dockerfile
rename : taskcluster/docker/android-gradle-build/README.md => testing/docker/android-gradle-build/README.md
rename : taskcluster/docker/android-gradle-build/REGISTRY => testing/docker/android-gradle-build/REGISTRY
rename : taskcluster/docker/android-gradle-build/VERSION => testing/docker/android-gradle-build/VERSION
rename : taskcluster/docker/android-gradle-build/bin/after.sh => testing/docker/android-gradle-build/bin/after.sh
rename : taskcluster/docker/android-gradle-build/bin/before.sh => testing/docker/android-gradle-build/bin/before.sh
rename : taskcluster/docker/android-gradle-build/bin/build.sh => testing/docker/android-gradle-build/bin/build.sh
rename : taskcluster/docker/android-gradle-build/bin/checkout-script.sh => testing/docker/android-gradle-build/bin/checkout-script.sh
rename : taskcluster/docker/android-gradle-build/bin/checkout-sources.sh => testing/docker/android-gradle-build/bin/checkout-sources.sh
rename : taskcluster/docker/android-gradle-build/buildprops.json => testing/docker/android-gradle-build/buildprops.json
rename : taskcluster/docker/android-gradle-build/dot-config/pip/pip.conf => testing/docker/android-gradle-build/dot-config/pip/pip.conf
rename : taskcluster/docker/android-gradle-build/oauth.txt => testing/docker/android-gradle-build/oauth.txt
rename : taskcluster/docker/base-build/Dockerfile => testing/docker/base-build/Dockerfile
rename : taskcluster/docker/base-build/VERSION => testing/docker/base-build/VERSION
rename : taskcluster/docker/base-build/system-setup.sh => testing/docker/base-build/system-setup.sh
rename : taskcluster/docker/base-test/Dockerfile => testing/docker/base-test/Dockerfile
rename : taskcluster/docker/base-test/REGISTRY => testing/docker/base-test/REGISTRY
rename : taskcluster/docker/base-test/VERSION => testing/docker/base-test/VERSION
rename : taskcluster/docker/base-test/sources.list => testing/docker/base-test/sources.list
rename : taskcluster/docker/centos6-build-upd/Dockerfile => testing/docker/centos6-build-upd/Dockerfile
rename : taskcluster/docker/centos6-build-upd/REGISTRY => testing/docker/centos6-build-upd/REGISTRY
rename : taskcluster/docker/centos6-build-upd/VERSION => testing/docker/centos6-build-upd/VERSION
rename : taskcluster/docker/centos6-build/Dockerfile => testing/docker/centos6-build/Dockerfile
rename : taskcluster/docker/centos6-build/REGISTRY => testing/docker/centos6-build/REGISTRY
rename : taskcluster/docker/centos6-build/VERSION => testing/docker/centos6-build/VERSION
rename : taskcluster/docker/centos6-build/hgrc => testing/docker/centos6-build/hgrc
rename : taskcluster/docker/centos6-build/system-setup.sh => testing/docker/centos6-build/system-setup.sh
rename : taskcluster/docker/decision/Dockerfile => testing/docker/decision/Dockerfile
rename : taskcluster/docker/decision/README.md => testing/docker/decision/README.md
rename : taskcluster/docker/decision/REGISTRY => testing/docker/decision/REGISTRY
rename : taskcluster/docker/decision/VERSION => testing/docker/decision/VERSION
rename : taskcluster/docker/decision/system-setup.sh => testing/docker/decision/system-setup.sh
rename : taskcluster/docker/desktop-build/Dockerfile => testing/docker/desktop-build/Dockerfile
rename : taskcluster/docker/desktop-build/bin/build.sh => testing/docker/desktop-build/bin/build.sh
rename : taskcluster/docker/desktop-build/bin/checkout-script.sh => testing/docker/desktop-build/bin/checkout-script.sh
rename : taskcluster/docker/desktop-build/bin/checkout-sources.sh => testing/docker/desktop-build/bin/checkout-sources.sh
rename : taskcluster/docker/desktop-build/buildprops.json => testing/docker/desktop-build/buildprops.json
rename : taskcluster/docker/desktop-build/dot-config/pip/pip.conf => testing/docker/desktop-build/dot-config/pip/pip.conf
rename : taskcluster/docker/desktop-build/oauth.txt => testing/docker/desktop-build/oauth.txt
rename : taskcluster/docker/desktop-test/Dockerfile => testing/docker/desktop-test/Dockerfile
rename : taskcluster/docker/desktop-test/apport => testing/docker/desktop-test/apport
rename : taskcluster/docker/desktop-test/buildprops.json => testing/docker/desktop-test/buildprops.json
rename : taskcluster/docker/desktop-test/deja-dup-monitor.desktop => testing/docker/desktop-test/deja-dup-monitor.desktop
rename : taskcluster/docker/desktop-test/dot-files/config/pip/pip.conf => testing/docker/desktop-test/dot-files/config/pip/pip.conf
rename : taskcluster/docker/desktop-test/dot-files/config/user-dirs.dirs => testing/docker/desktop-test/dot-files/config/user-dirs.dirs
rename : taskcluster/docker/desktop-test/dot-files/config/user-dirs.locale => testing/docker/desktop-test/dot-files/config/user-dirs.locale
rename : taskcluster/docker/desktop-test/dot-files/pulse/default.pa => testing/docker/desktop-test/dot-files/pulse/default.pa
rename : taskcluster/docker/desktop-test/fonts.conf => testing/docker/desktop-test/fonts.conf
rename : taskcluster/docker/desktop-test/jockey-gtk.desktop => testing/docker/desktop-test/jockey-gtk.desktop
rename : taskcluster/docker/desktop-test/motd => testing/docker/desktop-test/motd
rename : taskcluster/docker/desktop-test/release-upgrades => testing/docker/desktop-test/release-upgrades
rename : taskcluster/docker/desktop-test/taskcluster-interactive-shell => testing/docker/desktop-test/taskcluster-interactive-shell
rename : taskcluster/docker/desktop-test/tc-vcs-config.yml => testing/docker/desktop-test/tc-vcs-config.yml
rename : taskcluster/docker/desktop-test/tester.env => testing/docker/desktop-test/tester.env
rename : taskcluster/docker/desktop1604-test/Dockerfile => testing/docker/desktop1604-test/Dockerfile
rename : taskcluster/docker/desktop1604-test/apport => testing/docker/desktop1604-test/apport
rename : taskcluster/docker/desktop1604-test/buildprops.json => testing/docker/desktop1604-test/buildprops.json
rename : taskcluster/docker/desktop1604-test/deja-dup-monitor.desktop => testing/docker/desktop1604-test/deja-dup-monitor.desktop
rename : taskcluster/docker/desktop1604-test/dot-files/config/pip/pip.conf => testing/docker/desktop1604-test/dot-files/config/pip/pip.conf
rename : taskcluster/docker/desktop1604-test/dot-files/config/user-dirs.dirs => testing/docker/desktop1604-test/dot-files/config/user-dirs.dirs
rename : taskcluster/docker/desktop1604-test/dot-files/config/user-dirs.locale => testing/docker/desktop1604-test/dot-files/config/user-dirs.locale
rename : taskcluster/docker/desktop1604-test/dot-files/pulse/default.pa => testing/docker/desktop1604-test/dot-files/pulse/default.pa
rename : taskcluster/docker/desktop1604-test/fonts.conf => testing/docker/desktop1604-test/fonts.conf
rename : taskcluster/docker/desktop1604-test/jockey-gtk.desktop => testing/docker/desktop1604-test/jockey-gtk.desktop
rename : taskcluster/docker/desktop1604-test/motd => testing/docker/desktop1604-test/motd
rename : taskcluster/docker/desktop1604-test/release-upgrades => testing/docker/desktop1604-test/release-upgrades
rename : taskcluster/docker/desktop1604-test/taskcluster-interactive-shell => testing/docker/desktop1604-test/taskcluster-interactive-shell
rename : taskcluster/docker/desktop1604-test/tc-vcs-config.yml => testing/docker/desktop1604-test/tc-vcs-config.yml
rename : taskcluster/docker/desktop1604-test/tester.env => testing/docker/desktop1604-test/tester.env
rename : taskcluster/docker/image_builder/Dockerfile => testing/docker/image_builder/Dockerfile
rename : taskcluster/docker/image_builder/REGISTRY => testing/docker/image_builder/REGISTRY
rename : taskcluster/docker/image_builder/VERSION => testing/docker/image_builder/VERSION
rename : taskcluster/docker/image_builder/build-image.sh => testing/docker/image_builder/build-image.sh
rename : taskcluster/docker/image_builder/setup.sh => testing/docker/image_builder/setup.sh
rename : taskcluster/docker/lint/Dockerfile => testing/docker/lint/Dockerfile
rename : taskcluster/docker/lint/system-setup.sh => testing/docker/lint/system-setup.sh
rename : taskcluster/docker/recipes/centos6-build-system-setup.sh => testing/docker/recipes/centos6-build-system-setup.sh
rename : taskcluster/docker/recipes/common.sh => testing/docker/recipes/common.sh
rename : taskcluster/docker/recipes/install-mercurial.sh => testing/docker/recipes/install-mercurial.sh
rename : taskcluster/docker/recipes/run-task => testing/docker/recipes/run-task
rename : taskcluster/docker/recipes/tooltool.py => testing/docker/recipes/tooltool.py
rename : taskcluster/docker/recipes/ubuntu1204-test-system-setup.sh => testing/docker/recipes/ubuntu1204-test-system-setup.sh
rename : taskcluster/docker/recipes/ubuntu1604-test-system-setup.sh => testing/docker/recipes/ubuntu1604-test-system-setup.sh
rename : taskcluster/docker/recipes/xvfb.sh => testing/docker/recipes/xvfb.sh
rename : taskcluster/docker/rust-build/Dockerfile => testing/docker/rust-build/Dockerfile
rename : taskcluster/docker/rust-build/README.md => testing/docker/rust-build/README.md
rename : taskcluster/docker/rust-build/REGISTRY => testing/docker/rust-build/REGISTRY
rename : taskcluster/docker/rust-build/VERSION => testing/docker/rust-build/VERSION
rename : taskcluster/docker/rust-build/build_cargo.sh => testing/docker/rust-build/build_cargo.sh
rename : taskcluster/docker/rust-build/build_rust.sh => testing/docker/rust-build/build_rust.sh
rename : taskcluster/docker/rust-build/build_rust_mac.sh => testing/docker/rust-build/build_rust_mac.sh
rename : taskcluster/docker/rust-build/fetch_cargo.sh => testing/docker/rust-build/fetch_cargo.sh
rename : taskcluster/docker/rust-build/fetch_rust.sh => testing/docker/rust-build/fetch_rust.sh
rename : taskcluster/docker/rust-build/package_rust.sh => testing/docker/rust-build/package_rust.sh
rename : taskcluster/docker/rust-build/repack_rust.py => testing/docker/rust-build/repack_rust.py
rename : taskcluster/docker/rust-build/splat_rust.py => testing/docker/rust-build/splat_rust.py
rename : taskcluster/docker/rust-build/task.json => testing/docker/rust-build/task.json
rename : taskcluster/docker/rust-build/tcbuild.py => testing/docker/rust-build/tcbuild.py
rename : taskcluster/docker/rust-build/upload_rust.sh => testing/docker/rust-build/upload_rust.sh
rename : taskcluster/docker/tester/Dockerfile => testing/docker/tester/Dockerfile
rename : taskcluster/docker/tester/REGISTRY => testing/docker/tester/REGISTRY
rename : taskcluster/docker/tester/VERSION => testing/docker/tester/VERSION
rename : taskcluster/docker/tester/bin/test.sh => testing/docker/tester/bin/test.sh
rename : taskcluster/docker/tester/dot-config/pip/pip.conf => testing/docker/tester/dot-config/pip/pip.conf
rename : taskcluster/docker/tester/dot-config/user-dirs.dirs => testing/docker/tester/dot-config/user-dirs.dirs
rename : taskcluster/docker/tester/dot-config/user-dirs.locale => testing/docker/tester/dot-config/user-dirs.locale
rename : taskcluster/docker/tester/dot-pulse/default.pa => testing/docker/tester/dot-pulse/default.pa
rename : taskcluster/docker/tester/tc-vcs-config.yml => testing/docker/tester/tc-vcs-config.yml
rename : taskcluster/docker/tester/tester.env => testing/docker/tester/tester.env
rename : taskcluster/docker/upload-symbols/Dockerfile => testing/docker/upload-symbols/Dockerfile
rename : taskcluster/docker/upload-symbols/README.md => testing/docker/upload-symbols/README.md
rename : taskcluster/docker/upload-symbols/bin/checkout-script.sh => testing/docker/upload-symbols/bin/checkout-script.sh
rename : taskcluster/docker/upload-symbols/bin/upload.sh => testing/docker/upload-symbols/bin/upload.sh
rename : taskcluster/docker/upload-symbols/test_exports.sh => testing/docker/upload-symbols/test_exports.sh
2016-12-19 21:15:07 +01:00
CuriousLearner 68aa62d8a7 Bug 1302763 - Move docker images out of testing/docker into taskcluster/docker; r=CuriousLearner
MozReview-Commit-ID: 7v1uCDB5qoN

--HG--
rename : testing/docker/README.md => taskcluster/docker/README.md
rename : testing/docker/REGISTRY => taskcluster/docker/REGISTRY
rename : testing/docker/android-gradle-build/Dockerfile => taskcluster/docker/android-gradle-build/Dockerfile
rename : testing/docker/android-gradle-build/README.md => taskcluster/docker/android-gradle-build/README.md
rename : testing/docker/android-gradle-build/REGISTRY => taskcluster/docker/android-gradle-build/REGISTRY
rename : testing/docker/android-gradle-build/VERSION => taskcluster/docker/android-gradle-build/VERSION
rename : testing/docker/android-gradle-build/bin/after.sh => taskcluster/docker/android-gradle-build/bin/after.sh
rename : testing/docker/android-gradle-build/bin/before.sh => taskcluster/docker/android-gradle-build/bin/before.sh
rename : testing/docker/android-gradle-build/bin/build.sh => taskcluster/docker/android-gradle-build/bin/build.sh
rename : testing/docker/android-gradle-build/bin/checkout-script.sh => taskcluster/docker/android-gradle-build/bin/checkout-script.sh
rename : testing/docker/android-gradle-build/bin/checkout-sources.sh => taskcluster/docker/android-gradle-build/bin/checkout-sources.sh
rename : testing/docker/android-gradle-build/buildprops.json => taskcluster/docker/android-gradle-build/buildprops.json
rename : testing/docker/android-gradle-build/dot-config/pip/pip.conf => taskcluster/docker/android-gradle-build/dot-config/pip/pip.conf
rename : testing/docker/android-gradle-build/oauth.txt => taskcluster/docker/android-gradle-build/oauth.txt
rename : testing/docker/base-build/Dockerfile => taskcluster/docker/base-build/Dockerfile
rename : testing/docker/base-build/VERSION => taskcluster/docker/base-build/VERSION
rename : testing/docker/base-build/system-setup.sh => taskcluster/docker/base-build/system-setup.sh
rename : testing/docker/base-test/Dockerfile => taskcluster/docker/base-test/Dockerfile
rename : testing/docker/base-test/REGISTRY => taskcluster/docker/base-test/REGISTRY
rename : testing/docker/base-test/VERSION => taskcluster/docker/base-test/VERSION
rename : testing/docker/base-test/sources.list => taskcluster/docker/base-test/sources.list
rename : testing/docker/centos6-build-upd/Dockerfile => taskcluster/docker/centos6-build-upd/Dockerfile
rename : testing/docker/centos6-build-upd/REGISTRY => taskcluster/docker/centos6-build-upd/REGISTRY
rename : testing/docker/centos6-build-upd/VERSION => taskcluster/docker/centos6-build-upd/VERSION
rename : testing/docker/centos6-build/Dockerfile => taskcluster/docker/centos6-build/Dockerfile
rename : testing/docker/centos6-build/REGISTRY => taskcluster/docker/centos6-build/REGISTRY
rename : testing/docker/centos6-build/VERSION => taskcluster/docker/centos6-build/VERSION
rename : testing/docker/centos6-build/hgrc => taskcluster/docker/centos6-build/hgrc
rename : testing/docker/centos6-build/system-setup.sh => taskcluster/docker/centos6-build/system-setup.sh
rename : testing/docker/decision/Dockerfile => taskcluster/docker/decision/Dockerfile
rename : testing/docker/decision/README.md => taskcluster/docker/decision/README.md
rename : testing/docker/decision/REGISTRY => taskcluster/docker/decision/REGISTRY
rename : testing/docker/decision/VERSION => taskcluster/docker/decision/VERSION
rename : testing/docker/decision/system-setup.sh => taskcluster/docker/decision/system-setup.sh
rename : testing/docker/desktop-build/Dockerfile => taskcluster/docker/desktop-build/Dockerfile
rename : testing/docker/desktop-build/bin/build.sh => taskcluster/docker/desktop-build/bin/build.sh
rename : testing/docker/desktop-build/bin/checkout-script.sh => taskcluster/docker/desktop-build/bin/checkout-script.sh
rename : testing/docker/desktop-build/bin/checkout-sources.sh => taskcluster/docker/desktop-build/bin/checkout-sources.sh
rename : testing/docker/desktop-build/buildprops.json => taskcluster/docker/desktop-build/buildprops.json
rename : testing/docker/desktop-build/dot-config/pip/pip.conf => taskcluster/docker/desktop-build/dot-config/pip/pip.conf
rename : testing/docker/desktop-build/oauth.txt => taskcluster/docker/desktop-build/oauth.txt
rename : testing/docker/desktop-test/Dockerfile => taskcluster/docker/desktop-test/Dockerfile
rename : testing/docker/desktop-test/apport => taskcluster/docker/desktop-test/apport
rename : testing/docker/desktop-test/buildprops.json => taskcluster/docker/desktop-test/buildprops.json
rename : testing/docker/desktop-test/deja-dup-monitor.desktop => taskcluster/docker/desktop-test/deja-dup-monitor.desktop
rename : testing/docker/desktop-test/dot-files/config/pip/pip.conf => taskcluster/docker/desktop-test/dot-files/config/pip/pip.conf
rename : testing/docker/desktop-test/dot-files/config/user-dirs.dirs => taskcluster/docker/desktop-test/dot-files/config/user-dirs.dirs
rename : testing/docker/desktop-test/dot-files/config/user-dirs.locale => taskcluster/docker/desktop-test/dot-files/config/user-dirs.locale
rename : testing/docker/desktop-test/dot-files/pulse/default.pa => taskcluster/docker/desktop-test/dot-files/pulse/default.pa
rename : testing/docker/desktop-test/fonts.conf => taskcluster/docker/desktop-test/fonts.conf
rename : testing/docker/desktop-test/jockey-gtk.desktop => taskcluster/docker/desktop-test/jockey-gtk.desktop
rename : testing/docker/desktop-test/motd => taskcluster/docker/desktop-test/motd
rename : testing/docker/desktop-test/release-upgrades => taskcluster/docker/desktop-test/release-upgrades
rename : testing/docker/desktop-test/taskcluster-interactive-shell => taskcluster/docker/desktop-test/taskcluster-interactive-shell
rename : testing/docker/desktop-test/tc-vcs-config.yml => taskcluster/docker/desktop-test/tc-vcs-config.yml
rename : testing/docker/desktop-test/tester.env => taskcluster/docker/desktop-test/tester.env
rename : testing/docker/desktop1604-test/Dockerfile => taskcluster/docker/desktop1604-test/Dockerfile
rename : testing/docker/desktop1604-test/apport => taskcluster/docker/desktop1604-test/apport
rename : testing/docker/desktop1604-test/buildprops.json => taskcluster/docker/desktop1604-test/buildprops.json
rename : testing/docker/desktop1604-test/deja-dup-monitor.desktop => taskcluster/docker/desktop1604-test/deja-dup-monitor.desktop
rename : testing/docker/desktop1604-test/dot-files/config/pip/pip.conf => taskcluster/docker/desktop1604-test/dot-files/config/pip/pip.conf
rename : testing/docker/desktop1604-test/dot-files/config/user-dirs.dirs => taskcluster/docker/desktop1604-test/dot-files/config/user-dirs.dirs
rename : testing/docker/desktop1604-test/dot-files/config/user-dirs.locale => taskcluster/docker/desktop1604-test/dot-files/config/user-dirs.locale
rename : testing/docker/desktop1604-test/dot-files/pulse/default.pa => taskcluster/docker/desktop1604-test/dot-files/pulse/default.pa
rename : testing/docker/desktop1604-test/fonts.conf => taskcluster/docker/desktop1604-test/fonts.conf
rename : testing/docker/desktop1604-test/jockey-gtk.desktop => taskcluster/docker/desktop1604-test/jockey-gtk.desktop
rename : testing/docker/desktop1604-test/motd => taskcluster/docker/desktop1604-test/motd
rename : testing/docker/desktop1604-test/release-upgrades => taskcluster/docker/desktop1604-test/release-upgrades
rename : testing/docker/desktop1604-test/taskcluster-interactive-shell => taskcluster/docker/desktop1604-test/taskcluster-interactive-shell
rename : testing/docker/desktop1604-test/tc-vcs-config.yml => taskcluster/docker/desktop1604-test/tc-vcs-config.yml
rename : testing/docker/desktop1604-test/tester.env => taskcluster/docker/desktop1604-test/tester.env
rename : testing/docker/image_builder/Dockerfile => taskcluster/docker/image_builder/Dockerfile
rename : testing/docker/image_builder/REGISTRY => taskcluster/docker/image_builder/REGISTRY
rename : testing/docker/image_builder/VERSION => taskcluster/docker/image_builder/VERSION
rename : testing/docker/image_builder/build-image.sh => taskcluster/docker/image_builder/build-image.sh
rename : testing/docker/image_builder/setup.sh => taskcluster/docker/image_builder/setup.sh
rename : testing/docker/lint/Dockerfile => taskcluster/docker/lint/Dockerfile
rename : testing/docker/lint/system-setup.sh => taskcluster/docker/lint/system-setup.sh
rename : testing/docker/recipes/centos6-build-system-setup.sh => taskcluster/docker/recipes/centos6-build-system-setup.sh
rename : testing/docker/recipes/common.sh => taskcluster/docker/recipes/common.sh
rename : testing/docker/recipes/install-mercurial.sh => taskcluster/docker/recipes/install-mercurial.sh
rename : testing/docker/recipes/run-task => taskcluster/docker/recipes/run-task
rename : testing/docker/recipes/tooltool.py => taskcluster/docker/recipes/tooltool.py
rename : testing/docker/recipes/ubuntu1204-test-system-setup.sh => taskcluster/docker/recipes/ubuntu1204-test-system-setup.sh
rename : testing/docker/recipes/ubuntu1604-test-system-setup.sh => taskcluster/docker/recipes/ubuntu1604-test-system-setup.sh
rename : testing/docker/recipes/xvfb.sh => taskcluster/docker/recipes/xvfb.sh
rename : testing/docker/rust-build/Dockerfile => taskcluster/docker/rust-build/Dockerfile
rename : testing/docker/rust-build/README.md => taskcluster/docker/rust-build/README.md
rename : testing/docker/rust-build/REGISTRY => taskcluster/docker/rust-build/REGISTRY
rename : testing/docker/rust-build/VERSION => taskcluster/docker/rust-build/VERSION
rename : testing/docker/rust-build/build_cargo.sh => taskcluster/docker/rust-build/build_cargo.sh
rename : testing/docker/rust-build/build_rust.sh => taskcluster/docker/rust-build/build_rust.sh
rename : testing/docker/rust-build/build_rust_mac.sh => taskcluster/docker/rust-build/build_rust_mac.sh
rename : testing/docker/rust-build/fetch_cargo.sh => taskcluster/docker/rust-build/fetch_cargo.sh
rename : testing/docker/rust-build/fetch_rust.sh => taskcluster/docker/rust-build/fetch_rust.sh
rename : testing/docker/rust-build/package_rust.sh => taskcluster/docker/rust-build/package_rust.sh
rename : testing/docker/rust-build/repack_rust.py => taskcluster/docker/rust-build/repack_rust.py
rename : testing/docker/rust-build/splat_rust.py => taskcluster/docker/rust-build/splat_rust.py
rename : testing/docker/rust-build/task.json => taskcluster/docker/rust-build/task.json
rename : testing/docker/rust-build/tcbuild.py => taskcluster/docker/rust-build/tcbuild.py
rename : testing/docker/rust-build/upload_rust.sh => taskcluster/docker/rust-build/upload_rust.sh
rename : testing/docker/tester/Dockerfile => taskcluster/docker/tester/Dockerfile
rename : testing/docker/tester/REGISTRY => taskcluster/docker/tester/REGISTRY
rename : testing/docker/tester/VERSION => taskcluster/docker/tester/VERSION
rename : testing/docker/tester/bin/test.sh => taskcluster/docker/tester/bin/test.sh
rename : testing/docker/tester/dot-config/pip/pip.conf => taskcluster/docker/tester/dot-config/pip/pip.conf
rename : testing/docker/tester/dot-config/user-dirs.dirs => taskcluster/docker/tester/dot-config/user-dirs.dirs
rename : testing/docker/tester/dot-config/user-dirs.locale => taskcluster/docker/tester/dot-config/user-dirs.locale
rename : testing/docker/tester/dot-pulse/default.pa => taskcluster/docker/tester/dot-pulse/default.pa
rename : testing/docker/tester/tc-vcs-config.yml => taskcluster/docker/tester/tc-vcs-config.yml
rename : testing/docker/tester/tester.env => taskcluster/docker/tester/tester.env
rename : testing/docker/upload-symbols/Dockerfile => taskcluster/docker/upload-symbols/Dockerfile
rename : testing/docker/upload-symbols/README.md => taskcluster/docker/upload-symbols/README.md
rename : testing/docker/upload-symbols/bin/checkout-script.sh => taskcluster/docker/upload-symbols/bin/checkout-script.sh
rename : testing/docker/upload-symbols/bin/upload.sh => taskcluster/docker/upload-symbols/bin/upload.sh
rename : testing/docker/upload-symbols/test_exports.sh => taskcluster/docker/upload-symbols/test_exports.sh
extra : rebase_source : 2cf145867ff1f14f8e64b20e88e93fabaff3e756
extra : source : 50adff295bf00ea0d9d7426e745acf3635e7dba5
2016-10-20 18:25:34 +05:30
Peter Moore 43d8906bc4 Bug 1319487 - don't explicitly set env vars APPDATA, LOCALAPPDATA, TEMP, TMP in generic-worker tasks,r=grenade 2016-12-16 17:28:36 +01:00
Brian Stack aa3683d105 Bug 1289823 - Add backfilling as an action-task r=armenzg,dustin
MozReview-Commit-ID: HALwE6Q0Lch

--HG--
extra : rebase_source : de9329c46bb9d50e44d29181095577326e039b73
2016-12-07 13:33:20 -10:00
Brian Stack 9ab478af57 Bug 1289823 - Make taskcluster action-task more flexible r=armenzg,dustin
MozReview-Commit-ID: 8qoJsFeFm6I

--HG--
extra : rebase_source : def57f82265534d6f3d7d3f6ee627c66c4bf28bc
2016-11-28 14:15:31 -08:00
Phil Ringnalda 4aef1bde99 Backed out changeset 6034929c3e4a (bug 1302802) for decision task bustage
CLOSED TREE
2016-12-13 10:01:05 -08:00
Hammad Akhtar b92e9673e7 Bug 1302802 - Ensure that task graphs do not contain duplicate Treeherder symbols; r=dustin
MozReview-Commit-ID: LO2fEbxzZH2

--HG--
extra : rebase_source : 0949a6ff585401fd6f7197b5aca1fe95c96f8a10
2016-12-13 11:51:53 +05:30
Hammad Akhtar 4dd59586f3 Bug 1289779 - Make sure that different docker-image tasks use different job symbols; r=dustin
MozReview-Commit-ID: 2sn231bKJ1z

--HG--
extra : rebase_source : 8094c6677c6927dfd2e50203b8f918ec3c78b8cf
2016-12-13 13:39:47 +05:30
Phil Ringnalda bb36034cd4 Backed out changeset 1acac2205dc3 (bug 1311814) for having Taskcluster tell buildbot to run talos jobs on branches where no talos builders exist
MozReview-Commit-ID: 6GB1XqWb8fG
2016-12-11 11:32:38 -08:00
Hammad Akhtar 079365ac41 Bug 1322193 - Verify taskgraph implementations against documentation, with proper regex. Updated doc verification for fake values of kinds, parameters etc., regex optimized r=Callek
MozReview-Commit-ID: 56ZEJECbtK5

--HG--
extra : rebase_source : ad1efed52363e95040a9907c6387b4cd57bdaa49
2016-12-06 12:03:36 +05:30
Carsten "Tomcat" Book 3e157ac240 merge mozilla-inbound to mozilla-central a=merge 2016-12-08 16:16:48 +01:00
Nathan Froyd c482f7591d Bug 1321444 - part 5 - add taskcluster windows clang jobs; r=dustin
We need to define the jobs and we also need to whitelist them appropriately.
2016-12-03 06:38:22 -05:00
Mike Shal 2214443444 Bug 1279221 - Remove buildbot routes for Taskcluster tasks; r=dustin
MozReview-Commit-ID: A2YxsnWo9ek

--HG--
extra : rebase_source : 2f979352c9ef2adbb33f386eb45a383cc142832b
2016-11-29 15:02:00 -05:00
Rob Wood 5379f7712e Bug 1311814 - talos tc configs for linux; r=wcosta
MozReview-Commit-ID: 7rzzqdGRwJU

--HG--
extra : rebase_source : 07aa846c5c1760bd635459d779fefc1f407e429c
2016-11-22 12:12:44 -05:00
Hammad Akhtar 5267b83943 Bug 1302800 - Verify taskgraph implementations against documentation; r=dustin
MozReview-Commit-ID: J8djr4ifvzm

--HG--
extra : rebase_source : 8112a13fdb8e4bc1b004757411384e224305b2ac
2016-11-26 01:22:46 +05:30
Rob Thijssen d258cf41e9 Bug 1321776 - enable green tc win tests on tier 3. r=jmaher
MozReview-Commit-ID: 5IpUMcEfZBH

--HG--
extra : rebase_source : fd77ecbcf866a4a0ab3e21c74e30fd8272f15435
2016-12-02 11:24:42 +00:00
Justin Wood 6fe0be02c7 Bug 1321614 - fix android_stuff kind to use build secrets, because it uses the same mozharness stuff as build jobs. r=dustin
MozReview-Commit-ID: D6wV1KSa6mp

--HG--
extra : rebase_source : ea2a3ad899d9e099631c0d06efceeaf260383f0a
2016-12-01 14:13:16 -05:00
Andrew Halberstadt 541a302cee Bug 1318438 - [taskcluster] "job" tasks should have ability to run on multiple platforms, r=dustin
This adds an optional "platforms" key to the job description. It can be used in conjunction with
"by-platform" like so:

platforms:
    - linux
    - windows
worker-type:
    by-platform:
        linux: ...
        windows: ...
worker:
    by-platform:
        linux: ...
        windows: ...

MozReview-Commit-ID: JwL1NAR4bnY

--HG--
extra : rebase_source : 637dd777912e256d82092ba3e0edd6937cbb03c6
2016-11-18 15:07:56 -05:00
Dustin J. Mitchell 84887ecca6 Bug 1321330: fix some aliasing issues; r=jmaher
Always copy objects after schema validation applies defaults, in case the
defaults are mutable (`.., default=[]`)

When duplicating objects for e10s, copy *before* yielding, as the object will
be mutated before the yield returns.

As a consequence of the previous point, tests have not yet had `extra-options`
expanded via `by-test-platform` when it comes time to append to it, so perform
that expansion early.  This will get cleaner when bug 1302192 is completd.

MozReview-Commit-ID: 76z4OlqZg82

--HG--
extra : rebase_source : 26a6a59c5cad21b27e5054b21fe5deef27aa6896
2016-11-30 18:45:55 +00:00
Hammad Akhtar 0c3b469c02 Bug 1302765 - Allow `./mach taskgraph .. --parameters P` to take a URL. URL building mechanism fixed; r=dustin
MozReview-Commit-ID: 7reezQj9Bds

--HG--
extra : rebase_source : a571294e80491b0918e21697d922abfaa91432b6
2016-11-24 01:15:33 +05:30
Gregory Szorc afe18feb0a Bug 1269355 - Insert blank line to appease the flake8 linting overlord; r=me
Fixes bustage from c1b55d39dd28.
2016-11-22 18:54:16 -08:00
Ted Mielczarek 6673bfebc4 bug 1316329 - build from a symlink dir in generic-worker builds. r=pmoore,gps
MozReview-Commit-ID: EXp08oIquPF

--HG--
extra : rebase_source : f4c7b04fb6e22d837460dac98caee41259c1c62c
2016-11-14 11:47:59 -05:00
Ted Mielczarek 1c52e9500b bug 1269355 - Enable sccache for taskcluster linux32/64 builds. r=dustin,gps
MozReview-Commit-ID: LGqpNDb7uHN

--HG--
extra : rebase_source : dfd3d0c7208178d7a44cd49a84cd1ead194e8095
2016-11-10 13:02:54 -05:00
Carsten "Tomcat" Book e0f46513b6 Merge mozilla-central to mozilla-inbound 2016-11-22 16:28:50 +01:00
HAMMAD AKHTAR 0455672103 Bug 1311810: changing desktop-test-* to gecko-t*; r=dustin
MozReview-Commit-ID: WuXZWOsK5z

--HG--
extra : rebase_source : 5f64920b9686dd28c1a0cd3c7e3f807314dc01ae
2016-11-21 20:55:48 +00:00
Wander Lairson Costa faf6866243 Bug 1316077 part 1: Support buildbot-bridge for talos tests. r=dustin
While we don't have physical machines running taskcluster-worker, we
want to schedule talos tests on Taskcluster and run them on buildbot.

buildbot-bridge acts as a worker that runs its tasks in buildbot
machines. Any talos task is redirected to buildbot-bridge.

MozReview-Commit-ID: Im9IhhT0Mr1

--HG--
extra : rebase_source : ede38a683abdf411612e885f6985c79b0532cb46
2016-11-18 16:52:15 -02:00
Julian Seward e601de1cd1 Bug 1254964 - Enable manual taskcluster scheduling for valgrind-mochitest runs. r=dustin@mozilla.com.
--HG--
extra : rebase_source : c438dbffd83fa339e35d4804fda2e33ddbe97f36
2016-11-22 11:25:01 +01:00
Gregory Szorc 743fc9a44c Bug 1318200 - Filter Stylo platforms when Servo isn't available; r=dustin
Stylo automation doesn't work unless Servo is present in the source
directory. This commit introduces a "check_servo" filter that prunes
tasks requiring Servo. Currently, this is implemented as a test against
platforms that are unique to Servo.

The use of relative path checking to find the topsrcdir is a bit
unfortunate. But we use this pattern elsewhere in this code.

MozReview-Commit-ID: IRtd53tudJW

--HG--
extra : rebase_source : 8c4742c13878d762fe7970eedfa5937fdaebe8c4
2016-11-17 17:10:01 -08:00
Gregory Szorc 0e12f1cc60 Bug 1318200 - Introduce task graph filtering; r=dustin
Previously, we ran a single "target task" function to mutate the full
task graph into a subset based on input parameters (try syntax,
repository being built for, etc). This concept is useful. But
the implementation was limiting because we could only have a single
"target tasks" function.

This commit introduces the concept of "filters." They conceptually
do the same thing as "target tasks methods" but you can run more than
1 of them.

Filters are simply functions that examine an input graph+parameters
and emit nodes that should be retained. Filters, like target tasks
methods, are defined via decorated functions in a module.

TaskGraphGenerator has been converted to use filters. The list of
defined filters can be defined in the parameters dict passed into
TaskGraphGenerator. A default filter list is provided in decision.py.

The intent is to eventually convert target tasks to filters. Until
that happens, we always run the registered target tasks method via
a filter proxy function.

No new tests have been added because we don't yet have any
functionality relying explicitly on filters. Tests will be added in
a subsequent commit once we add a new filter.

While I was here, I also snuck in some logging on the size of the
graphs.

MozReview-Commit-ID: ERn2hIYbMRp

--HG--
extra : rebase_source : 36b8e86aa64b2f52b03b31b5497759b0009fb921
2016-11-17 15:53:30 -08:00
Gregory Szorc bd86442e13 Bug 1318200 - Obtain target tasks method from parameters; r=dustin
Previously, all callers outside of tests that passed
"target_tasks_method" to TaskGraphGenerator all used the same pattern
of looking for a key in the parameters and calling a function in
the target_tasks module.

Future commits will refactor how target tasks graph work. To
make the transition easier, we move the logic for obtaining the
target tasks method into TaskGraphGenerator.

MozReview-Commit-ID: 3QU09iGhoXh

--HG--
extra : rebase_source : fbcc31d705c4b0e148aa3709ddcb18ad99953231
2016-11-17 16:29:51 -08:00
Gregory Szorc 6fd7392903 Bug 1318200 - TaskCluster CI for Stylo; r=dustin
This commit introduces support for performing build and test variations
with Stylo enabled.

From a high level, this is similar to the e10s/non-e10s variations that
we currently run. However, it is different in that Stylo is a build
time (not run time) flag. So, we need to perform separate builds for
Stylo.

In the current implementation of the task graph, we can either
introduce a new platform or a new build type/configuration. I've
chosen to introduce a new platform if nothing else so the Treeherder
results clearly separate Stylo from non-Stylo. This decision can be
revisited in the future once Stylo becomes more stable and visible
outside the "stylo" repository.

Stylo functionality is limited to layout functionality and Stylo
developers aren't very interested in many tests not related to layout
at the moment. So we introduce a new test set running a limited
functionality of tests in Stylo builds.

In the current state of this commit, Stylo builds will permafail.
This is because Stylo builds require a vendored copy of Servo. Logic
for pruning the task graph of Stylo/Servo related tasks will be
implemented in subsequent commits.

MozReview-Commit-ID: JivhkpXDjIw

--HG--
extra : rebase_source : fdc9a5300c0bfa27133478fc456bc618f26fb9b2
2016-11-17 09:52:39 -08:00
Sebastian Hengst 0acd4ede3e Bug 1318099 - Disable artifact build tasks on the graphics branch: add empty line to make flake8 happy. r=flake8-fix 2016-11-18 00:25:36 +01:00
Kartikaya Gupta 9cb5f9e9cf Bug 1318099 - Disable artifact build tasks on the graphics branch. r=dustin
MozReview-Commit-ID: 2whpCUpZTtv

--HG--
extra : rebase_source : 1406fe794e3e6c28139a83b75489444cd6f9f9d7
2016-11-16 15:40:55 -05:00
Rob Thijssen e8a2815ded Bug 1311966 - symlink rather than copy artifacts; r=pmoore
MozReview-Commit-ID: 5cFjuwtUgEr

--HG--
extra : rebase_source : ab58c9d091b51235566e97b139de365873e41aaa
2016-11-16 13:31:48 +00:00
Brian Stack ee34799ca7 Bug 1316961 - Fix parameters for action tasks. r=dustin
MozReview-Commit-ID: 95xs7NRHSdi

--HG--
extra : rebase_source : acfcd50ddced904c4a9e3aace8808a097caab398
2016-11-14 10:28:58 -08:00
Jonas Finnemann Jensen d83197756c Bug 1316446 - Improve mach taskcluster-load-image r=gps
MozReview-Commit-ID: 3Y8fI5WXP1Y

--HG--
extra : rebase_source : a6411fd161bc9222e4a6c788f077d7d9b1fada35
2016-11-10 18:05:52 -08:00
Andrew Halberstadt adbd485b6e Bug 1275943 - Ensure job tasks are added to target set even if no try syntax specified, r=dustin
Job tasks are tasks that are not tied to a specific build or test. As such, they cannot be scheduled
with the regular -p/-u try syntax options. There exists a -j try syntax option, to schedule them, which
defaults to running "all" of them if not specified.

However, there is a bug here where they will only default to "all" if a try syntax exists in the commit
message. They will not be considered if a developer pushes to try without a try syntax. This happens
because self.jobs is initially initialized with '[]' and we use None to determine when to schedule "all"
later on.

I want to move towards a world without try syntax, so we should start improving the UX of the no try
syntax use case.

Note: When I say "schedule" here, I mean added to the target set. They may still be optimized away.

MozReview-Commit-ID: 4TrC84RGiaL

--HG--
extra : rebase_source : 8fd50113c37745bc10181e1311cc62d75485723a
2016-11-14 14:29:50 -05:00
Jonas Finnemann Jensen 2cd49e189e Bug 1316183 - Compress docker images with zstd. r=dustin
* Compress docker images with zstd
 * Removed need for context.tar from decision task
 * Index images by level rather than project

MozReview-Commit-ID: 4RL4QXNWmpd

--HG--
extra : rebase_source : 677d8030a15af3288866a70fc648a10b22c396a3
2016-11-07 11:26:27 -08:00
Wes Kocher 41c087935b Merge m-c to inbound, a=merge 2016-11-08 14:08:34 -08:00
Wander Lairson Costa 9950817294 Bug 1274980 part 2: Support Mac OS tests in tc intree config. r=dustin
We add support for Mac OSX tests in Taskcluster by support
taskcluster-worker macosx engine. We also add a new configuration
blob-upload-branch needed by mochitest-other.

MozReview-Commit-ID: 5ZaYYRueRVr

--HG--
extra : rebase_source : f81b3d97d44797a323431a640b1f8e29bf192606
2016-11-08 12:11:15 -02:00
Wander Lairson Costa 9caaae3ed3 Bug 1274980 part 1: Add support for test platform regex match. r=dustin
Often we need to setup a test configuration for different platforms, but
not for different platform builds (opt/debug). This leads to cumbersome
configuration duplicates. This patch adds support for platform regular
expression matching. For example, if you want to configure the chunk
size for linux64 platform both for opt and debug, originally you would
do this:

chunks:
    by-test-platform:
        linux64/opt: 4
        linux64/debug: 4
        default: 8

With regular expression matching, you only need:

chunks:
    by-test-platform:
        linux64/.*: 4
        default: 8

This patch was originally written by Geoffrey Brown for Windows support.

MozReview-Commit-ID: KbMHV7UkTLe

--HG--
extra : rebase_source : 79a4344c7e3e978bb6b93713c6e6e4114ba5d5b8
2016-11-08 12:11:15 -02:00
Kim Moir 9e85c7c832 Bug 1315690 - Limit cedar TC tests to Linux64 mochitest* and xpcshell only (fix lint errors) u=aselagea r=dustin 2016-11-08 09:36:19 -05:00
Kim Moir 35b93a38b7 Bug 1315690 - Limit cedar TC tests to Linux64 mochitest* and xpcshell only u=aselagea r=dustin 2016-11-08 09:22:17 -05:00
Dustin J. Mitchell aaabbac964 Bug 1296842: check parameters; r=jmaher
MozReview-Commit-ID: 1JCpufowNHD

--HG--
extra : rebase_source : 3409f417070751615d799cbda3f99d8e9029dda3
2016-11-07 19:13:40 +00:00
Dustin J. Mitchell 51aa1fc9fb Bug 1296842: make target-task related parameters a fixed set; r=jmaher
The `from_parameters` method was never used, and let do confusion over the role
of these parameters.  Now there are only two, and they are always required.

MozReview-Commit-ID: AbPqijXucu5

--HG--
extra : rebase_source : 85affd063a543c549afaaa36ce7ee31ed1f943d5
2016-11-07 19:13:34 +00:00
Joel Maher bbfd3040db Bug 1315145 - disable SETA on tier-1 platforms temporarily. r=dustin
MozReview-Commit-ID: 2royNntQxB2

--HG--
extra : rebase_source : b77fa8845d2b7e3370e2470370f280114644b906
2016-11-07 13:39:23 -05:00
Sebastian Hengst c663cd7c34 Backed out changeset b8760b0b11ac (bug 1274980) on suspicion of breaking marionette tests in taskcluster. r=backout on a CLOSED TREE 2016-11-07 18:57:58 +01:00
Sebastian Hengst ebc8c22b60 Backed out changeset 6228dfcfac3b (bug 1274980) 2016-11-07 17:57:04 +01:00
Sebastian Hengst acb7cd32d4 Backed out changeset c45f2ebe0e66 (bug 1274980) 2016-11-07 17:56:41 +01:00
Wander Lairson Costa f03f376d43 Bug 1274980 part 3: Fix flake8 errors. r=tomcat 2016-11-07 05:15:00 +01:00
Wander Lairson Costa 41ed0a2cdf Bug 1274980 part 2: Support Mac OS tests in tc intree config. r=dustin
We add support for Mac OSX tests in Taskcluster by support
taskcluster-worker macosx engine. We also add a new configuration
blob-upload-branch needed by mochitest-other.

MozReview-Commit-ID: CxT3BP3sydG

--HG--
extra : rebase_source : 25e16bf5b5d5a8121fd431788185d318612d7ea5
2016-11-07 09:20:50 -02:00
Wander Lairson Costa 4e8662ab83 Bug 1274980 part 1: Add support for test platform regex match. r=dustin
Often we need to setup a test configuration for different platforms, but
not for different platform builds (opt/debug). This leads to cumbersome
configuration duplicates. This patch adds support for platform regular
expression matching. For example, if you want to configure the chunk
size for linux64 platform both for opt and debug, originally you would
do this:

chunks:
    by-test-platform:
        linux64/opt: 4
        linux64/debug: 4
        default: 8

With regular expression matching, you only need:

chunks:
    by-test-platform:
        linux64/.*: 4
        default: 8

This patch was originally written by Geoffrey Brown for Windows support.

MozReview-Commit-ID: HFP52N9Ef0k

--HG--
extra : rebase_source : d2a5129b7459fc7f71f59da76d45526cef028e44
2016-11-07 09:20:50 -02:00
Jordan Lund c569b6a415 Bug 1314795 - introduce build_date to params that defaults to pushdate, r=dustin
MozReview-Commit-ID: AviPKtw3BiY

--HG--
extra : rebase_source : 03ea3a98f84ecf977280beff88e69b292c12886d
2016-11-02 19:23:27 -07:00
Wes Kocher db15df3e50 Merge m-c to inbound, a=merge CLOSED TREE 2016-11-04 15:19:49 -07:00
Nathan Froyd 8742cf38dc Bug 1306650 - part 15 - update windows toolchain builds to use |hg robustcheckout|; r=pmoore
This change is needed after recent changes removed the shared hg checkout on C:.
2016-11-04 20:24:38 -04:00
Wes Kocher 16a45d598b Backed out changeset 36b1cce63e74 (bug 1314795) for lint failures a=backout CLOSED TREE 2016-11-03 17:04:16 -07:00
Jordan Lund 124d2f3f4c Bug 1314795 - introduce build_date to params that defaults to pushdate, r=dustin
MozReview-Commit-ID: AviPKtw3BiY

--HG--
extra : rebase_source : aed70ad54badfdd3e200acbbca85cf8372f54698
2016-11-02 19:23:27 -07:00
Gregory Szorc c328879fc5 Bug 1314807 - Change ownership of files in workspace; r=dustin
The other changesets for this bug worked on Try but failed on
autoland due to permissions failures in /home/worker/workspace.
Ensure the files have the proper permissions.

The path is a cache with the repo and build type keyed into it.
So there should be no problem with this change causing permissions
issues for other tasks.

--HG--
extra : amend_source : 1fa1c2f7a22afabd4b2e252a268b2f492238966c
2016-11-03 08:10:15 -07:00
Gregory Szorc 7a61d25ab6 Bug 1314807 - Use run-task in hazard kind; r=dustin
As part of this, we eliminate tc-vcs since it is redundant with run-task.

MozReview-Commit-ID: 8HAFSM73BOU

--HG--
extra : rebase_source : 92947b92ce23a7ca4aa885d4dfd073d72410ae16
2016-11-02 15:45:40 -07:00
Kim Moir c488cc0a40 Bug 1296396 - remove configs that reference fx-team in tc and buildbot u=aselagea r=kmoir 2016-11-02 10:53:19 -04:00
CuriousLearner e67707b149 Bug 1302763 - Move docker images out of testing/docker into taskcluster/docker; r=dustin r=CuriousLearner
MozReview-Commit-ID: 7v1uCDB5qoN

--HG--
rename : testing/docker/README.md => taskcluster/docker/README.md
rename : testing/docker/REGISTRY => taskcluster/docker/REGISTRY
rename : testing/docker/android-gradle-build/Dockerfile => taskcluster/docker/android-gradle-build/Dockerfile
rename : testing/docker/android-gradle-build/README.md => taskcluster/docker/android-gradle-build/README.md
rename : testing/docker/android-gradle-build/REGISTRY => taskcluster/docker/android-gradle-build/REGISTRY
rename : testing/docker/android-gradle-build/VERSION => taskcluster/docker/android-gradle-build/VERSION
rename : testing/docker/android-gradle-build/bin/after.sh => taskcluster/docker/android-gradle-build/bin/after.sh
rename : testing/docker/android-gradle-build/bin/before.sh => taskcluster/docker/android-gradle-build/bin/before.sh
rename : testing/docker/android-gradle-build/bin/build.sh => taskcluster/docker/android-gradle-build/bin/build.sh
rename : testing/docker/android-gradle-build/bin/checkout-script.sh => taskcluster/docker/android-gradle-build/bin/checkout-script.sh
rename : testing/docker/android-gradle-build/bin/checkout-sources.sh => taskcluster/docker/android-gradle-build/bin/checkout-sources.sh
rename : testing/docker/android-gradle-build/buildprops.json => taskcluster/docker/android-gradle-build/buildprops.json
rename : testing/docker/android-gradle-build/dot-config/pip/pip.conf => taskcluster/docker/android-gradle-build/dot-config/pip/pip.conf
rename : testing/docker/android-gradle-build/oauth.txt => taskcluster/docker/android-gradle-build/oauth.txt
rename : testing/docker/base-build/Dockerfile => taskcluster/docker/base-build/Dockerfile
rename : testing/docker/base-build/HASH => taskcluster/docker/base-build/HASH
rename : testing/docker/base-build/VERSION => taskcluster/docker/base-build/VERSION
rename : testing/docker/base-build/system-setup.sh => taskcluster/docker/base-build/system-setup.sh
rename : testing/docker/base-test/Dockerfile => taskcluster/docker/base-test/Dockerfile
rename : testing/docker/base-test/HASH => taskcluster/docker/base-test/HASH
rename : testing/docker/base-test/REGISTRY => taskcluster/docker/base-test/REGISTRY
rename : testing/docker/base-test/VERSION => taskcluster/docker/base-test/VERSION
rename : testing/docker/base-test/sources.list => taskcluster/docker/base-test/sources.list
rename : testing/docker/centos6-build-upd/Dockerfile => taskcluster/docker/centos6-build-upd/Dockerfile
rename : testing/docker/centos6-build-upd/HASH => taskcluster/docker/centos6-build-upd/HASH
rename : testing/docker/centos6-build-upd/REGISTRY => taskcluster/docker/centos6-build-upd/REGISTRY
rename : testing/docker/centos6-build-upd/VERSION => taskcluster/docker/centos6-build-upd/VERSION
rename : testing/docker/centos6-build/Dockerfile => taskcluster/docker/centos6-build/Dockerfile
rename : testing/docker/centos6-build/HASH => taskcluster/docker/centos6-build/HASH
rename : testing/docker/centos6-build/REGISTRY => taskcluster/docker/centos6-build/REGISTRY
rename : testing/docker/centos6-build/VERSION => taskcluster/docker/centos6-build/VERSION
rename : testing/docker/centos6-build/hgrc => taskcluster/docker/centos6-build/hgrc
rename : testing/docker/centos6-build/system-setup.sh => taskcluster/docker/centos6-build/system-setup.sh
rename : testing/docker/decision/Dockerfile => taskcluster/docker/decision/Dockerfile
rename : testing/docker/decision/HASH => taskcluster/docker/decision/HASH
rename : testing/docker/decision/README.md => taskcluster/docker/decision/README.md
rename : testing/docker/decision/REGISTRY => taskcluster/docker/decision/REGISTRY
rename : testing/docker/decision/VERSION => taskcluster/docker/decision/VERSION
rename : testing/docker/decision/system-setup.sh => taskcluster/docker/decision/system-setup.sh
rename : testing/docker/desktop-build/Dockerfile => taskcluster/docker/desktop-build/Dockerfile
rename : testing/docker/desktop-build/bin/build.sh => taskcluster/docker/desktop-build/bin/build.sh
rename : testing/docker/desktop-build/bin/checkout-script.sh => taskcluster/docker/desktop-build/bin/checkout-script.sh
rename : testing/docker/desktop-build/bin/checkout-sources.sh => taskcluster/docker/desktop-build/bin/checkout-sources.sh
rename : testing/docker/desktop-build/buildprops.json => taskcluster/docker/desktop-build/buildprops.json
rename : testing/docker/desktop-build/dot-config/pip/pip.conf => taskcluster/docker/desktop-build/dot-config/pip/pip.conf
rename : testing/docker/desktop-build/oauth.txt => taskcluster/docker/desktop-build/oauth.txt
rename : testing/docker/desktop-test/Dockerfile => taskcluster/docker/desktop-test/Dockerfile
rename : testing/docker/desktop-test/apport => taskcluster/docker/desktop-test/apport
rename : testing/docker/desktop-test/buildprops.json => taskcluster/docker/desktop-test/buildprops.json
rename : testing/docker/desktop-test/deja-dup-monitor.desktop => taskcluster/docker/desktop-test/deja-dup-monitor.desktop
rename : testing/docker/desktop-test/dot-files/config/pip/pip.conf => taskcluster/docker/desktop-test/dot-files/config/pip/pip.conf
rename : testing/docker/desktop-test/dot-files/config/user-dirs.dirs => taskcluster/docker/desktop-test/dot-files/config/user-dirs.dirs
rename : testing/docker/desktop-test/dot-files/config/user-dirs.locale => taskcluster/docker/desktop-test/dot-files/config/user-dirs.locale
rename : testing/docker/desktop-test/dot-files/pulse/default.pa => taskcluster/docker/desktop-test/dot-files/pulse/default.pa
rename : testing/docker/desktop-test/fonts.conf => taskcluster/docker/desktop-test/fonts.conf
rename : testing/docker/desktop-test/jockey-gtk.desktop => taskcluster/docker/desktop-test/jockey-gtk.desktop
rename : testing/docker/desktop-test/motd => taskcluster/docker/desktop-test/motd
rename : testing/docker/desktop-test/release-upgrades => taskcluster/docker/desktop-test/release-upgrades
rename : testing/docker/desktop-test/taskcluster-interactive-shell => taskcluster/docker/desktop-test/taskcluster-interactive-shell
rename : testing/docker/desktop-test/tc-vcs-config.yml => taskcluster/docker/desktop-test/tc-vcs-config.yml
rename : testing/docker/desktop-test/tester.env => taskcluster/docker/desktop-test/tester.env
rename : testing/docker/desktop1604-test/Dockerfile => taskcluster/docker/desktop1604-test/Dockerfile
rename : testing/docker/desktop1604-test/apport => taskcluster/docker/desktop1604-test/apport
rename : testing/docker/desktop1604-test/buildprops.json => taskcluster/docker/desktop1604-test/buildprops.json
rename : testing/docker/desktop1604-test/deja-dup-monitor.desktop => taskcluster/docker/desktop1604-test/deja-dup-monitor.desktop
rename : testing/docker/desktop1604-test/dot-files/config/pip/pip.conf => taskcluster/docker/desktop1604-test/dot-files/config/pip/pip.conf
rename : testing/docker/desktop1604-test/dot-files/config/user-dirs.dirs => taskcluster/docker/desktop1604-test/dot-files/config/user-dirs.dirs
rename : testing/docker/desktop1604-test/dot-files/config/user-dirs.locale => taskcluster/docker/desktop1604-test/dot-files/config/user-dirs.locale
rename : testing/docker/desktop1604-test/dot-files/pulse/default.pa => taskcluster/docker/desktop1604-test/dot-files/pulse/default.pa
rename : testing/docker/desktop1604-test/fonts.conf => taskcluster/docker/desktop1604-test/fonts.conf
rename : testing/docker/desktop1604-test/jockey-gtk.desktop => taskcluster/docker/desktop1604-test/jockey-gtk.desktop
rename : testing/docker/desktop1604-test/motd => taskcluster/docker/desktop1604-test/motd
rename : testing/docker/desktop1604-test/release-upgrades => taskcluster/docker/desktop1604-test/release-upgrades
rename : testing/docker/desktop1604-test/taskcluster-interactive-shell => taskcluster/docker/desktop1604-test/taskcluster-interactive-shell
rename : testing/docker/desktop1604-test/tc-vcs-config.yml => taskcluster/docker/desktop1604-test/tc-vcs-config.yml
rename : testing/docker/desktop1604-test/tester.env => taskcluster/docker/desktop1604-test/tester.env
rename : testing/docker/image_builder/Dockerfile => taskcluster/docker/image_builder/Dockerfile
rename : testing/docker/image_builder/HASH => taskcluster/docker/image_builder/HASH
rename : testing/docker/image_builder/REGISTRY => taskcluster/docker/image_builder/REGISTRY
rename : testing/docker/image_builder/VERSION => taskcluster/docker/image_builder/VERSION
rename : testing/docker/image_builder/build-image.sh => taskcluster/docker/image_builder/build-image.sh
rename : testing/docker/image_builder/setup.sh => taskcluster/docker/image_builder/setup.sh
rename : testing/docker/lint/Dockerfile => taskcluster/docker/lint/Dockerfile
rename : testing/docker/lint/system-setup.sh => taskcluster/docker/lint/system-setup.sh
rename : testing/docker/recipes/centos6-build-system-setup.sh => taskcluster/docker/recipes/centos6-build-system-setup.sh
rename : testing/docker/recipes/common.sh => taskcluster/docker/recipes/common.sh
rename : testing/docker/recipes/install-mercurial.sh => taskcluster/docker/recipes/install-mercurial.sh
rename : testing/docker/recipes/run-task => taskcluster/docker/recipes/run-task
rename : testing/docker/recipes/tooltool.py => taskcluster/docker/recipes/tooltool.py
rename : testing/docker/recipes/ubuntu1204-test-system-setup.sh => taskcluster/docker/recipes/ubuntu1204-test-system-setup.sh
rename : testing/docker/recipes/ubuntu1604-test-system-setup.sh => taskcluster/docker/recipes/ubuntu1604-test-system-setup.sh
rename : testing/docker/recipes/xvfb.sh => taskcluster/docker/recipes/xvfb.sh
rename : testing/docker/rust-build/Dockerfile => taskcluster/docker/rust-build/Dockerfile
rename : testing/docker/rust-build/README.md => taskcluster/docker/rust-build/README.md
rename : testing/docker/rust-build/REGISTRY => taskcluster/docker/rust-build/REGISTRY
rename : testing/docker/rust-build/VERSION => taskcluster/docker/rust-build/VERSION
rename : testing/docker/rust-build/build_cargo.sh => taskcluster/docker/rust-build/build_cargo.sh
rename : testing/docker/rust-build/build_rust.sh => taskcluster/docker/rust-build/build_rust.sh
rename : testing/docker/rust-build/build_rust_mac.sh => taskcluster/docker/rust-build/build_rust_mac.sh
rename : testing/docker/rust-build/fetch_cargo.sh => taskcluster/docker/rust-build/fetch_cargo.sh
rename : testing/docker/rust-build/fetch_rust.sh => taskcluster/docker/rust-build/fetch_rust.sh
rename : testing/docker/rust-build/package_rust.sh => taskcluster/docker/rust-build/package_rust.sh
rename : testing/docker/rust-build/repack_rust.py => taskcluster/docker/rust-build/repack_rust.py
rename : testing/docker/rust-build/splat_rust.py => taskcluster/docker/rust-build/splat_rust.py
rename : testing/docker/rust-build/task.json => taskcluster/docker/rust-build/task.json
rename : testing/docker/rust-build/tcbuild.py => taskcluster/docker/rust-build/tcbuild.py
rename : testing/docker/rust-build/upload_rust.sh => taskcluster/docker/rust-build/upload_rust.sh
rename : testing/docker/tester/Dockerfile => taskcluster/docker/tester/Dockerfile
rename : testing/docker/tester/HASH => taskcluster/docker/tester/HASH
rename : testing/docker/tester/REGISTRY => taskcluster/docker/tester/REGISTRY
rename : testing/docker/tester/VERSION => taskcluster/docker/tester/VERSION
rename : testing/docker/tester/bin/test.sh => taskcluster/docker/tester/bin/test.sh
rename : testing/docker/tester/dot-config/pip/pip.conf => taskcluster/docker/tester/dot-config/pip/pip.conf
rename : testing/docker/tester/dot-config/user-dirs.dirs => taskcluster/docker/tester/dot-config/user-dirs.dirs
rename : testing/docker/tester/dot-config/user-dirs.locale => taskcluster/docker/tester/dot-config/user-dirs.locale
rename : testing/docker/tester/dot-pulse/default.pa => taskcluster/docker/tester/dot-pulse/default.pa
rename : testing/docker/tester/tc-vcs-config.yml => taskcluster/docker/tester/tc-vcs-config.yml
rename : testing/docker/tester/tester.env => taskcluster/docker/tester/tester.env
rename : testing/docker/upload-symbols/Dockerfile => taskcluster/docker/upload-symbols/Dockerfile
rename : testing/docker/upload-symbols/README.md => taskcluster/docker/upload-symbols/README.md
rename : testing/docker/upload-symbols/bin/checkout-script.sh => taskcluster/docker/upload-symbols/bin/checkout-script.sh
rename : testing/docker/upload-symbols/bin/upload.sh => taskcluster/docker/upload-symbols/bin/upload.sh
rename : testing/docker/upload-symbols/test_exports.sh => taskcluster/docker/upload-symbols/test_exports.sh
extra : rebase_source : fd02b10c77de5b68476ce462b5f888475520a6fe
extra : source : 50adff295bf00ea0d9d7426e745acf3635e7dba5
2016-10-20 18:25:34 +05:30
Dustin J. Mitchell d65bd841f8 Bug 1313678: rename task description chainOfTrust to chain-of-trust; r=aki
Note that this does not affect task.extra.chainOfTrust, and thus has no impact
on the generated task JSON.

MozReview-Commit-ID: ERSVZlQUMpK

--HG--
extra : rebase_source : 5cee34de62138535eceb4cec7bcb860d45442938
2016-10-28 14:36:09 +00:00
Joel Maher 6ab76ab165 Bug 1313426 - gecko decision task: ValueError: No JSON object. fix SETA. r=dustin
MozReview-Commit-ID: F4V3VcDHMnW

--HG--
extra : rebase_source : 2761f12b75f31701164d912c60be0f9d745ec883
2016-10-27 15:12:33 -04:00
Phil Ringnalda 4012e61cc3 Merge m-i to m-c, a=merge
MozReview-Commit-ID: CysKZsvYf69
2016-10-26 18:40:50 -07:00
Brian Stack bbf6fceee0 Bug 1304180 - Set taskcluster artifact expiration to 28 days on try r=dustin
MozReview-Commit-ID: ECXCs9EkOYI

--HG--
extra : rebase_source : e1c52eaa1c3324b44851f9d3c88d69d0174b0f21
2016-10-25 11:47:50 -07:00
Gregory Szorc b547239226 Bug 1312475 - Add a version parameter to checkouts cache; r=dustin
ff5a4bab0813 (bug 1311791) and 332a08725ed0 (bug 1292071) changed
behavior of the VCS caches. First, the store cache / path was merged
into the checkouts cache. Then the path of the Mercurial shared store
was moved within the cache to always be rooted at the cache root.

Caches are shared across tasks. Tasks can execute on any revision
configured to use a cache. So, when interacting with caches, it is
important to consider how every revision configured to use that
cache will interact with it.

Take this scenario for example.

A worker executes a task where the hg shared store is rooted at
/home/worker/checkouts/src/hg-shared. Then the worker executes a
task where the hg shared store is rooted at
/home/worker/checkouts/hg-store. `hg robustcheckout` will see the
checkout from the first task. But then it sees that the store
it is pointing to is at an unexpected location
(checkouts/src/hg-shared instead of checkouts/hg-store). `hg
robustcheckout` aggressively normalizes state to ensure
consistency. So when it sees this mismatch, it blows away the
checkout and creates one from checkouts/hg-store to replace it.
That's a lot of overhead. And this cycle can repeat itself if
the right combination of revisions run on the worker!

A solution to this problem is to create a clean break from caches
when cache semantics change. In TaskCluster, that means using a
different cache.

This commit introduces a "version" component to the checkouts
cache name. By doing so, we create a clean break from all previous
caches, ensuring all revisions this point forward won't encounter
an hg shared store at an unexpected location. This also paves the
road for easily making additional clean breaks in the future.

MozReview-Commit-ID: JT8yuULKpch

--HG--
extra : rebase_source : 2e5d321e4314ff7543423d3c7837b770b7c8a3a3
2016-10-24 09:58:01 -07:00
Geoff Brown 988f3eff4d Bug 1312552 - Better chunking support for TC Windows; r=grenade 2016-10-25 08:53:32 -06:00
Ryan VanderMeulen a57d15ff6a Merge inbound to m-c. a=merge 2016-10-23 13:16:27 -04:00
Gregory Szorc 1deb8dd0e5 Bug 1311791 - Explicitly declare path to shared hg store; r=dustin
332a08725ed0 changed the store path logic in a quick and crude manner.
The code could lead to multiple shared stores existing on a cache
if checkouts were in different parent directories.

This commit refactors the code to explicitly declare a path to the
shared hg store. This restores the behavior of ensuring there is only
a single shared store per cache.

MozReview-Commit-ID: 19Aa1QVrVQ8

--HG--
extra : rebase_source : f74c0ab9cba2bf18e335f24c86dd095335961723
2016-10-20 12:56:43 -07:00
Rob Thijssen 3adfc86e1c Bug 1280474 - enable tc win cpp; r=dustin
MozReview-Commit-ID: 36rmfGExOx8

--HG--
extra : rebase_source : 252e75485d2de667e5ccf751a6c6c596be374b75
2016-10-20 10:51:48 +01:00
Wes Kocher b879e5232a Backed out changeset d15798b73b9e (bug 1302763) for taskcluster build issues a=backout CLOSED TREE
--HG--
rename : taskcluster/docker/README.md => testing/docker/README.md
rename : taskcluster/docker/REGISTRY => testing/docker/REGISTRY
rename : taskcluster/docker/android-gradle-build/README.md => testing/docker/android-gradle-build/README.md
rename : taskcluster/docker/android-gradle-build/VERSION => testing/docker/android-gradle-build/VERSION
rename : taskcluster/docker/android-gradle-build/bin/after.sh => testing/docker/android-gradle-build/bin/after.sh
rename : taskcluster/docker/android-gradle-build/bin/before.sh => testing/docker/android-gradle-build/bin/before.sh
rename : taskcluster/docker/android-gradle-build/bin/build.sh => testing/docker/android-gradle-build/bin/build.sh
rename : taskcluster/docker/android-gradle-build/bin/checkout-sources.sh => testing/docker/android-gradle-build/bin/checkout-sources.sh
rename : taskcluster/docker/base-build/Dockerfile => testing/docker/base-build/Dockerfile
rename : taskcluster/docker/base-build/VERSION => testing/docker/base-build/VERSION
rename : taskcluster/docker/base-build/system-setup.sh => testing/docker/base-build/system-setup.sh
rename : taskcluster/docker/base-test/Dockerfile => testing/docker/base-test/Dockerfile
rename : taskcluster/docker/base-test/VERSION => testing/docker/base-test/VERSION
rename : taskcluster/docker/base-test/sources.list => testing/docker/base-test/sources.list
rename : taskcluster/docker/centos6-build-upd/Dockerfile => testing/docker/centos6-build-upd/Dockerfile
rename : taskcluster/docker/centos6-build-upd/VERSION => testing/docker/centos6-build-upd/VERSION
rename : taskcluster/docker/centos6-build/Dockerfile => testing/docker/centos6-build/Dockerfile
rename : taskcluster/docker/centos6-build/hgrc => testing/docker/centos6-build/hgrc
rename : taskcluster/docker/centos6-build/system-setup.sh => testing/docker/centos6-build/system-setup.sh
rename : taskcluster/docker/decision/README.md => testing/docker/decision/README.md
rename : taskcluster/docker/decision/VERSION => testing/docker/decision/VERSION
rename : taskcluster/docker/decision/system-setup.sh => testing/docker/decision/system-setup.sh
rename : taskcluster/docker/desktop-build/bin/build.sh => testing/docker/desktop-build/bin/build.sh
rename : taskcluster/docker/desktop-build/bin/checkout-script.sh => testing/docker/desktop-build/bin/checkout-script.sh
rename : taskcluster/docker/desktop-build/bin/checkout-sources.sh => testing/docker/desktop-build/bin/checkout-sources.sh
rename : taskcluster/docker/desktop-build/buildprops.json => testing/docker/desktop-build/buildprops.json
rename : taskcluster/docker/desktop-build/oauth.txt => testing/docker/desktop-build/oauth.txt
rename : taskcluster/docker/desktop1604-test/apport => testing/docker/desktop-test/apport
rename : taskcluster/docker/desktop1604-test/buildprops.json => testing/docker/desktop-test/buildprops.json
rename : taskcluster/docker/tester/dot-config/pip/pip.conf => testing/docker/desktop-test/dot-files/config/pip/pip.conf
rename : taskcluster/docker/desktop1604-test/dot-files/config/user-dirs.dirs => testing/docker/desktop-test/dot-files/config/user-dirs.dirs
rename : taskcluster/docker/desktop1604-test/jockey-gtk.desktop => testing/docker/desktop-test/jockey-gtk.desktop
rename : taskcluster/docker/desktop1604-test/motd => testing/docker/desktop-test/motd
rename : taskcluster/docker/desktop1604-test/release-upgrades => testing/docker/desktop-test/release-upgrades
rename : taskcluster/docker/desktop-test/taskcluster-interactive-shell => testing/docker/desktop-test/taskcluster-interactive-shell
rename : taskcluster/docker/desktop1604-test/bin/run-wizard => testing/docker/desktop1604-test/bin/run-wizard
rename : taskcluster/docker/desktop1604-test/deja-dup-monitor.desktop => testing/docker/desktop1604-test/deja-dup-monitor.desktop
rename : taskcluster/docker/desktop1604-test/fonts.conf => testing/docker/desktop1604-test/fonts.conf
rename : taskcluster/docker/desktop1604-test/taskcluster-interactive-shell => testing/docker/desktop1604-test/taskcluster-interactive-shell
rename : taskcluster/docker/tester/tc-vcs-config.yml => testing/docker/desktop1604-test/tc-vcs-config.yml
rename : taskcluster/docker/image_builder/Dockerfile => testing/docker/image_builder/Dockerfile
rename : taskcluster/docker/tester/REGISTRY => testing/docker/image_builder/REGISTRY
rename : taskcluster/docker/image_builder/VERSION => testing/docker/image_builder/VERSION
rename : taskcluster/docker/image_builder/bin/build_image.sh => testing/docker/image_builder/bin/build_image.sh
rename : taskcluster/docker/lint/system-setup.sh => testing/docker/lint/system-setup.sh
rename : taskcluster/docker/recipes/centos6-build-system-setup.sh => testing/docker/recipes/centos6-build-system-setup.sh
rename : taskcluster/docker/recipes/common.sh => testing/docker/recipes/common.sh
rename : taskcluster/docker/recipes/install-mercurial.sh => testing/docker/recipes/install-mercurial.sh
rename : taskcluster/docker/recipes/run-task => testing/docker/recipes/run-task
rename : taskcluster/docker/recipes/tooltool.py => testing/docker/recipes/tooltool.py
rename : taskcluster/docker/recipes/ubuntu1204-test-system-setup.sh => testing/docker/recipes/ubuntu1204-test-system-setup.sh
rename : taskcluster/docker/recipes/ubuntu1604-test-system-setup.sh => testing/docker/recipes/ubuntu1604-test-system-setup.sh
rename : taskcluster/docker/recipes/xvfb.sh => testing/docker/recipes/xvfb.sh
rename : taskcluster/docker/rust-build/Dockerfile => testing/docker/rust-build/Dockerfile
rename : taskcluster/docker/rust-build/README.md => testing/docker/rust-build/README.md
rename : taskcluster/docker/rust-build/REGISTRY => testing/docker/rust-build/REGISTRY
rename : taskcluster/docker/rust-build/VERSION => testing/docker/rust-build/VERSION
rename : taskcluster/docker/rust-build/build_cargo.sh => testing/docker/rust-build/build_cargo.sh
rename : taskcluster/docker/rust-build/build_rust.sh => testing/docker/rust-build/build_rust.sh
rename : taskcluster/docker/rust-build/build_rust_mac.sh => testing/docker/rust-build/build_rust_mac.sh
rename : taskcluster/docker/rust-build/fetch_cargo.sh => testing/docker/rust-build/fetch_cargo.sh
rename : taskcluster/docker/rust-build/fetch_rust.sh => testing/docker/rust-build/fetch_rust.sh
rename : taskcluster/docker/rust-build/package_rust.sh => testing/docker/rust-build/package_rust.sh
rename : taskcluster/docker/rust-build/repack_rust.py => testing/docker/rust-build/repack_rust.py
rename : taskcluster/docker/rust-build/task.json => testing/docker/rust-build/task.json
rename : taskcluster/docker/rust-build/tcbuild.py => testing/docker/rust-build/tcbuild.py
rename : taskcluster/docker/rust-build/upload_rust.sh => testing/docker/rust-build/upload_rust.sh
rename : taskcluster/docker/tester/Dockerfile => testing/docker/tester/Dockerfile
rename : taskcluster/docker/tester/VERSION => testing/docker/tester/VERSION
rename : taskcluster/docker/tester/bin/test.sh => testing/docker/tester/bin/test.sh
rename : taskcluster/docker/tester/dot-config/user-dirs.dirs => testing/docker/tester/dot-config/user-dirs.dirs
rename : taskcluster/docker/tester/dot-config/user-dirs.locale => testing/docker/tester/dot-config/user-dirs.locale
rename : taskcluster/docker/tester/dot-pulse/default.pa => testing/docker/tester/dot-pulse/default.pa
rename : taskcluster/docker/tester/tester.env => testing/docker/tester/tester.env
2016-10-20 15:59:47 -07:00
CuriousLearner 69f1c6608d Bug 1302763 - Move docker images out of testing/docker into taskcluster/docker; r=dustin
MozReview-Commit-ID: 7v1uCDB5qoN

--HG--
rename : testing/docker/README.md => taskcluster/docker/README.md
rename : testing/docker/REGISTRY => taskcluster/docker/REGISTRY
rename : testing/docker/android-gradle-build/README.md => taskcluster/docker/android-gradle-build/README.md
rename : testing/docker/image_builder/REGISTRY => taskcluster/docker/android-gradle-build/REGISTRY
rename : testing/docker/android-gradle-build/VERSION => taskcluster/docker/android-gradle-build/VERSION
rename : testing/docker/android-gradle-build/bin/after.sh => taskcluster/docker/android-gradle-build/bin/after.sh
rename : testing/docker/android-gradle-build/bin/before.sh => taskcluster/docker/android-gradle-build/bin/before.sh
rename : testing/docker/android-gradle-build/bin/build.sh => taskcluster/docker/android-gradle-build/bin/build.sh
rename : testing/docker/desktop-build/bin/checkout-script.sh => taskcluster/docker/android-gradle-build/bin/checkout-script.sh
rename : testing/docker/android-gradle-build/bin/checkout-sources.sh => taskcluster/docker/android-gradle-build/bin/checkout-sources.sh
rename : testing/docker/desktop-build/buildprops.json => taskcluster/docker/android-gradle-build/buildprops.json
rename : testing/docker/desktop-test/dot-files/config/pip/pip.conf => taskcluster/docker/android-gradle-build/dot-config/pip/pip.conf
rename : testing/docker/desktop-build/oauth.txt => taskcluster/docker/android-gradle-build/oauth.txt
rename : testing/docker/base-build/Dockerfile => taskcluster/docker/base-build/Dockerfile
rename : testing/docker/base-build/VERSION => taskcluster/docker/base-build/VERSION
rename : testing/docker/base-build/system-setup.sh => taskcluster/docker/base-build/system-setup.sh
rename : testing/docker/base-test/Dockerfile => taskcluster/docker/base-test/Dockerfile
rename : testing/docker/image_builder/REGISTRY => taskcluster/docker/base-test/REGISTRY
rename : testing/docker/base-test/VERSION => taskcluster/docker/base-test/VERSION
rename : testing/docker/base-test/sources.list => taskcluster/docker/base-test/sources.list
rename : testing/docker/image_builder/REGISTRY => taskcluster/docker/builder/REGISTRY
rename : testing/docker/centos6-build-upd/Dockerfile => taskcluster/docker/centos6-build-upd/Dockerfile
rename : testing/docker/image_builder/REGISTRY => taskcluster/docker/centos6-build-upd/REGISTRY
rename : testing/docker/centos6-build-upd/VERSION => taskcluster/docker/centos6-build-upd/VERSION
rename : testing/docker/centos6-build/Dockerfile => taskcluster/docker/centos6-build/Dockerfile
rename : testing/docker/image_builder/REGISTRY => taskcluster/docker/centos6-build/REGISTRY
rename : testing/docker/decision/VERSION => taskcluster/docker/centos6-build/VERSION
rename : testing/docker/centos6-build/hgrc => taskcluster/docker/centos6-build/hgrc
rename : testing/docker/centos6-build/system-setup.sh => taskcluster/docker/centos6-build/system-setup.sh
rename : testing/docker/decision/README.md => taskcluster/docker/decision/README.md
rename : testing/docker/image_builder/REGISTRY => taskcluster/docker/decision/REGISTRY
rename : testing/docker/decision/VERSION => taskcluster/docker/decision/VERSION
rename : testing/docker/decision/system-setup.sh => taskcluster/docker/decision/system-setup.sh
rename : testing/docker/desktop-build/bin/build.sh => taskcluster/docker/desktop-build/bin/build.sh
rename : testing/docker/desktop-build/bin/checkout-script.sh => taskcluster/docker/desktop-build/bin/checkout-script.sh
rename : testing/docker/desktop-build/bin/checkout-sources.sh => taskcluster/docker/desktop-build/bin/checkout-sources.sh
rename : testing/docker/desktop-build/buildprops.json => taskcluster/docker/desktop-build/buildprops.json
rename : testing/docker/desktop-test/dot-files/config/pip/pip.conf => taskcluster/docker/desktop-build/dot-config/pip/pip.conf
rename : testing/docker/desktop-build/oauth.txt => taskcluster/docker/desktop-build/oauth.txt
rename : testing/docker/desktop-test/apport => taskcluster/docker/desktop-test/apport
rename : testing/docker/desktop-test/buildprops.json => taskcluster/docker/desktop-test/buildprops.json
rename : testing/docker/desktop1604-test/deja-dup-monitor.desktop => taskcluster/docker/desktop-test/deja-dup-monitor.desktop
rename : testing/docker/desktop-test/dot-files/config/pip/pip.conf => taskcluster/docker/desktop-test/dot-files/config/pip/pip.conf
rename : testing/docker/desktop-test/dot-files/config/user-dirs.dirs => taskcluster/docker/desktop-test/dot-files/config/user-dirs.dirs
rename : testing/docker/tester/dot-config/user-dirs.locale => taskcluster/docker/desktop-test/dot-files/config/user-dirs.locale
rename : testing/docker/tester/dot-pulse/default.pa => taskcluster/docker/desktop-test/dot-files/pulse/default.pa
rename : testing/docker/desktop1604-test/fonts.conf => taskcluster/docker/desktop-test/fonts.conf
rename : testing/docker/desktop-test/jockey-gtk.desktop => taskcluster/docker/desktop-test/jockey-gtk.desktop
rename : testing/docker/desktop-test/motd => taskcluster/docker/desktop-test/motd
rename : testing/docker/desktop-test/release-upgrades => taskcluster/docker/desktop-test/release-upgrades
rename : testing/docker/desktop-test/taskcluster-interactive-shell => taskcluster/docker/desktop-test/taskcluster-interactive-shell
rename : testing/docker/desktop1604-test/tc-vcs-config.yml => taskcluster/docker/desktop-test/tc-vcs-config.yml
rename : testing/docker/tester/tester.env => taskcluster/docker/desktop-test/tester.env
rename : testing/docker/desktop-test/apport => taskcluster/docker/desktop1604-test/apport
rename : testing/docker/desktop1604-test/bin/run-wizard => taskcluster/docker/desktop1604-test/bin/run-wizard
rename : testing/docker/desktop-test/buildprops.json => taskcluster/docker/desktop1604-test/buildprops.json
rename : testing/docker/desktop1604-test/deja-dup-monitor.desktop => taskcluster/docker/desktop1604-test/deja-dup-monitor.desktop
rename : testing/docker/desktop-test/dot-files/config/pip/pip.conf => taskcluster/docker/desktop1604-test/dot-files/config/pip/pip.conf
rename : testing/docker/desktop-test/dot-files/config/user-dirs.dirs => taskcluster/docker/desktop1604-test/dot-files/config/user-dirs.dirs
rename : testing/docker/tester/dot-config/user-dirs.locale => taskcluster/docker/desktop1604-test/dot-files/config/user-dirs.locale
rename : testing/docker/tester/dot-pulse/default.pa => taskcluster/docker/desktop1604-test/dot-files/pulse/default.pa
rename : testing/docker/desktop1604-test/fonts.conf => taskcluster/docker/desktop1604-test/fonts.conf
rename : testing/docker/desktop-test/jockey-gtk.desktop => taskcluster/docker/desktop1604-test/jockey-gtk.desktop
rename : testing/docker/desktop-test/motd => taskcluster/docker/desktop1604-test/motd
rename : testing/docker/desktop-test/release-upgrades => taskcluster/docker/desktop1604-test/release-upgrades
rename : testing/docker/desktop1604-test/taskcluster-interactive-shell => taskcluster/docker/desktop1604-test/taskcluster-interactive-shell
rename : testing/docker/desktop1604-test/tc-vcs-config.yml => taskcluster/docker/desktop1604-test/tc-vcs-config.yml
rename : testing/docker/tester/tester.env => taskcluster/docker/desktop1604-test/tester.env
rename : testing/docker/image_builder/Dockerfile => taskcluster/docker/image_builder/Dockerfile
rename : testing/docker/image_builder/REGISTRY => taskcluster/docker/image_builder/REGISTRY
rename : testing/docker/image_builder/VERSION => taskcluster/docker/image_builder/VERSION
rename : testing/docker/image_builder/bin/build_image.sh => taskcluster/docker/image_builder/bin/build_image.sh
rename : testing/docker/lint/system-setup.sh => taskcluster/docker/lint/system-setup.sh
rename : testing/docker/recipes/centos6-build-system-setup.sh => taskcluster/docker/recipes/centos6-build-system-setup.sh
rename : testing/docker/recipes/common.sh => taskcluster/docker/recipes/common.sh
rename : testing/docker/recipes/install-mercurial.sh => taskcluster/docker/recipes/install-mercurial.sh
rename : testing/docker/recipes/run-task => taskcluster/docker/recipes/run-task
rename : testing/docker/recipes/tooltool.py => taskcluster/docker/recipes/tooltool.py
rename : testing/docker/recipes/ubuntu1204-test-system-setup.sh => taskcluster/docker/recipes/ubuntu1204-test-system-setup.sh
rename : testing/docker/recipes/ubuntu1604-test-system-setup.sh => taskcluster/docker/recipes/ubuntu1604-test-system-setup.sh
rename : testing/docker/recipes/xvfb.sh => taskcluster/docker/recipes/xvfb.sh
rename : testing/docker/rust-build/Dockerfile => taskcluster/docker/rust-build/Dockerfile
rename : testing/docker/rust-build/README.md => taskcluster/docker/rust-build/README.md
rename : testing/docker/rust-build/REGISTRY => taskcluster/docker/rust-build/REGISTRY
rename : testing/docker/rust-build/VERSION => taskcluster/docker/rust-build/VERSION
rename : testing/docker/rust-build/build_cargo.sh => taskcluster/docker/rust-build/build_cargo.sh
rename : testing/docker/rust-build/build_rust.sh => taskcluster/docker/rust-build/build_rust.sh
rename : testing/docker/rust-build/build_rust_mac.sh => taskcluster/docker/rust-build/build_rust_mac.sh
rename : testing/docker/rust-build/fetch_cargo.sh => taskcluster/docker/rust-build/fetch_cargo.sh
rename : testing/docker/rust-build/fetch_rust.sh => taskcluster/docker/rust-build/fetch_rust.sh
rename : testing/docker/rust-build/package_rust.sh => taskcluster/docker/rust-build/package_rust.sh
rename : testing/docker/rust-build/repack_rust.py => taskcluster/docker/rust-build/repack_rust.py
rename : testing/docker/rust-build/task.json => taskcluster/docker/rust-build/task.json
rename : testing/docker/rust-build/tcbuild.py => taskcluster/docker/rust-build/tcbuild.py
rename : testing/docker/rust-build/upload_rust.sh => taskcluster/docker/rust-build/upload_rust.sh
rename : testing/docker/tester/Dockerfile => taskcluster/docker/tester/Dockerfile
rename : testing/docker/image_builder/REGISTRY => taskcluster/docker/tester/REGISTRY
rename : testing/docker/tester/VERSION => taskcluster/docker/tester/VERSION
rename : testing/docker/tester/bin/test.sh => taskcluster/docker/tester/bin/test.sh
rename : testing/docker/desktop-test/dot-files/config/pip/pip.conf => taskcluster/docker/tester/dot-config/pip/pip.conf
rename : testing/docker/tester/dot-config/user-dirs.dirs => taskcluster/docker/tester/dot-config/user-dirs.dirs
rename : testing/docker/tester/dot-config/user-dirs.locale => taskcluster/docker/tester/dot-config/user-dirs.locale
rename : testing/docker/tester/dot-pulse/default.pa => taskcluster/docker/tester/dot-pulse/default.pa
rename : testing/docker/desktop1604-test/tc-vcs-config.yml => taskcluster/docker/tester/tc-vcs-config.yml
rename : testing/docker/tester/tester.env => taskcluster/docker/tester/tester.env
extra : rebase_source : 94c16b2ea7c5824e70637e7fb64a4f5dc3a02837
2016-10-20 18:25:34 +05:30
Gregory Szorc 0363e0cffb Bug 1306641 - Remove TaskCluster automation related to b2g; r=dustin
This definitely isn't all of it. But I got the obvious chunks. Still
need to clean up mozharness.

MozReview-Commit-ID: JTZBydP3i2r

--HG--
extra : rebase_source : 782401359036751896ef6c153a81a06cb14031bb
2016-09-30 09:21:09 -07:00
Gregory Szorc f67f676a52 Bug 1292071 - Put Mercurial store on same cache as checkout; r=dustin
We were seeing issues with the Mercurial working directory not being
pristine. While I can't reproduce this, I have a hunch it is due to
mixing and matching stores and checkouts in TaskCluster. For example,
if a worker supports running concurrent tasks and 2 tasks arrive at
the same time, the caches for the store and checkout may look like:

  (store0, checkout0)
  (store1, checkout1)

However, the next task may get:

  (store1, checkout0)

This may confuse Mercurial.

This commit eliminates the "hg-shared" cache and places the shared
stores as a sibling directory of the checkout.

MozReview-Commit-ID: 8SzyS6wWf9C

--HG--
extra : rebase_source : 6205f3fe944a6ad2cb833a5a7c0ae5ba136eaea6
2016-10-18 09:46:55 -07:00
Joel Maher 8ddb1bbdb8 Bug 1311442 - remove /home/worker/workspace cache from marionette-harness jobs. r=garndt
MozReview-Commit-ID: 2ptRmk9kWtc

--HG--
extra : rebase_source : 4099ed63c5b3c9dc3501c14b17ce4ff868eedfa0
2016-10-19 13:00:10 -04:00
Rob Thijssen 866b206b8e Bug 1305485 - use robustcheckout with ephemeral storage (tc windows); r=gps
MozReview-Commit-ID: 1jatmsVJsDM
2016-10-12 16:06:17 +01:00
Greg Mierzwinski 7bf3a43886 Bug 1305242 - Disable linux64-jsdcov and linux64-ccov from running on try with '-u all'. r=dustin
This patch prevents tests which have the 'run_on_projects' attribute assigned to an empty set from running when the try message contains '-p all' and '-u all' together. It also makes the 'match_test' function a little more readable and updates the 'attributes.rst' document to reflect the changes that were made.

MozReview-Commit-ID: IMk0cmSza8U

--HG--
extra : rebase_source : 06d542cbec16bd8091bc282ad1b831fb4671e72a
2016-09-24 14:31:25 -04:00
Ryan VanderMeulen aed5c0a176 Merge m-c to inbound on a CLOSED TREE. a=merge 2016-10-21 17:15:01 -04:00
MikeLing d36cf3f20a Bug 1287018: consult the SETA service to determine low-value tasks; r=dustin
MozReview-Commit-ID: nvtRNUxytR

--HG--
extra : rebase_source : 1348ebe7c623b85d7614925b9f95f2f59f7ffa13
2016-10-20 22:16:39 +00:00
Nathan Froyd 73b37920ec Bug 1306650 - part 2 - add windows toolchain build transform; r=dustin
We need an toolchain-script runner for generic-worker worker types.
2016-10-26 16:18:24 -04:00
Nathan Froyd c483186515 Bug 1309337 - add schemas for in-tree generic-worker tasks for mounting directories; r=pmoore 2016-10-26 16:18:24 -04:00
Nick Fitzgerald e2cccedfb2 Bug 1277338 - Part 1: Turn js/src into the mozjs-sys crate; r=sfink 2016-10-13 16:12:42 -07:00
Aki Sasaki 6cfb40f43f bug 1309293 - fix flake8. r=bustage 2016-10-12 14:21:22 -07:00
Aki Sasaki 63eaf9dc71 bug 1309293 - task.extra.chainOfTrust.inputs for build tasks. r=dustin 2016-10-12 14:01:24 -07:00
Justin Wood 8b611ab64b Bug 1308950 - L10n in taskcluster is broken due to run-task landing. r=dustin
MozReview-Commit-ID: FKNYqhNoevP

--HG--
extra : rebase_source : 90d493bf6812350e531a2b2389e0b25e747ce8d0
2016-10-10 15:01:28 -04:00
Geoff Brown 929f35de3b Bug 1280570 - Retrigger tc tasks when mozharness returns TBPL_RETRY; r=dustin 2016-10-07 10:20:15 -06:00
Carsten "Tomcat" Book 7c8e81673d merge mozilla-inbound to mozilla-central a=merge 2016-10-06 11:59:54 +02:00
Aki Sasaki ea55d9e315 bug 1298553 - enable cot in docker-image and docker-worker build tasks. r=dustin
MozReview-Commit-ID: JEZ1Q0FgjEY
2016-10-04 14:04:21 -07:00
Justin Wood a695dbbac1 Bug 1306598 - update l10n kind to not hardcode 'try' in options. r=dustin
MozReview-Commit-ID: Hmj51RZSkf6

--HG--
extra : rebase_source : 10a6586c6d487ac6d907b69d7f6f14c5c7e1584a
2016-09-29 14:59:49 -04:00
Joel Maher 974f731a59 Bug 1300074 - adjust taskcluster task names to match buildbot. r=dustin.
MozReview-Commit-ID: BV9stGRhhZG

--HG--
extra : rebase_source : 39b630a75acd571555a983c3d6f9dcbf1170d96d
2016-10-05 08:57:50 -04:00
Dustin J. Mitchell 8777d8afb3 Bug 1303556: ensure owner is always an email address; r=jonasfj
MozReview-Commit-ID: HPRQS9lYjhI

--HG--
extra : rebase_source : f1a6881d6950e89bb49e99228225ef53cc8f0419
2016-10-03 22:28:02 +00:00
Phil Ringnalda 18e0fd86a6 Bug 1307043 - Make [Ubuntu] in try syntax include ASan tests, r=dustin
If you want to run tests on Linux32 and Linux64, you use trychooser syntax like
"-u all[Ubuntu]" which taskcluster supports, but if you also built ASan, and
want tests on ASan, there's no supported documented way to get them. That sounds
like an edge-case, except that to get tests to run on WinXP or Win8 you have to
explicitly list them, so to get tests on every platform you build you have to
list all of them, and if ASan is one of them you have to somehow know to dig
around in the .yml and to know that linux64-asan is the thing to dig out.

MozReview-Commit-ID: 2REf0cUWmK8

--HG--
extra : rebase_source : cb77ff3e016939c94ac05964a6db809fe10aaa1a
2016-10-02 23:20:02 -07:00
Phil Ringnalda b585dfc1bc Bug 1306933 - Support the 'Android 4.3' prettyname alias for trychooser, r=dustin
The trychooser website advertises 'Android 4.3' as the alias to choose Android
tests in [] syntax, but without support for that in taskcluster, someone who
wants both opt and debug tests would need to guess, with no support or
documentation, that they should use [Android 4.3,android-4.3-arm7-api-15]

MozReview-Commit-ID: 4rEKcvqAfDH

--HG--
extra : rebase_source : 336d3a787569e14e5ae8608902e6e557ef2ce6c3
2016-10-01 19:19:24 -07:00
Mike Shal 34419a456f Bug 1277881 - Remove all gecko.v1 routes; r=dustin
MozReview-Commit-ID: HyZO2sKFuJD

--HG--
extra : rebase_source : c22d8f5f094a1a41f569ebb58395ccba96db5330
2016-09-20 18:09:00 -04:00
Gregory Szorc 4e15118d64 Bug 1289249 - Use run-task for mozharness jobs on docker-worker; r=dustin
This transform appears to always be executed on desktop-build.
build.sh always calls checkout-sources.sh and checkout-sources.sh
always performs a Gecko checkout. It /may/ perform a build/tools
checkout unless an environment variable is set.

Now that desktop-build is ready to use run-task, we switch this
transform to run-task. A gecko and tools checkout is *always*
performed. There is room to make the tools checkout optional.
But it completes nearly instantly. So I'm inclined to do this
as a follow-up enhancement, if needed.

Ideally, the checkout would be on a cache so subsequent tasks on
the worker only need to perform a purge+update as opposed to a
full checkout. However, many tasks make assumptions about the
VCS behavior and modifying the checkout path is a non-trivial
amount of work. This can be deferred to a follow-up bug.

MozReview-Commit-ID: 5Auerl4OL9x

--HG--
extra : rebase_source : 7981b19d043bae311620790809c0c1f3f3696bb5
2016-09-29 16:51:15 -07:00
Gregory Szorc 8899c07747 Bug 1289249 - Use run-task in spidermonkey tasks; r=dustin
This is a pretty straightforward port.

MozReview-Commit-ID: HaQ6EyrdoKT

--HG--
extra : rebase_source : 7e2dfa48e71c10fe4d6139dd339135fbfc7b79ca
2016-09-28 23:36:26 -07:00
Gregory Szorc 110de002ce Bug 1289249 - Use vendored tooltool.py in SpiderMonkey tasks; r=dustin
Previously, SpiderMonkey tasks were using tc-vcs to clone the tooltool
repository so they could have access to tooltool.py. tooltool.py is
already in the execution environment courtesy of being part of the
source checkout. So use it from there.

One less dependency on a 3rd party service at run-time. One less
point for a MITM attack against our automation.

MozReview-Commit-ID: JmavaBG4vii

--HG--
extra : rebase_source : 5f6c56d1398268ceba867bb47645281465949246
2016-09-29 18:13:36 -07:00
Rob Thijssen 2678725c30 Bug 1304998 - enable tc win pgo; r=dustin
MozReview-Commit-ID: 8X9aj19Kp13

--HG--
extra : rebase_source : 34817db2922fa27a4aa36e719dad11f598ad3f2d
2016-09-29 07:49:30 +01:00
Carsten "Tomcat" Book 5b45193594 merge mozilla-inbound to mozilla-central a=merge 2016-09-29 11:44:58 +02:00
Kalpesh Krishna 87f3ac8197 Bug 1305989 - Update usage of create_tasks() in action tasks. r=dustin
--HG--
extra : rebase_source : c8bdd1c4972ec2363f31d371ed9e1e9368d367f0
2016-09-28 09:43:00 -04:00
Carsten "Tomcat" Book b5206d37f5 Merge mozilla-central to mozilla-inbound 2016-09-28 16:25:01 +02:00
Alastair Pharo b722a9955f Bug 1304019 - Add support for setting task's index rank r=dustin
MozReview-Commit-ID: Kye7UXoRCZt
2016-09-28 16:09:06 +02:00
Dustin J. Mitchell b48e0323bb Bug 1305740: delete leftover legacy.py; r=gps
MozReview-Commit-ID: 8GHv1E9CBRH

--HG--
extra : rebase_source : a626f79b7bb6e91793b09e3067a8791e52674c5b
2016-09-27 15:55:36 +00:00
Carsten "Tomcat" Book 8829648c55 Backed out changeset a8ccca7bb19d (bug 1304019) for breaking Gecko Decision Task opt 2016-09-28 08:50:18 +02:00
Alastair Pharo 7a2b5bfab6 Bug 1304019 - Add support for setting task's index rank r=dustin
MozReview-Commit-ID: I5pPbPiW7pY
2016-09-28 07:47:35 +02:00
Phil Ringnalda 67df428994 Backed out changeset ff35e4bcc7c8 (bug 1253314) for not working 2016-09-26 19:11:04 -07:00
Mihai Tabara 2c8c8c958b Bug 1253314 - enable Linux32 PGO builds. r=dustin
MozReview-Commit-ID: 482FdMgYFvA

--HG--
extra : rebase_source : c0da90e5762377400f24eae947999b70b9bef52b
2016-09-25 13:48:52 +01:00
Andrew Halberstadt 58195de1e4 Bug 1304484 - Add back gecko vcs environment variables for desktop-test tasks, r=gps
This was regressed by bug 1296397 which stopped setting the GECKO_HEAD_REPOSITORY and
the like. It wasn't caught because the task doesn't actually depend on those environment
variables except when using the interactive loaner.

This patch supports vcs checkout regardless of whether the task runs from source or not.

MozReview-Commit-ID: CDxdG8G6JDd

--HG--
extra : rebase_source : 8a3d380c86bbfabe6d76854fd8af8e794e75970e
2016-09-21 16:02:49 -04:00
Brian Stack 92ede5330c Bug 1275774 - Add tests for new taskcluster try flag parsing r=dustin
MozReview-Commit-ID: 1QKnLZE0hzU

--HG--
extra : rebase_source : 7301c162bb21e41dcc858ff0d94b456e695166fc
2016-09-28 09:34:42 -07:00
Brian Stack e6e4f7b548 Bug 1275774 - Add notify routes to taskcluster tasks for certain try flags r=dustin
MozReview-Commit-ID: 4ugUjv0NCZK

--HG--
extra : rebase_source : d552a45a25cdcfbde9eb012b4c77a6f4b8770444
2016-09-26 10:57:14 -07:00
Brian Stack 3984bade54 Bug 1275774 - Add try-syntax parsing of email notifications to taskcluster r=dustin
MozReview-Commit-ID: 8ZXCNEvMDCg

--HG--
extra : rebase_source : e527c725e5b35a5f6f7644cbd72eb450801d64ba
2016-09-21 18:02:43 -07:00
Wes Kocher 223fdc5082 Backed out changeset d5b3c15bbbdf (bug 1305989) a=backout CLOSED TREE 2016-09-28 10:47:09 -07:00
Kalpesh Krishna 9e63c873f7 Bug 1305989 - Updating usage of create_tasks() in action tasks. r=dustin
MozReview-Commit-ID: I8dneQvCWgf

--HG--
extra : rebase_source : 91a7b658c1e616507123617c1c6b8fd93bd2ef84
2016-09-28 19:50:48 +05:30
Mihai Tabara 7d1a1e021f Bug 1253314 - enable Linux32 PGO builds. r=dustin
MozReview-Commit-ID: 8OLKfc9IAhh

--HG--
extra : rebase_source : 1c0baee1cf9dae3e921c3476d31377175f7741d8
2016-09-27 17:13:50 +01:00
Iris Hsiao 767e1e9b11 merge mozilla-inbound to mozilla-central a=merge 2016-09-26 18:34:20 +08:00
Dustin J. Mitchell 1045a329b8 Bug 1302227: set the taskGroupId to match the decision task; r=garndt
In this case, the tasks must have the same schedulerId as the existing task,
so this is calculated using parameters['level'].

MozReview-Commit-ID: G8EE2kvFstT

--HG--
extra : rebase_source : 214885da9b58520727d5f80b9a31bb8a206f9279
2016-09-22 21:30:56 +00:00