Граф коммитов

3820 Коммитов

Автор SHA1 Сообщение Дата
Gregory Szorc 526949a0ad Bug 1460470 - Make run-task compile on Python 3; r=mshal
The file failed to compile due to octal syntax and missing imports.
After this change, we get a run-time error, which is strictly better.

MozReview-Commit-ID: nY9A13Pt3E

--HG--
extra : source : ef477a048b575958be74287a2273830813b385f1
2018-05-16 13:57:08 -07:00
Tom Prince 8070e1498d Bug 1447460: [taskgraph] Use the graph config root to guess find the path to `.taskcluster.yml` in actions; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D1126

--HG--
extra : rebase_source : b9d3dbd07df5528009bb619937aafeb158a0e40e
2018-05-02 20:30:15 -06:00
Tom Prince 90b93a6db8 Bug 1458700: [release-promotion] Use a common target task for firefox and devedition; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1122

--HG--
extra : rebase_source : cf124d67fa250f13306a98a9412e64347b9fde68
2018-05-02 18:33:52 -06:00
Tom Prince 9bebf482da Bug 1458700: [release-promotion] Move configuration of flavors into the graph configuration; r=aki,dustin
Differential Revision: https://phabricator.services.mozilla.com/D1121

--HG--
extra : rebase_source : 270cb6a6a2c6255c585b46cc410110f83010ec6f
2018-04-23 00:17:30 -06:00
Steve Fink 57542ca64e Backed out changeset a4257fbc42c8 (bug 1291954) because tsan is permafail right now
--HG--
extra : rebase_source : fda93a1e9594ce52884a9e15b7c9c0dabea00a65
2018-05-16 11:17:29 -07:00
Tom Prince 6e1d5dc625 Bug 1456234: [release] Use `-release` platforms for top-level balrog tasks; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1289

--HG--
extra : rebase_source : c36d0e29c1f32b8c8f3fd9587f2254cf95037e7a
extra : source : 357bd0f84ffe52fc54e3516eae6855691404cd44
2018-05-09 07:26:24 -07:00
Tom Prince 36986d6888 487c3 Bug 1456234: [release] Use `-release` platforms for bouncer tasks; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1288

--HG--
extra : rebase_source : 813072f74f9660bc860a39485ace349d4c85a8b4
extra : source : e696372662260555e7d77aa63596e0f1428a112d
2018-05-15 13:09:12 -06:00
Tom Prince e0aa0edda7 Bug 1456234: [release] Change update-verify platforms to match the corresponding build platforms; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1287

--HG--
extra : rebase_source : 1a306e540eb7b10a352687628415bcaab317c131
extra : source : 407dce8b170311456e085f1c928c7156a016e76f
2018-05-05 14:38:23 -06:00
Tom Prince 7b13402d7e Bug 1456234: [taskgraph]: Add a helper for adding a suffix to a possibly grouped treeherder symbol; r=dustin.
Differential Revision: https://phabricator.services.mozilla.com/D1286

--HG--
extra : rebase_source : 3cb1080e5a94e3e9e5b5a3f6909b0e8d636de09c
extra : source : 4a182c3447fa01c75fa8a231e067bebd83683da9
2018-05-15 13:00:18 -06:00
Steve Fink 6d14e1c2dc Bug 1291954 - Promote SM(tsan) to tier 1, r=Aryx
--HG--
extra : topic : tsan.tier1
extra : rebase_source : 7fd22935b34e572c0ff58699b59d2fafa62905fc
extra : amend_source : 79b645ea0d6967b035a2c13a8e875d7d0edf522e
extra : histedit_source : df0b7090d6186a695b1768915a288097d1bbf220
2018-05-15 19:18:56 -07:00
Margareta Eliza Balazs d4b9e50875 Merge inbound to mozilla-central. a=merge 2018-05-16 13:00:51 +03:00
Chris AtLee 6e7f604585 Bug 1237182: Removing unused buildbot support r=Callek
MozReview-Commit-ID: EjclZgc864L

--HG--
extra : rebase_source : aebc03899ad88aa2838825c14a45c59e1e59be05
extra : source : ba91fec47e908619d9a8f550ee65cd78f67e3d59
2018-05-04 13:51:35 -04:00
Kartikaya Gupta e566dbc377 Bug 1390875 - Enable tps on QR test platforms. r=jmaher
MozReview-Commit-ID: 77KbhArleCC

--HG--
extra : rebase_source : b5b4429bdac978d127efc35ae579632c6a39b82c
2018-05-15 14:29:01 -04:00
Dorel Luca 7285fe0e8b Merge mozilla-central to autoland
--HG--
extra : rebase_source : 28cf949fe5cbd372058adac2d3a9d6e66902e6e3
2018-05-16 00:58:05 +03:00
Geoff Brown 432ab75dea Bug 1460411 - Follow-up - diffoscope repo moved; updated url; r=me on a CLOSED TREE 2018-05-15 11:36:28 -06:00
Geoff Brown bd4f5cfdbf Bug 1460411 - Add kvm to desktop1604-test image; r=jmaher
Our normal ubuntu 16.04 test image is suitable for hosting an Android x86
emulator with these minor updates: Install kvm and make sure /dev/kvm
rw permissions are open for everyone. Note that /dev/kvm is generally
only visible when running docker with --privileged; its permissions
cannot be modified in the Dockerfile, only at run-time: run-task is the
first opportunity.
2018-05-15 09:57:27 -06:00
Gregory Szorc 99b6ca1c73 Bug 1460475 - Port download-and-compress to Python 3; r=dustin
download-and-compress isn't very complicated and should work on Python 3
with minimal effort. So let's switch it to use Python 3.

MozReview-Commit-ID: 9G1WfcbbKEY

--HG--
extra : rebase_source : 3a6bab06c8500a90413e8b7642a7bf7bdff04a46
2018-05-09 19:41:07 -07:00
Gregory Szorc b104bdc7af Bug 1460475 - Use stream_reader API; r=dustin
python-zstandard 0.9 has an API that exposes a file object interface
for compression and decompression. This means we can remove our
stream wrapper in order to consume a zstandard compressed tar file.

MozReview-Commit-ID: DeWWKnigJVa

--HG--
extra : rebase_source : b510b9c7cf4471df835c755299a7842d13188b67
2018-05-11 10:10:41 -07:00
Gregory Szorc a3113a2560 Bug 1460475 - Install zstandard 0.9.0 in mach; r=dustin
The latest python-zstandard uses a newer zstandard that is faster.
It also has wheels available, which means installation doesn't require
Python development headers, etc.

MozReview-Commit-ID: 5gRq81KYmX4

--HG--
extra : rebase_source : 96ccc64e9707c6b4815c1bfa5c1a98b9a428b387
2018-05-09 20:13:28 -07:00
Gregory Szorc b92916aaf5 Bug 1460475 - Upgrade python-zstandard in image_builder; r=dustin
Version 0.9.0 bundles a newer version of the zstandard library, which
is a little faster and has a few minor bug fixes (none that we were
likely hitting, however).

MozReview-Commit-ID: 9YgSZ0G41eg

--HG--
extra : rebase_source : 8f5a68323b1e1fe7e9f1dd1a92e132434972d21d
2018-05-09 17:54:38 -07:00
Gregory Szorc c65d079532 Bug 1460475 - Install Python 3 on image_builder; r=dustin
We want Python 3 available everywhere because it is 2018.

MozReview-Commit-ID: L3wufNXKdnp

--HG--
extra : rebase_source : c260923e3c13f8b28e30eaaf6e1bd38f79500052
2018-05-09 17:45:39 -07:00
Geoff Brown 2703d7697a Bug 1461393 - Run Android debug xpcshell tests in more chunks; r=me,a=test-only 2018-05-14 17:11:46 -06:00
Andi-Bogdan Postelnicu 7ff371efa8 Bug 1432410 - Add tests in tree to make sure we don't regress with clang-tidy on static-analisys. Tests wrote in part by :sylvestre. r=gps
MozReview-Commit-ID: IWxzKfWNIHG

--HG--
extra : rebase_source : e6860d1adcc06bb1e4383cb76be02089a0ef61f9
2018-05-03 20:06:16 +03:00
Margareta Eliza Balazs c4a535377f Merge mozilla-central to autoland. a=merge CLOSED TREE
--HG--
extra : rebase_source : ba12f05efc62a616ff831b24e38823be9e69c8ea
2018-05-14 19:48:37 +03:00
Ted Mielczarek 0839e43771 bug 1460243 - don't try to upload symbols for asan-reporter nightlies. r=Callek,tomprince
Address Sanitizer builds use --disable-crashreporter so they don't have
symbols zip files to upload. Don't run symbol upload tasks for these builds.

MozReview-Commit-ID: GeQgRZF3m8t

--HG--
extra : rebase_source : 6ac59c5c96b5fb5ddbbe8c60af3a203d02ea9883
2018-05-09 10:54:04 -04:00
Maja Frydrychowicz 543283931f Bug 1460315 - Run Mn suite on both android-4.3-arm7 debug and opt; r=gbrown
MozReview-Commit-ID: Bq4gJJahwYQ

--HG--
extra : rebase_source : 7fd33e018939d79695daed308f0c062958bf9e21
2018-05-11 15:45:18 -04:00
Narcis Beleuzu 495eed2d41 Backed out changeset ba91fec47e90 (bug 1237182) for breaking the Windows 2012 Nightlies. a=backout 2018-05-12 17:33:18 +03:00
Brindusan Cristian 1df25b391a Merge inbound to mozilla-central. a=merge 2018-05-12 12:47:14 +03:00
Simon Fraser 0bbea03903 Bug 1460906 Fix use of config.params and release_eta r=aki
MozReview-Commit-ID: 9wtsZw118YX

--HG--
extra : rebase_source : 87f4caa973d3a7665ee9b3321bf9e18fee3edc83
2018-05-11 17:27:34 +01:00
Gregory Szorc cbf0a8af3e Bug 1460650 - Rename sixgill task name so it has "gcc" in it; r=nalexander
Mainly so searching "toolchain" + "gcc" yields something useful in the
taskgraph.

MozReview-Commit-ID: HWiT3AwwYQ2

--HG--
extra : rebase_source : b1ba0dfb4f99b6f8abe42506e8b37db68ed03590
2018-05-09 14:36:45 -07:00
Chris AtLee ef68c91c87 Bug 1237182: Removing unused buildbot support r=Callek
MozReview-Commit-ID: EjclZgc864L

--HG--
extra : rebase_source : 5ad7974462d14c00916fd0c88e06843e0f1f4276
2018-05-04 13:51:35 -04:00
Kartikaya Gupta 523db328a9 Bug 1460724 - Flip windows qr talos test-set from whitelist to blacklist. r=jmaher
MozReview-Commit-ID: 8DOEm3ONP0n

--HG--
extra : rebase_source : 885fb169949c18b81d1e6ac879d433e4bca8ceaf
2018-05-11 07:48:22 -04:00
Kartikaya Gupta 675bc5dc39 Bug 1460724 - Flip the linux64-qr talos set from a whitelist to a blacklist. r=jmaher
Instead of having a special test-set for linux64-qr we can just use the
regular test set, and explicitly disable the individual tests that are
failing.

MozReview-Commit-ID: 8MUj1YdtOsH

--HG--
extra : rebase_source : 5b4398ccedd208c97fe2c58024d98bfdb759c932
2018-05-11 07:48:22 -04:00
Bogdan Tara aac044cf2c Backed out 2 changesets (bug 1460724) for Geko build bustage CLOSED TREE
Backed out changeset eec4f33ab072 (bug 1460724)
Backed out changeset d9847393a843 (bug 1460724)
2018-05-11 14:43:49 +03:00
Kartikaya Gupta 74cd8bb092 Bug 1460724 - Flip windows qr talos test-set from whitelist to blacklist. r=jmaher
MozReview-Commit-ID: 8DOEm3ONP0n

--HG--
extra : rebase_source : fa5ff91e3d9cfc19e23847d523df0edfb4464b40
2018-05-11 05:16:26 -04:00
Kartikaya Gupta 1911735111 Bug 1460724 - Flip the linux64-qr talos set from a whitelist to a blacklist. r=jmaher
Instead of having a special test-set for linux64-qr we can just use the
regular test set, and explicitly disable the individual tests that are
failing.

MozReview-Commit-ID: 8MUj1YdtOsH

--HG--
extra : rebase_source : 4d38dd3ea7a6934c84e57d6a20c7dc457f06c2da
2018-05-10 16:21:52 -04:00
Sylvestre Ledru 274ecb9460 Bug 1460402 - Update the CI to use codespell with pip instead of the apt packages (too old) r=ahal
MozReview-Commit-ID: 9QkTPyP7izS

--HG--
extra : rebase_source : 155b8b64b3aac06682f9b4191293974d7b9cd844
2018-05-09 21:57:36 +02:00
Dorel Luca a5bc0b3f70 Backed out 4 changesets (bug 1460402) for lint failure on intl/locales/en-US/hyphenation/hyph_en_US.dic. CLOSED TREE
Backed out changeset c2e8fbd72ca6 (bug 1460402)
Backed out changeset 3676e913dbff (bug 1460402)
Backed out changeset bb12ffd4b96e (bug 1460402)
Backed out changeset 3e50885329c4 (bug 1460402)
2018-05-11 00:47:34 +03:00
Sylvestre Ledru 4f1403c359 Bug 1460402 - Update the CI to use codespell with pip instead of the apt packages (too old) r=ahal
MozReview-Commit-ID: 9QkTPyP7izS

--HG--
extra : rebase_source : 4784a5af43e806f2ec017fe16d930b3845fe2dde
2018-05-09 21:57:36 +02:00
Tom Ritter 2a715ec2bf Bug 1457598 Add MinGW and GCC scripts to the resources of fxc2 and nsis to ensure they get rebuilt r=glandium
MozReview-Commit-ID: GuF9IFXKy9T

--HG--
extra : rebase_source : 5d45eb1582b1afeecb2835e51c3c37114364573e
2018-04-27 16:36:54 -05:00
Dorel Luca 74bbb3c1eb Backed out 4 changesets (bug 1460402) for breaking taskcluster images. CLOSED TREE
Backed out changeset 5b40f3f18f42 (bug 1460402)
Backed out changeset 17526c61b995 (bug 1460402)
Backed out changeset e1caff997e5a (bug 1460402)
Backed out changeset 06ceda084d69 (bug 1460402)
2018-05-10 23:54:38 +03:00
Sylvestre Ledru a7f37d6509 Bug 1460402 - Update the CI to use codespell with pip instead of the apt packages (too old) r=ahal
MozReview-Commit-ID: 9QkTPyP7izS

--HG--
extra : rebase_source : 23d87e6b352378aa41e8c539ce8640da68fe604c
2018-05-09 21:57:36 +02:00
Kartikaya Gupta 543d2897ba Bug 1432515 - Enable QR test suites on all branches where the corresponding non-QR versions run. r=milan
Note in particular that tasks that were previously set to run on just
['mozilla-central', 'try'] will now also run on inbound and autoland, in
addition to mozilla-beta and other release branches. In some cases (e.g.
for talos tests) this might result in a significant increase in load on
CI infrastructure. For the tasks that were already running on ['trunk',
'try'] the extra load from the release branches should be relatively
small and will only take effect once 62 moves off nightly into beta.

MozReview-Commit-ID: 6sn9q6rCxOK

--HG--
extra : rebase_source : c228adf059a950aec3e311ae11915caf345e854f
2018-05-09 15:24:38 -04:00
Dorel Luca 979ac450c8 Backed out changeset 67d2aa892562 (bug 1237182) for breaking Decision task. CLOSED TREE 2018-05-10 21:20:39 +03:00
Dorel Luca 72fd8fbd90 Backed out changeset afe7cbee7576 (bug 1460650) for breaking toolchain. CLOSED TREE 2018-05-10 21:19:42 +03:00
Chris AtLee 714c7498fd Bug 1237182: Removing unused buildbot support r=Callek
MozReview-Commit-ID: EjclZgc864L

--HG--
extra : rebase_source : 18ceefd30a5e5df3be7dc4152256b4407f61e8eb
2018-05-04 13:51:35 -04:00
Gregory Szorc 0c68d84bc0 Bug 1460650 - Rename sixgill task name so it has "gcc" in it; r=nalexander
Mainly so searching "toolchain" + "gcc" yields something useful in the
taskgraph.

MozReview-Commit-ID: HWiT3AwwYQ2

--HG--
extra : rebase_source : b1ba0dfb4f99b6f8abe42506e8b37db68ed03590
2018-05-09 14:36:45 -07:00
Csoregi Natalia f034c0ab5d Merge mozilla-central to inbound. a=merge CLOSED TREE 2018-05-10 12:52:31 +03:00
Marco Castelluccio 7d4d8e8236 Bug 1457393 - Rename linux64-ccov/opt to linux64-ccov/debug. r=jmaher
--HG--
extra : rebase_source : c6faf49be98371efb80578e391fba80648ff5dac
2018-04-28 11:16:14 +02:00
Cosmin Sabou 5470a81920 Merge mozilla-central to autoland. a=merge
--HG--
extra : rebase_source : 2f2bf3dc60329bfb92eab3401b92f4eadf0bf8c3
2018-05-09 20:31:27 +03:00
Joel Maher b798845062 Bug 1392106 - skip css writing modes on win7/debug and fix import-tests.py to support reftest_writing_modes.list. r=gbrown,xidorn 2018-05-09 08:55:51 -04:00
Margareta Eliza Balazs 6c97db61d4 Merge mozilla-central to inbound. a=merge CLOSED TREE 2018-05-09 12:40:18 +03:00
Simon Fraser 9b2ede9a8e Bug 1458854 Disable release_eta for rc on beta channel r=bhearsum
Summary:
In essence, we're allowing a new field in the task definition,
which is trusted over the one that's passed in with the config. This
wouldn't make much sense if it had a real date in, but allows us to
set an empty string for the kind that needs it

Reviewers: bhearsum

Reviewed By: bhearsum

Bug #: 1458854

Differential Revision: https://phabricator.services.mozilla.com/D1214

--HG--
extra : rebase_source : 82145a94fa91957ffe57112a1c0d327d99e32b23
2018-05-09 09:40:55 +01:00
Kartikaya Gupta b0d22a2e6c Bug 1322845 - Enable reftests on macosx64-qr. r=Gankro
The change to tests.py is resurrecting code that was removed in bug
1446954 but that we still want.

MozReview-Commit-ID: CaWJiOopj82
2018-05-08 22:43:01 -04:00
Andreea Pavel 8daddd690f Backed out 2 changesets (bug 1322845) for failing reftest background-repeat-large-area.html == background-repeat-large-area-ref.html on a CLOSED TREE
Backed out changeset 4fd46cd822bf (bug 1322845)
Backed out changeset abd41b3e63e7 (bug 1322845)
2018-05-09 05:13:08 +03:00
Kartikaya Gupta 3a359fcc99 Bug 1322845 - Enable reftests on macosx64-qr. r=Gankro
The change to tests.py is resurrecting code that was removed in bug
1446954 but that we still want.

MozReview-Commit-ID: CaWJiOopj82
2018-05-08 20:39:55 -04:00
Gregory Szorc bdf45558d2 Bug 1459737 - Add missing package dependencies to google-play-strings Dockerfile; r=nalexander CLOSED TREE
This Dockerfile downloads non-deterministic remote content (by cloning a
Git repo) and then executes code from it. Part of that code is
executing Python package installs.

Since this Docker image was generated, it appears the remote code
requires new build dependencies. This commit adds those package
dependencies.

Not having deterministic Docker image builds is a bug. I'll file a
follow-up so we pin the Git commit used for building so this type
of failure doesn't occur again.

--HG--
extra : amend_source : 533a95abeb7cf7ddc9a1329549f5d294baf983f5
2018-05-08 09:03:35 -07:00
Coroiu Cristina f39a811db2 Merge mozilla-central to autoland a=merge on a CLOSED TREE
--HG--
rename : third_party/rust/core-foundation/.cargo-checksum.json => third_party/rust/core-foundation-0.5.1/.cargo-checksum.json
rename : third_party/rust/core-foundation/Cargo.toml => third_party/rust/core-foundation-0.5.1/Cargo.toml
rename : third_party/rust/core-foundation/src/array.rs => third_party/rust/core-foundation-0.5.1/src/array.rs
rename : third_party/rust/core-foundation/src/base.rs => third_party/rust/core-foundation-0.5.1/src/base.rs
rename : third_party/rust/core-foundation/src/bundle.rs => third_party/rust/core-foundation-0.5.1/src/bundle.rs
rename : third_party/rust/core-foundation/src/dictionary.rs => third_party/rust/core-foundation-0.5.1/src/dictionary.rs
rename : third_party/rust/core-foundation/src/filedescriptor.rs => third_party/rust/core-foundation-0.5.1/src/filedescriptor.rs
rename : third_party/rust/core-foundation/src/lib.rs => third_party/rust/core-foundation-0.5.1/src/lib.rs
rename : third_party/rust/core-foundation/src/propertylist.rs => third_party/rust/core-foundation-0.5.1/src/propertylist.rs
rename : third_party/rust/core-foundation/src/runloop.rs => third_party/rust/core-foundation-0.5.1/src/runloop.rs
rename : third_party/rust/core-foundation/src/set.rs => third_party/rust/core-foundation-0.5.1/src/set.rs
rename : third_party/rust/core-foundation/tests/use_macro_outside_crate.rs => third_party/rust/core-foundation-0.5.1/tests/use_macro_outside_crate.rs
rename : third_party/rust/core-foundation-sys/.cargo-checksum.json => third_party/rust/core-foundation-sys-0.5.1/.cargo-checksum.json
rename : third_party/rust/core-foundation-sys/Cargo.toml => third_party/rust/core-foundation-sys-0.5.1/Cargo.toml
rename : third_party/rust/core-foundation-sys/src/array.rs => third_party/rust/core-foundation-sys-0.5.1/src/array.rs
rename : third_party/rust/core-foundation-sys/src/base.rs => third_party/rust/core-foundation-sys-0.5.1/src/base.rs
rename : third_party/rust/core-foundation-sys/src/bundle.rs => third_party/rust/core-foundation-sys-0.5.1/src/bundle.rs
rename : third_party/rust/core-foundation-sys/src/data.rs => third_party/rust/core-foundation-sys-0.5.1/src/data.rs
rename : third_party/rust/core-foundation-sys/src/date.rs => third_party/rust/core-foundation-sys-0.5.1/src/date.rs
rename : third_party/rust/core-foundation-sys/src/dictionary.rs => third_party/rust/core-foundation-sys-0.5.1/src/dictionary.rs
rename : third_party/rust/core-foundation-sys/src/error.rs => third_party/rust/core-foundation-sys-0.5.1/src/error.rs
rename : third_party/rust/core-foundation-sys/src/filedescriptor.rs => third_party/rust/core-foundation-sys-0.5.1/src/filedescriptor.rs
rename : third_party/rust/core-foundation-sys/src/lib.rs => third_party/rust/core-foundation-sys-0.5.1/src/lib.rs
rename : third_party/rust/core-foundation-sys/src/messageport.rs => third_party/rust/core-foundation-sys-0.5.1/src/messageport.rs
rename : third_party/rust/core-foundation-sys/src/number.rs => third_party/rust/core-foundation-sys-0.5.1/src/number.rs
rename : third_party/rust/core-foundation-sys/src/propertylist.rs => third_party/rust/core-foundation-sys-0.5.1/src/propertylist.rs
rename : third_party/rust/core-foundation-sys/src/runloop.rs => third_party/rust/core-foundation-sys-0.5.1/src/runloop.rs
rename : third_party/rust/core-foundation-sys/src/set.rs => third_party/rust/core-foundation-sys-0.5.1/src/set.rs
rename : third_party/rust/core-foundation-sys/src/string.rs => third_party/rust/core-foundation-sys-0.5.1/src/string.rs
rename : third_party/rust/core-foundation-sys/src/timezone.rs => third_party/rust/core-foundation-sys-0.5.1/src/timezone.rs
rename : third_party/rust/core-foundation-sys/src/url.rs => third_party/rust/core-foundation-sys-0.5.1/src/url.rs
rename : third_party/rust/core-foundation-sys/src/uuid.rs => third_party/rust/core-foundation-sys-0.5.1/src/uuid.rs
rename : toolkit/mozapps/extensions/internal/UpdateRDFConverter.jsm => toolkit/mozapps/extensions/internal/RDFManifestConverter.jsm
extra : rebase_source : 82ff5278cf9bd559763cc24e3f6d87139466bfe5
2018-05-08 18:54:28 +03:00
Gregory Szorc f1f60ea6e5 Bug 1459737 - Assert that volumes aren't used on Windows; r=dustin
Volumes are a docker-worker concept. They shouldn't be encountered on
Windows, which uses generic-worker.

MozReview-Commit-ID: KUdSxVHVJQ

--HG--
extra : rebase_source : ff54131d471ae2ae2465b11ca5ba6e787f5d11de
2018-05-04 18:02:54 -07:00
Gregory Szorc d427f004f7 Bug 1459737 - Move volume configuration to standalone function; r=dustin
Do to volumes what we did to caches.

MozReview-Commit-ID: 7s4nYPC27nk

--HG--
extra : rebase_source : 8c71459a4854a9de0f74469eb3655d8293554cfd
2018-05-04 18:00:44 -07:00
Gregory Szorc b21421f3de Bug 1459737 - Move cache configuration to standalone function; r=dustin
main() is quite long. And the control flow will become more complicated
as we support Windows.

Let's move the bulk of the cache configuration code into a standalone
function so main() is less cluttered.

MozReview-Commit-ID: xredCubr1E

--HG--
extra : rebase_source : 385fe6fe9e083cf585edc922b1fa26355d580c02
2018-05-04 17:54:07 -07:00
Gregory Szorc 389a573533 Bug 1459737 - Require to run on root on POSIX platforms; r=dustin
The code for cache and volume normalization makes assumptions that uid
and gid are defined. They are not defined if not running as root and
Python would crash in these code paths.

So, presumably this means that all tasks using run-task are running as
root. Let's codify that requirement.

This requirement is arbitrary. But let's not scope bloat run-task to
support scenarios until we need them.

MozReview-Commit-ID: 2uW4OSovzWi

--HG--
extra : rebase_source : 56ced8ecbd0eef3a55dc68413f4eab7601756cc0
2018-05-04 17:47:09 -07:00
Gregory Szorc d4ef29a704 Bug 1459737 - Move closure to module-level function; r=dustin
MozReview-Commit-ID: 2Z2qL8LaEno

--HG--
extra : rebase_source : 84dbe9f1dce931e856c6aa84d305523034aa2ae9
2018-05-04 17:41:45 -07:00
Gregory Szorc faf43ccbf6 Bug 1459737 - Teach run-task where to find Mercurial on Windows; r=dustin
Because we can't rely on it being in %PATH%.

MozReview-Commit-ID: H6sMdX7XO5Q

--HG--
extra : rebase_source : 7d97a0eae39e92ef95f6367ef673dd72359f516c
2018-05-04 17:33:19 -07:00
Gregory Szorc 69823158e7 Bug 1459737 - Make run-task more runnable on non-POSIX platforms; r=dustin
I want to make run-task work on Windows. The script is currently very
POSIX oriented, as it assumes the existence of the grp and pwd modules,
that user IDs are numeric, and that system calls like setresgid() and
setresuid() are available, etc.

This commit starts to make some of the POSIX-centric code conditional
on running on POSIX.

Code for uid/gid extraction has been moved to its own function. Some
error messages were tweaked slightly as part of the move. Otherwise,
the changes should be pretty straightforward.

There are still other parts of this file that won't work on e.g.
Windows. But this gets us a big step closer.

MozReview-Commit-ID: HNyytKcBbBo

--HG--
extra : rebase_source : 01d653c801865e36e562a8de4c9e6d6962498f19
2018-05-04 17:11:53 -07:00
Gregory Szorc 5d87fc997f Bug 1459737 - Move run-task into taskcluster/scripts; r=dustin
In preparation for making it usable on Windows, after which point
having it in a directory with "docker" in it doesn't make much sense.

MozReview-Commit-ID: Hgu0buFyJwF

--HG--
rename : taskcluster/docker/recipes/run-task => taskcluster/scripts/run-task
extra : rebase_source : 3c0b502d28b5aad54bd04069efbfda88e25bbb20
2018-05-04 17:23:31 -07:00
Simon Fraser 426a0e402a Bug 1458855 Change periodic file update reviewers r=asasaki
Summary: Now with correct phabricator usernames

Reviewers: aki

Reviewed By: aki

Bug #: 1458855

Differential Revision: https://phabricator.services.mozilla.com/D1133

--HG--
extra : rebase_source : fd8aa5de1c1aaedacbbad53fa692e6c3132a0a94
2018-05-08 08:07:30 +01:00
Gregory Szorc a339b799f8 Bug 1460451 - Add /usr/bin/python3 to Debian images; r=glandium
The python3-minimal package provides /usr/bin/python3 on Debian.

This commit installs this package so a `python3` executable is
provided.

This required backporting the package to wheezy. The final patch
is trivial. But I wasted a bit of time figuring out why `mk-build-deps`
wasn't working. It would no-op and exit 0 and then the build would
complain about missing dependencies!

glandium's theory is that the ":any" multiarch support on wheezy
isn't complete. Removing ":any" seems to make things "just work."

MozReview-Commit-ID: FBicpK4SmkQ

--HG--
extra : rebase_source : a28ce731024e8ed6a43fb30e2ed57da2abb50d0f
2018-05-09 19:54:21 -07:00
Aki Sasaki 6cc637e95c bug 1457034 - populate release_partner_build_number. r=nthomas
MozReview-Commit-ID: EC4jHIwBWWb

--HG--
extra : rebase_source : 8c1616bc825b51502f72df92b10e0a4904592966
2018-05-08 19:06:31 -07:00
Aki Sasaki aa58e7acbf bug 1457034 - generate `release_partner_config` in `release_promotion` r=nthomas
If we're not passed `release_partner_config` in the input, let's poll github for it in the action.

MozReview-Commit-ID: 2swx76vhTE5

--HG--
extra : rebase_source : d16c517348e506519bc6e6296ad7a0cb2f90527c
extra : source : 3ad2e53b051d48a54dfb1cf88b743ed4d9571ff6
2018-04-25 15:16:49 -07:00
Aki Sasaki 5d4a986a12 bug 1457034 - re-add partner github code. r=nthomas
We originally had this logic here, and called it from the `partner_repack` transform. This kept the config more hidden, but had the downsides of a) being difficult to test, and b) hitting the network during transforms, which we're trying to avoid.

We moved this code to release-runner3, and passed in the `release_partner_config` as input, and saved it as a parameter. Parameterizing the partner config means that we can refer to it easily throughout taskgraph generation and in local testing, and we don't have to hit the network during transforms. The downsides include potentially having to generate this config in multiple places (rr3, ship-it-v2, the partner hook), and risking hitting the 20k gpg cleartext character limit in the `ACTION_INPUT` environment variable.

Now I'm moving this code back into util.partners, but I'm calling it from the action, not from the transform. The action populates the `release_partner_config` parameter, so we can still access the config from anywhere in the taskgraph generation code, more easily test, and avoid hitting the network during transforms. It also means that release-runner3, ship-it-v2, and the partner hook can all use the partner config generation code from a single location, rather than having to duplicate it.

Hoping this is the last major change we need to make here for a while.

MozReview-Commit-ID: 8UmvmcAoZgD

--HG--
extra : rebase_source : 57464354ea294bec972d6ff44b8c9426b31fc644
extra : source : 21289762391e66c9330f5c6f93a417f8d608c6e9
2018-04-25 13:38:51 -07:00
Rob Wood 6802d07a28 Bug 1455872 - Build support for the new raptor performance framework; r=gps
MozReview-Commit-ID: FBvXwkYfz0o

--HG--
extra : rebase_source : eb611d916d1bfda47321f6f424eeefa5598c1f83
2018-05-02 16:42:41 -04:00
Rob Wood ced102a09b Bug 1455872 - Add taskcluster configs for raptor on OSX; r=jmaher
MozReview-Commit-ID: I67InZTEziy

--HG--
extra : rebase_source : b18672eca2d3922367d3e4e50ff4b451a06e479e
2018-04-24 10:30:42 -04:00
Ciure Andrei 5c13bf1ff4 Backed out 5 changesets (bug 1460470) for toolchains bustages a=backout CLOSED TREE
Backed out changeset 94a9641c5a01 (bug 1460470)
Backed out changeset 33fe8423f88c (bug 1460470)
Backed out changeset 4902cab3ce5d (bug 1460470)
Backed out changeset 19fe5702cf6d (bug 1460470)
Backed out changeset ef477a048b57 (bug 1460470)
2018-05-17 01:04:29 +03:00
Gregory Szorc 0023204ad1 Bug 1460470 - Make run-task Python 3.5+ only; r=mshal
A try push converting run-task to Python 3 seemed to complete without
error.

Since it is annoying writing code that needs to work on both Python
2 and 3, let's require Python 3 and remove code for supporting Python 2.

We implement a version check enforcing Python 3.5+. This is because
we're supposed to be standardizing on 3.5+ everywhere. I want to
prevent accidental usage of older Python 3 versions.

MozReview-Commit-ID: 4vATLZ6Si2e

--HG--
extra : rebase_source : d1450979e636387a5fdbd80ba19a92ec4fd31088
extra : histedit_source : 62910e29cc2fff0a1db0e9521cc58b200406d393
2018-05-11 10:19:53 -07:00
Gregory Szorc 9b265e41ee Bug 1460470 - Change run-task to use Python 3 by default; r=mshal
Python 3 is the future.

MozReview-Commit-ID: APuu4Q3mimj

--HG--
extra : rebase_source : 79839dc7f3ec130e467f1d0aa268bf3912cc1c8f
extra : histedit_source : 4be41658b5debaa6165228f60f09a9d1bf53ddbb
2018-05-09 17:26:40 -07:00
Gregory Szorc 84b3320347 Bug 1460470 - More run-task Python 3 porting; r=mshal
Mostly normalization of str and bytes. Python 3 is annoying for
systems level code where most things are bytes.

MozReview-Commit-ID: KpvZGegBkYn

--HG--
extra : rebase_source : aa50a6cd1337fe604015131b053234a2db642e57
extra : histedit_source : 8481b23bde4f408a59c623b8be43ee0611492afd
2018-05-09 21:15:36 -07:00
Gregory Szorc b300a4a11d Bug 1460470 - Make run-task somewhat usable on Python 3; r=mshal
This required a lot of attention to bytes versus strings.

The hacks around handling process output are somewhat gross. Apparently
readline() doesn't work on bytes streams in Python 3?! So we install a
custom stream decoder so we can have nice things.

There are still some failures in run-task on Python 3. But we're a big
step closer.

MozReview-Commit-ID: 4FJlTn3q9Ai

--HG--
extra : rebase_source : 1a45b158fb625c7fd86701736b16da8df122218d
extra : histedit_source : f66fb22e86caf9b6b3cb301bedeab0b709685ef3
2018-05-16 11:06:36 -07:00
Gregory Szorc 247b0d8be5 Bug 1460470 - Make run-task compile on Python 3; r=mshal
The file failed to compile due to octal syntax and missing imports.
After this change, we get a run-time error, which is strictly better.

MozReview-Commit-ID: nY9A13Pt3E

--HG--
extra : rebase_source : 074cbf7daaed820bd330b6850d28acd766b3801a
extra : histedit_source : e10c0a14f55148dd3e57a194d262ded41c038ee5
2018-05-16 13:57:08 -07:00
Tom Ritter 65a58e425c Bug 1460668 Bump MinGW to capture the CD3D11_BLEND_DESC fix r=froydnj
MozReview-Commit-ID: 83igqfjKm6O

--HG--
extra : rebase_source : 1f800310e562b5d1ba76bc5693e648eb63a44fac
2018-05-16 13:43:29 -05:00
Ciure Andrei e2adc25ccb Backed out 5 changesets (bug 1460470) for gps: image build failures a=backout CLOSED TREE
Backed out changeset 07a3e76abc8c (bug 1460470)
Backed out changeset 94c3b68ccc48 (bug 1460470)
Backed out changeset 88324086394e (bug 1460470)
Backed out changeset 16d15b4b97fa (bug 1460470)
Backed out changeset ebd569c9d870 (bug 1460470)
2018-05-16 22:29:17 +03:00
Gregory Szorc b3529e86ca Bug 1460470 - Make run-task Python 3.5+ only; r=mshal
A try push converting run-task to Python 3 seemed to complete without
error.

Since it is annoying writing code that needs to work on both Python
2 and 3, let's require Python 3 and remove code for supporting Python 2.

We implement a version check enforcing Python 3.5+. This is because
we're supposed to be standardizing on 3.5+ everywhere. I want to
prevent accidental usage of older Python 3 versions.

MozReview-Commit-ID: 4vATLZ6Si2e

--HG--
extra : rebase_source : bbf3a0bd6cc881002d38c58eef64636c5efa6712
2018-05-11 10:19:53 -07:00
Gregory Szorc abb76d95f9 Bug 1460470 - Change run-task to use Python 3 by default; r=mshal
Python 3 is the future.

MozReview-Commit-ID: APuu4Q3mimj

--HG--
extra : rebase_source : f204a712466f10149b35e125d9ceb181e0f420b7
2018-05-09 17:26:40 -07:00
Gregory Szorc 836b5bdad3 Bug 1460470 - More run-task Python 3 porting; r=mshal
Mostly normalization of str and bytes. Python 3 is annoying for
systems level code where most things are bytes.

MozReview-Commit-ID: KpvZGegBkYn

--HG--
extra : rebase_source : 6bda98911cf32ce1bc3d651805b473aff18bf1f9
2018-05-09 21:15:36 -07:00
Gregory Szorc dd1809c1fd Bug 1460470 - Make run-task somewhat usable on Python 3; r=mshal
This required a lot of attention to bytes versus strings.

The hacks around handling process output are somewhat gross. Apparently
readline() doesn't work on bytes streams in Python 3?! So we install a
custom stream decoder so we can have nice things.

There are still some failures in run-task on Python 3. But we're a big
step closer.

MozReview-Commit-ID: 4FJlTn3q9Ai

--HG--
extra : rebase_source : 38d5626574d924c25e3fb4eecf29d379c2678e0d
2018-05-16 11:06:36 -07:00
Gregory Szorc 65a310206f Bug 1460470 - Make run-task compile on Python 3; r=mshal
The file failed to compile due to octal syntax and missing imports.
After this change, we get a run-time error, which is strictly better.

MozReview-Commit-ID: nY9A13Pt3E

--HG--
extra : rebase_source : b13d859ffaa2d10795312ff5a0f3ebbd5ca06835
2018-05-09 16:14:28 -07:00
Andrew Halberstadt cedce1ff81 Bug 1466660 - Remove use-artifact directory from run-task workers after task has finished r=jmaher
Right now artifacts from previous tasks are left lying around. We should clean these up
in case a task accidentally uses an artifact from the wrong dependency.

Ideally we'd cache these properly based on the taskId they came from, but that can be
follow-up fodder.

MozReview-Commit-ID: HUgvNlqyFav

--HG--
extra : rebase_source : fb9c6723598223619993c2695fb588ead3325edb
2018-06-04 16:36:28 -04:00
Rob Wood b1aed740b1 Bug 1460741 - Taskcluster configs for raptor speedometer on firefox; r=jmaher
MozReview-Commit-ID: 2yOl5aoJvSu

--HG--
extra : rebase_source : 9ed4e5a697bb67b812960c1041b5c5bb49b42660
2018-05-15 14:47:12 -04:00
Tom Prince e3b55ab1ce Bug 1464523: [release] Simplify `resolve_keyed_by` logic in update-verify-config; r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D1490
2018-06-04 17:49:23 +00:00
Simon Fraser 3539c7c2ef Bug 1466552 Automated file updates for beta/release r=RyanVM
Enable blocklist.xml (and remote-settings, per bug 1451040) for release, and all updates for beta.

Differential Revision: https://phabricator.services.mozilla.com/D1529
2018-06-04 15:30:57 +00:00
Kartikaya Gupta dd196a279b Bug 1467783 - Split basic_compositor_video into a separate suite and disable it on QR test platforms. r=jmaher
MozReview-Commit-ID: Ls5rM9SgOV9

--HG--
extra : rebase_source : 21e6ebd5264cbbf5239f37caa6fc2ac3c317622e
2018-06-08 09:59:14 -04:00
Aki Sasaki ff8b4c5d69 bug 1403548 - filter out asan on beta+release. r=catlee
--HG--
extra : rebase_source : ac1f9badbe1e13d7dca43122cafb1d332830aa5b
2018-05-07 14:08:24 -07:00
Ted Mielczarek 1120b5bb3e bug 1437577 - allow uploading symbols from any build type on try. r=dustin
Previously we would only generate upload-symbols tasks for nightly builds,
since we only want to upload symbols for builds we ship to users.

On try, developers may want to use the symbol server but very rarely want
to do nightly builds, so allow uploading symbols from any build type there.

MozReview-Commit-ID: IYs9mZii3DN

--HG--
extra : rebase_source : 15acb889510bb07ed3d29ea802997f11796dad9f
2018-04-12 08:49:43 -04:00
Ted Mielczarek 666e28db6e bug 1437577 - preserve treeherder.platform from job into task. r=dustin
Tasks like upload-symbols that have a dependency on a build job want to
copy the treeherder.platform from the build job but it gets lost in
the task transform currently. This simply copies it into
an extra.treeherder-platform key to make life easier.

MozReview-Commit-ID: H4PtC4mvIYA

--HG--
extra : rebase_source : 5588bdadfcff8eb8f35935dc5c05dcde5658da83
2018-04-12 11:50:23 -04:00
Ted Mielczarek 7be3f76595 bug 1353296 - get rid of filter_upload_symbols. r=dustin
filter_upload_symbols is a relic of task configurations that were written
before we had a better handle on taskgraph generation. We should only be
uploading symbols for nightly builds anyway, so this is better served using
newer filtering methods.

upload-symbols tasks were specified to run on non-nightly build types in the
kind.yml, but those were filtered out in filter_upload_symbols. I believe
these were simply an artifact of the initial upload-symbols implementation
happening before nightly builds were running in Taskcluster.

MozReview-Commit-ID: Je1NytrVPT8

--HG--
extra : rebase_source : a961c17d329af848fa7bb64c5186135d37dd412f
2018-03-23 17:17:32 -04:00
Joel Maher fa141745dd Bug 1392106 - split reftest fonts into seperate suite. r=gbrown 2018-04-12 13:58:54 -04:00
Joel Maher 04ca7ca5ef Bug 1392106 - add a --run-slow mode to reftest to add extra time for win7 font rendering. r=ahal 2018-04-12 13:30:17 -04:00
Ben Hearsum 7400208c99 bug 1455692: add support for limiting locales in partner repacks. r=nthomas 2018-05-07 07:57:53 -04:00
Mihai Tabara b0de0153b7 Bug 1446815 - cleanup in naming beetmover source checksums for consistency. r=tomprince
--HG--
rename : taskcluster/ci/beetmover-release-source-checksums/kind.yml => taskcluster/ci/release-beetmover-source-checksums/kind.yml
extra : rebase_source : 46fad2100b374cd281db315472b0398a955211dc
extra : source : 7b33e1765372bb178a33e67a3a161d102c536906
2018-05-03 19:51:20 +03:00
Csoregi Natalia d69aac5687 Merge inbound to mozilla-central. a=merge 2018-05-05 12:47:28 +03:00
Tom Prince b62deb2fb0 Bug 1458700: Fix flake8 error; r=me
--HG--
extra : rebase_source : fb4fe847fa0e22ff49634c4207afcba65de001de
2018-05-04 15:50:02 -06:00
Brindusan Cristian 2d54f42738 Merge mozilla-central to inbound. a=merge CLOSED TREE 2018-05-05 00:43:22 +03:00
Brindusan Cristian 89a097be09 Merge inbound to mozilla-central. a=merge 2018-05-05 00:35:50 +03:00
Cosmin Sabou 6c3b5ef9ba Merge mozilla-central to autoland. a=merge CLOSED TREE 2018-05-04 21:06:14 +03:00
Cosmin Sabou dc4e10c449 Merge inbound to mozilla-central. a=merge
--HG--
rename : testing/profiles/prefs_general.js => testing/profiles/common/user.js
2018-05-04 20:37:47 +03:00
Simon Fraser 817daaf573 Bug 1459185 Fix filter for email in release-notify-promote r=jlorenzo
Summary: dustin's updating the documentation in https://github.com/taskcluster/taskcluster-notify/pull/33/files

Reviewers: jlorenzo

Reviewed By: jlorenzo

Bug #: 1459185

Differential Revision: https://phabricator.services.mozilla.com/D1132

--HG--
extra : rebase_source : b81502a5488728a9045892b973609c61df766769
2018-05-04 15:12:35 +01:00
Tom Prince 98a9ca8de3 Bug 1458700: [release-promotion] Record the root of the graph configuration for use in release promotion; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D1125

--HG--
extra : source : 364b590a58fe305b449fbdbbc6a0b65849a67699
extra : histedit_source : 22081606c5bfcddec126f5e22b2c257aa6ea719e
2018-05-02 20:28:11 -06:00
Tom Prince 9be271f7c9 Bug 1458700: [taskgraph] Move `load_graph_config` into `taskgraph.config`; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D1123

--HG--
extra : source : 38407a04fc43074648430482c6d4b0860cb9473d
extra : histedit_source : 09c671d2923789aae334e3c8df8510a1a9f07bd0
2018-05-02 19:28:43 -06:00
Tom Prince cd13ecc436 Bug 1421062: [release] Update secondary balrog tasks to get scopes based on project; r=aki
This is a follow up to 9c941daebe9fb3e79066ee4def16ed5ce0eb10a9

Differential Revision: https://phabricator.services.mozilla.com/D1140

--HG--
extra : rebase_source : 4c56ea683a7bcb3a80cd032e5491d3c13e891368
extra : source : 72e960bcc54751b15d144e0a5550c65649a2ad7d
2018-05-04 12:33:58 -06:00
Joel Maher 7979e74bbb Bug 1442893 - disable ts_paint_heavy on osx due to length of time to unpack profile. r=rwood 2018-05-04 14:13:08 -04:00
Cosmin Sabou 2f93cbd6cb Merge mozilla-central to inbound. a=merge CLOSED TREE
--HG--
rename : testing/profiles/prefs_general.js => testing/profiles/common/user.js
extra : rebase_source : e56a2d784bd87af73d03cc5fcdca84d8156ed054
2018-05-04 21:07:31 +03:00
Justin Wood c238627a38 Bug 1459050 - ja-JP-mac language pack should be submitted to AMO as "unlisted" in all cases. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1129

--HG--
extra : rebase_source : 46128cb5519e7f9f25ae343e05de46c0256b64a7
2018-05-03 14:26:55 -04:00
Johan Lorenzo 740147d7bf Bug 1408868 - Set bouncer alias in taskgraph and removed duplicated configs r=mtabara
MozReview-Commit-ID: EJt9Dc4kuPi

--HG--
extra : rebase_source : 650b6b6e26004ee2a308bfbc9f5b70927d93e037
extra : source : e1c89bf28365823de83262354b17801158d9414f
2018-05-03 18:17:52 +02:00
Ted Mielczarek 35c2dc5aed bug 1442306 - set MOZ_SOURCE_CHANGESET and MH_BRANCH consistently in the environment for mozharness tasks. r=gps
We currently set GECKO_HEAD_REV to the revision being built, but the build
system already looks for MOZ_SOURCE_CHANGESET so set that as well. Additionally,
set MH_BRANCH for mozharness tasks on generic-worker to match docker-worker.

MozReview-Commit-ID: 52B3SSQpSwU

--HG--
extra : rebase_source : d65ca493764e6a5fbc7cca1d018b21cd6c82b6a0
extra : histedit_source : d7bd585e69fcc9b781550f89571250729882c8e8
2018-04-30 16:26:59 -04:00
Andrew Halberstadt ee69aa133e Bug 1451159 - [testing/profiles] Store profile data in actual profile look alike folders r=gbrown
This moves testing/profiles/prefs_general.js to
testing/profiles/common/user.js. It also adds an 'extensions' folder to the
common profile. Dropping extension files here will get them installed in all
test harnesses (useful for testing on try).

The idea is that all test harnesses will eventually use this 'common' profile.
We'll also create some new per harness profiles, e.g testing/profiles/mochitest
and testing/profiles/reftest. This way there will be a single location
developers can go to set preferences, both for a specific harness, and across
all harnesses.

MozReview-Commit-ID: 8sqBqLiypgU

--HG--
rename : testing/profiles/prefs_general.js => testing/profiles/common/user.js
extra : rebase_source : 72a4a4b691e93c77479c7e70647b0ca373862c51
2018-04-19 16:12:26 -04:00
Dave Hunt d5d4c1b840 Bug 1455570 - Build and publish TPS add-on; r=dustin,ted
MozReview-Commit-ID: HOsTcmg1m7e

--HG--
extra : rebase_source : 57ee75482fe1204d741f851ed51f32a06146ae08
2018-04-23 14:32:05 +01:00
Chris AtLee 9472cb160b Bug 1450029: Remove buildbot/buildbot-bridge references from taskcluster r=aki,tomprince
MozReview-Commit-ID: Hu9ju4XVQpA

--HG--
extra : rebase_source : dba8ba385a86ef24a031bca58f01c6ec553d1459
2018-05-01 16:07:19 -04:00
Nick Thomas 7f4f680548 Bug 1459116 - Disable job failed/exception notifications, r=rail
MozReview-Commit-ID: 39kxGWO6oyV

--HG--
extra : rebase_source : 73e4a62670965867c4856a8fdd935b9e91bbf4b6
2018-05-04 17:24:49 +12:00
Johan Lorenzo 7e6fcca361 Bug 1459145 - Send notification emails when a shipping phase is over r=sfraser
MozReview-Commit-ID: FjOewecynv1

--HG--
extra : rebase_source : 232876ee0512371b1a12a1b08e79740670bb57af
2018-05-04 11:04:22 +02:00
Tom Prince 74d785280e Bug 1458700: [release-promotion] Add shipping-product list to graph config; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1111

--HG--
extra : source : d8ff2432bef5acc4f4d33ec983098cd47a0ac9d5
extra : amend_source : b25306140f25eef1c44127d3d77bb7471fb97344
extra : intermediate-source : 3cdfec4f89674ad248aa09566bef61bf43aa1eb0
2018-04-19 09:21:30 -06:00
Joel Maher 397494c8d5 Bug 1458638 - It looks like Skia is no longer being used on talos on windows. r=rwood 2018-05-04 14:19:53 -04:00
Joel Maher 6a518d2c97 Bug 1459273 - remove unnecessary options from taskcluster talos.yml configs. r=rwood 2018-05-04 14:19:45 -04:00
Johan Lorenzo 01951313fc Bug 1455325 - Staging release: promotion task should contact staging balrog, instead of prod one r=Callek
MozReview-Commit-ID: 8CLcuaJHixP

--HG--
extra : rebase_source : eb9150b2aa10adfd85a4a154e82dd553a737f3fd
extra : source : d266b9e4f3e8f1f80fd0433d474789443bfc436d
2018-04-19 16:18:50 +02:00
Bogdan Tara b7924c2ed2 Backed out 4 changesets (bug 1451159) for linux build bustages CLOSED TREE
Backed out changeset 72926ae685af (bug 1451159)
Backed out changeset f90a99682382 (bug 1451159)
Backed out changeset 3914937893de (bug 1451159)
Backed out changeset 79931e4a2bfb (bug 1451159)

--HG--
rename : testing/profiles/common/user.js => testing/profiles/prefs_general.js
2018-05-04 00:25:56 +03:00
Andrew Halberstadt fd23fd839b Bug 1451159 - [testing/profiles] Store profile data in actual profile look alike folders r=gbrown
This moves testing/profiles/prefs_general.js to
testing/profiles/common/user.js. It also adds an 'extensions' folder to the
common profile. Dropping extension files here will get them installed in all
test harnesses (useful for testing on try).

The idea is that all test harnesses will eventually use this 'common' profile.
We'll also create some new per harness profiles, e.g testing/profiles/mochitest
and testing/profiles/reftest. This way there will be a single location
developers can go to set preferences, both for a specific harness, and across
all harnesses.

MozReview-Commit-ID: 8sqBqLiypgU

--HG--
rename : testing/profiles/prefs_general.js => testing/profiles/common/user.js
extra : rebase_source : 7599913e547533f2f57b597ad0f238c6cd391c82
2018-04-19 16:12:26 -04:00
Brindusan Cristian 09c2471bd3 Merge mozilla-central to autoland. a=merge CLOSED TREE 2018-05-05 00:42:16 +03:00
Gregory Szorc 7a11019c3c Bug 1459077 - Install known working pip and virtualenv; r=ted
Previously, we installed the latest version of pip and virtualenv.

This commit pins the pip and virtualenv version so we install known
working versions (pip 10 breaks the image build for some reason).

MozReview-Commit-ID: hOAMencdcr

--HG--
extra : rebase_source : 2cb44c2ef55e29c55cf3d1b354e90d6fb5414cce
2018-05-04 13:10:50 -07:00
Dorel Luca e8a2c14c65 Merge mozilla-central to autoland 2018-05-03 13:01:33 +03:00
Dorel Luca 8d9f459c77 Merge mozilla-inbound to mozilla-central. a=merge 2018-05-03 12:58:18 +03:00
Simon Fraser 3cb2d4751b Bug 1458809 Update release bouncer scopes for esr60 r=mtabara
MozReview-Commit-ID: ESJ0SVFtsKE

--HG--
extra : rebase_source : 8d171de1576fc9ece0d4973ec48259bb945f1921
2018-05-03 09:00:05 +01:00
Justin Wood 85341db6a3 Bug 1458378 - Make l10n jobs (seen on try) tier 3, since they are more likely than not to fail, because they are different than what we do for Nightlies. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1081

--HG--
extra : rebase_source : c2086304702da7ed35c1ea045efdc3c916cd9abb
2018-05-01 19:03:59 -04:00
Gurzau Raul 295c747edd Merge mozilla-central to inbound. a=merge CLOSED TREE 2018-05-03 00:08:38 +03:00
Gurzau Raul 30662c7545 Merge inbound to mozilla-central. a=merge 2018-05-03 00:04:54 +03:00
Tom Prince 87e43b4e01 Bug 1456234: Fix yamllint errors; rs=bustage-fix CLOSED TREE 2018-05-02 11:31:40 -06:00
Justin Wood 36648e7085 Bug 1453033 - Define taskgraph logic for signing and shipping devedition language packs as well. r=aki
This merely extends the logic involved in shipping language packs to AMO. All devedition language packs will be shipped as 'unlisted' for now, meaning that there is no extra AMO work involved. The extension ID is taken from the langpack itself.

Differential Revision: https://phabricator.services.mozilla.com/D1104

--HG--
extra : rebase_source : a6fcc953c79531377540216343e9d0037a2879d6
2018-05-02 14:20:32 -04:00
Justin Wood 90990671f8 Bug 1453033 - Do not define shipping-product explicitly, let it be inhereted. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1103

--HG--
extra : rebase_source : 67f3c5fc13a0a516f12eac4140933756f9ad242c
2018-05-02 13:59:58 -04:00
Tom Prince 72bd9cbbd3 Bug 1456234: [release] Use release platforms for source; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1055

--HG--
extra : rebase_source : 3ac38ac3b178a8f0d738295d8385643945aa3fb1
2018-04-26 21:24:58 -06:00
Tom Prince 3d579a1b7c Bug 1456234: [release] Unsplit definition of release-source tasks; r=aki
The previous definitions are split across to files, but the task are complex
enough to warrant it.

Differential Revision: https://phabricator.services.mozilla.com/D1054

--HG--
extra : rebase_source : 2dd8b5330bfc835c23534037aa96370103248743
2018-04-26 21:24:50 -06:00
Tom Prince 23e2ca187b Bug 1456234: [release] Don't use toolchains in source tasks; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1053

--HG--
extra : rebase_source : 403c9d3778547eece1ae90789b96bfec9a7ddab3
2018-04-26 21:14:16 -06:00
Johan Lorenzo 3a1fec93ed Bug 1453274 - Add esr watersheds in update configs r=bhearsum
MozReview-Commit-ID: 1npP19obrBn

--HG--
extra : rebase_source : e84cd58ded0220a79fd7db550c7dc14f7b8be901
2018-05-02 17:52:27 +02:00
Cosmin Sabou ce9ff94ffe Merge inbound to mozilla-central. a=merge 2018-05-02 17:58:43 +03:00
Tom Prince 6578f466e7 Bug 1456234: [release] Use release platforms in generate-checksums tasks; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1019

--HG--
extra : rebase_source : f3170cbeb0a5028af7a3ea6e88992beabcfa52e4
2018-04-20 15:25:18 -06:00
Mihai Tabara 0d2a8b9577 Bug 1446815 - add source shas in release checksums. r=aki a=release
--HG--
extra : rebase_source : a9bc8a6087c809cac31e47a82a02af87aaa6a85c
extra : source : b7eafd965f5dad12c1914f32c610e0d23fb220e8
2018-04-30 19:05:35 +03:00
Gregory Szorc 8daf811909 Bug 1380893 - Add CI for plain builds; r=mshal
This commit adds CI tasks to perform "plain" builds. These builds use
the same toolchains used by official builds. But that's about it. The
mozconfig changes are minimal and only set up paths to toolchain
artifacts. sccache is not used.

The main goal of these builds is to have a "reference" build that
matches an out-of-the-box build environment as much as possible. We want
this mainly so we have timing and behavior information that matches what
developers are doing.

The Windows/generic Taskcluster worker doesn't like it when you specify
an artifact directory that doesn't exist. So we needed to add a
mozharness step to ensure UPLOAD_PATH exists to prevent those tasks from
erroring.

I'm not super thrilled about using mozharness here. We definitely don't
really need mozharness. But the main thing it is providing that we care
about is the Perfherder metrics data. I don't feel like scope bloating
to move that out of mozharness at this time.

I only implemented Linux64 and Windows64 because I'm not convinced
coverage on 32-bit build variations is useful. Tasks only run on trunk
because they are informational only and we don't need to waste resources
running these on release repos and on Try. They are tier 2 because they
aren't critical to shipping Firefox.

MozReview-Commit-ID: Gl6hGYbFX9b

--HG--
extra : rebase_source : 05360d2f6e5dbfed5543726a1be4b0e5d00e0b3d
2018-04-20 10:31:05 -07:00
Gurzau Raul 888b59c801 Merge mozilla-central to autoland. a=merge CLOSED TREE 2018-05-03 00:07:30 +03:00
Rail Aliiev a213746517 Bug 1434889 - Enable release promotion on esr60. r=jlorenzo
CLOSED TREE
2018-05-02 16:55:25 -04:00
Simon Fraser 008c875572 Bug 1458489 Avoid use of mirrors for beta and beta-cdntest release updates r=bhearsum
MozReview-Commit-ID: ETd58woJ3nY

--HG--
extra : rebase_source : 43e64d7be998dfd034f42b0a321db19116188425
2018-05-02 12:13:11 +01:00
Johan Lorenzo cbc63d130a Bug 1458479 - Add Firefox RC's complete bouncer entry r=sfraser
MozReview-Commit-ID: 6zYdsfJWW2L

--HG--
extra : rebase_source : d4b44d92cf594dde180acd528f2be67c79a77e2f
extra : intermediate-source : 601f1c97c389a68d93147e276f7cd4ab9b16aaa8
extra : source : 54b135713998d9a877b72f5de545e96b5c8c7fe9
2018-05-02 11:20:46 +02:00
Andreea Pavel 7955752872 Merge mozilla-inbound to mozilla-central. a=merge 2018-05-01 13:13:09 +03:00
Dustin J. Mitchell ebc5bef8b2 Bug 1458105 - try more to fetch automationrelevance; r=gps
MozReview-Commit-ID: LdcGes2mf01

--HG--
extra : rebase_source : ef4d14bca0b18defcedf5a039df85956de482f81
extra : source : ab6f969c2b916f87c3acc54d2abf1ae4d051d0e3
2018-05-01 01:25:24 +00:00
Tom Prince efca9c00c1 Bug 1421062: Enable production nightly balrog update on comm-central branches; r=me a=me
--HG--
extra : amend_source : e145d6164b8a2502f81bcd49008fe15afd3b2390
2018-04-30 14:14:22 -06:00
Tom Prince 386cd7a8bc Bug 1456182: [update-verify] Stop creating a virtualenv in update-verify-config-creator; r=nthomas
Since it is run with `mach python`, it uses the environment defined by
`build/virtualenv_packages.txt`. Thus, we don't need to create a separate
virtualenv.

Differential Revision: https://phabricator.services.mozilla.com/D1015

--HG--
extra : rebase_source : 023095f82d7219a10dffb3579276c5285db37cfc
extra : source : a2999a5b9b7aa08a7c5c2ba6384724853d14b9c5
2018-04-22 18:51:38 -06:00
Geoff Brown aebd334d65 Bug 1457971 - Support test chunks in runjunit.py and run geckoview-junit in 3 chunks on debug builds; r=me,a=test-only 2018-04-30 17:58:27 -06:00
Nick Thomas 6170e0ae61 Bug 1425571 - fixups for release notifications, r=aki
Sends 'in the candidates directory', 'pushed to cdntest', etc emails only when the underlying dummy tasks succeed, avoiding false messages when graphs are cancelled or the dummy job fails for infrastructure reasons.

Also sets the body of the email to be the same string as the subject, as we used to do, to avoid unnecessary information about the dummy task.
2018-04-30 13:45:53 +12:00
Andreea Pavel 7fec5697dc Merge mozilla-central to autoland. a=merge on a CLOSED TREE 2018-04-28 20:41:18 +03:00
Hector Zhao ad13f85bf6 Bug 1457423 - Locate android-{findbugs,lint} artifacts with updated filename. r=nalexander
MozReview-Commit-ID: 3sVHQr4toaS

--HG--
extra : rebase_source : d823dd4616e8ce604d1d8f32e6d235e12ce2828c
2018-04-27 19:25:57 +08:00
Kris Maglione a259026c9d Bug 1456035: Part 4 - Convert callers of XPCOMUtils.generateQI to ChromeUtils.generateQI. r=mccr8
This also removes any redundant Ci.nsISupports elements in the interface
lists.

This was done using the following script:

acecb401b7/processors/chromeutils-generateQI.jsm

MozReview-Commit-ID: AIx10P8GpZY

--HG--
extra : rebase_source : a29c07530586dc18ba040f19215475ac20fcfb3b
2018-04-22 20:55:06 -07:00
Csoregi Natalia d2c649436f Merge autoland to mozilla-central. a=merge 2018-04-28 00:52:20 +03:00
Tom Prince 3331d41567 Bug 1421062: Enable production beetmoving on comm-central branches; r=aki a=me
Differential Revision: https://phabricator.services.mozilla.com/D1060

--HG--
extra : rebase_source : 70c2605858f01503321189d7e4fa046d6c65b387
extra : amend_source : ba346c535b856f18e64afc6ce3502e0621be2c40
2018-04-27 14:53:43 -06:00
Johan Lorenzo 5b3fccf5b2 Bug 1456327 - Snap: pin desktop-gtk3 dependency for causing start up crash r=sfraser
MozReview-Commit-ID: 4diqZRxNwj3

--HG--
extra : rebase_source : cf97f01c31e8e67ebb05c2360a55cb44d0a5d1db
2018-04-27 11:17:02 +02:00
Andreea Pavel 17a7053b0d Merge mozilla-inbound to mozilla-central. a=merge 2018-04-26 17:03:43 +03:00
Robin Templeton 8f61a2db7d Bug 1455795 - Remove the AUTOMATION option from mozjs_sys's build.rs. r=sfink
This option shouldn't be used for local builds (see bug 1294157). Set
the option from the crate's taskcluster script instead, so that it's
used only for automated builds.

--HG--
extra : rebase_source : 94b398a0f1fac60094269d755735c426ecc63e17
2018-04-24 18:04:00 -04:00
Andreea Pavel a21531022b Merge mozilla-inbound to mozilla-central. a=merge
--HG--
rename : toolkit/components/extensions/test/xpcshell/test_ext_browserSettings.js => toolkit/components/extensions/test/xpcshell/test_ext_proxy_config.js
2018-04-26 09:04:59 +03:00
Johan Lorenzo ce8360e572 Bug 1453261 - adjust bouncer kinds to handle esr60. r=rail,mtabara CLOSED TREE
MozReview-Commit-ID: EpzlzLoQFLk

--HG--
extra : histedit_source : 786c95dc3a579c78ece2094d13a75e13f443fd50%2C5ce141423b18b432d1d6f1a721335f1ab49f636b
2018-04-16 16:25:26 +02:00
Mihai Tabara 20f7adc3ef Bug 1453273,1453255,1453253 - add esr60 fixes in automation. r=aki CLOSED TREE
--HG--
extra : histedit_source : b3427d4436bc7ef445eb67114bde33b16993d63c
2018-04-26 01:29:09 +03:00
Aki Sasaki 64e8635656 bug 1456620 - chunk mac partner signing. r=nthomas
Previously, we had a single mac signing task that signed all mac locales and subpartners in a single signing task. This task required us to bump the signing task timeout. Chunking gives us a speed boost and a bit more resiliency if a single signing task fails - we don't have to re-sign everything, only the tasks that fail.

MozReview-Commit-ID: 4vPZE1vzZoQ

--HG--
extra : rebase_source : 320e9b51061b57d65d08aed1e621983e911c7b6d
extra : source : 00c8d34184b954d259c04459da916bda8baaca78
2018-04-23 17:12:43 -07:00
Aki Sasaki 1b40a4b7fc bug 1456620 - move check_if_partners_enabled call. r=nthomas
Because the transforms are generators, we actually call them from the bottom up. The previous transforms don't get called until the `for task in tasks:` or `for job in jobs:` in the following transform.

Moving the `check_if_partners_enabled` transform to the end means we never try to access `config.params['release_partner_config'].values()` in `add_command_arguments` when `release_partner_config` is None. Otherwise, we hit errors when we run taskgraph-gen.py.

MozReview-Commit-ID: Ho2odPL9FxS

--HG--
extra : rebase_source : 51406b39c358ff99690e073920a2e3f66cb39c83
extra : source : 02136f9beec0726098d9263f84f46244bd454b9f
2018-04-23 13:53:19 -07:00
Aki Sasaki 1d75a042d7 bug 1456620 - stop uploading public partners to private. r=nthomas
MozReview-Commit-ID: 2clmiQKswnp

--HG--
extra : rebase_source : df3571f12016a631d8e967eaed37780e6674584a
extra : source : a09d7b1149dccccfea0f6922261c2b66292b5715
2018-04-23 12:57:36 -07:00
Chris AtLee 96d067df95 Bug 1403548: Enable nightly asan reportor builds and updates r=Callek
MozReview-Commit-ID: 2X03vU5bO32

--HG--
extra : rebase_source : 70d25b081ed874d4f88944e05f40764f948a45a7
2018-04-19 09:28:59 -04:00
Dorel Luca b78d790273 Backed out changeset a63caceffcee (bug 1403548) for liniting failure on builds/worker/checkouts/gecko/taskcluster/taskgraph/transforms/beetmover_repackage.py. CLOSED TREE 2018-04-26 00:07:21 +03:00
Chris AtLee a8def10cc3 Bug 1403548: Enable nightly asan reportor builds and updates r=Callek
MozReview-Commit-ID: 2X03vU5bO32

--HG--
extra : rebase_source : d4b6672eae5b378ac5a5d80d7f14d193d201f517
2018-04-19 09:28:59 -04:00
Coroiu Cristina 985588fd09 Backed out changeset 1527cfbcd067 (bug 1453273) for failing Geko decision task on a CLOSED TREE 2018-04-25 21:22:09 +03:00
Mihai Tabara 01008a59eb Bug 1453273,1453255,1453253 - add esr60 fixes in automation. r=aki
--HG--
extra : rebase_source : 991312e6cfbbb616e2c5f5706e9b3c1b8e6e0263
extra : source : cf2e01720435b19d7fb1320c48a91728b39bddaa
2018-04-20 09:54:03 +01:00
Tom Prince cdc2f74412 Bug 1418058: [taskcluster] Add `graph_config` to some actions that were originally missed; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D1025

--HG--
extra : rebase_source : 1c6579521edd185b79646b3aa14165877c0a12b3
2018-04-23 13:08:28 -06:00
Geoff Brown bc36ecada6 Bug 1445716 - Increase timeout for geckoview-junit on android debug; r=jmaher 2018-04-25 09:10:26 -06:00
Geoff Brown b0abf7f6dd Bug 1445716 - Add new Android test task geckoview-junit, but do not run it yet; r=jmaher
Add geckoview-junit test task to taskcluster and mozharness configs.
https://developer.mozilla.org/en-US/docs/Mozilla/Geckoview-Junit_Tests
2018-04-25 09:10:26 -06:00
Gurzau Raul faeb9b7ddd Merge inbound to mozilla-central. a=merge 2018-04-25 12:36:04 +03:00
Brindusan Cristian 9265429dcd Merge mozilla-central to autoland. a=merge CLOSED TREE 2018-04-25 00:57:49 +03:00
Chris Manchester 73c4c02d68 Backed out rust 1.25 update due to breaking Windows rust oom stack traces (bug 1447116)
MozReview-Commit-ID: EkBliM51n59
2018-04-24 12:07:49 -07:00
Justin Wood b85bff3aac Bug 1456246 - taskgraph: Perform release promotion needs on mozilla-esr60 on-push. (No Android). Fix bustage. r=rail
--HG--
extra : rebase_source : 834dd0b4041789c1c74d97fc7cef82fe3a77043a
2018-04-24 10:52:30 -04:00
Joel Maher b6b767f893 Bug 1425929 - test-verify jobs should pick a virtualization appropriate to the test. r=gbrown 2018-04-24 10:20:19 -04:00
Joel Maher 9077c8cf36 Bug 1453056 - test-verify should have the ability to run in chunks depending on the incoming tests. r=gbrown 2018-04-24 10:20:11 -04:00
Margareta Eliza Balazs 36dec78aec Merge inbound to mozilla-central. a=merge
--HG--
rename : toolkit/mozapps/extensions/internal/XPIProviderUtils.js => toolkit/mozapps/extensions/internal/XPIDatabase.jsm
2018-04-24 12:42:08 +03:00
Tom Prince 25fe6ae3a0 Bug 1455448: [taskcluster] Use `taskgraph` indexed decision tasks for finding parameters; r=me
Now that 28db2c96ac69 has been uplifted, get parameters from the new index paths.

--HG--
extra : rebase_source : 17166c55ad85ee153196e1797fe027dc6895beb2
2018-04-23 22:59:59 -06:00
Ciure Andrei 84bde96dc6 Merge mozilla-central to autoland. a=merge CLOSED TREE 2018-04-24 04:26:26 +03:00
Tom Prince 0de4a5fd3d Bug 1455448: Don't include `firefox` in the decision task index; r=dustin,mshal,rail,Callek a=release
The decision task is used for everything built as part of a push (for
mozilla-central, this is firefox, devedition and fennec, as well as tasks that
aren't strictly part of any product). Thus, having `firefox` encoded as part of
the decision task doesn't make sense.

This changes the route from
    index.gecko.v2.${repository.project}.latest.firefox.decision
to
    index.gecko.v2.${repository.project}.latest.taskgraph.decision
while leaving the latter for backwards compatability with tools that expect it.

Differential Revision: https://phabricator.services.mozilla.com/D996

--HG--
extra : rebase_source : c4c4691bb4633225e5e37b21982b916f76353e27
extra : source : 6ef1607a3e63250eefbda5333d61fd338c23311d
2018-04-19 15:32:02 -06:00
Ciure Andrei 33e644e1da Merge inbound to mozilla-central. a=merge 2018-04-24 04:14:21 +03:00
Tom Prince 0822363bfa Bug 1456175: [mozharness] Remove unreferenced `enable_signing` config; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D1014

--HG--
extra : source : 8c1bb61b86d6678b9109bff0f659b1bb4c98442b
extra : amend_source : c6f1f2e7414f232e1eee57d7bd62fde9d79212b3
2018-04-20 14:51:33 -06:00
Johan Lorenzo 3f11f75aa1 Bug 1453266 - Fix bad worker-type and scopes r=rail
MozReview-Commit-ID: DbQXkXUk7am

--HG--
extra : rebase_source : 38b80fc36cdf7f3db7181376f98c451ae124bed1
2018-04-16 16:10:13 +02:00
Justin Wood fe50f509e3 Bug 1456246 - taskgraph: Perform release promotion needs on mozilla-esr60 on-push. (No Android). r=rail
MozReview-Commit-ID: BFpSAz3oj3F

--HG--
extra : rebase_source : db212900f7ea4e19f29a543f7cacb5e2dcc201fe
2018-04-23 15:39:33 -04:00
Ciure Andrei 1940af33ec Merge mozilla-central to mozilla-inbound. a=merge CLOSED TREE 2018-04-24 04:29:20 +03:00
Tom Prince b929e4e30d Bug 1456234: [release] Embed generate-checksums mozharness config in taskcluster config; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1018

--HG--
extra : rebase_source : daa6987654bbd16858dd17dfa4b85a78bd9f77e6
extra : source : 934cccf5ed74d5024f183bedbc40ad12bdc3ae00
2018-04-23 12:43:53 -06:00
Tom Prince 9203ed3c58 Bug 1456234: [mozharness] Process EXTRA_MOZHARNESS_CONFIG even if no files are specified; r=aki
This will allow mozharness configs to be specified exclusively in the taskgraph.

Differential Revision: https://phabricator.services.mozilla.com/D1017

--HG--
extra : rebase_source : a3a9b6cc9d1004c4bd396fccc3e4354a7316651d
extra : source : 10acd193df92b7c495789dc24157b85f116ade5e
2018-04-23 17:39:35 -06:00
Justin Wood e9432bbb09 Bug 1458395 - Do not use stub installer on esr60. r=aki
On ESR[60] stub installer isn't designed to work, and we expect most users of esr will have no use for a stub installer. However this poses some problems where the taskgraph assumes that any Nightly generates a stub installer and thus it should be available along the way.

The patch hardcodes the list of branches that do not need a stub installer, though we'll want to clean up this specification in some way, as Thunderbird will likely need it to be cleaner and we may want on-change builds to use this logic (e.g. for on-change l10n).

Differential Revision: https://phabricator.services.mozilla.com/D1082

--HG--
extra : source : 2f091908b8839650961c3968b6beee1dd8d1084b
2018-05-01 19:32:38 -04:00
Geoff Brown 742c252648 Bug 1445716 - Run new Android test task, geckoview-junit; r=me,a=test-only
https://developer.mozilla.org/en-US/docs/Mozilla/Geckoview-Junit_Tests

--HG--
extra : rebase_source : 692d3ab979917af756d1bea743015d8d7059a5cb
2018-05-01 07:55:35 -06:00
Andreea Pavel 5df2666ad7 Merge mozilla-central to autoland. a=merge on a CLOSED TREE 2018-04-26 09:06:52 +03:00
Nick Thomas 1ab53e6094 Bug 1457010 - gpg sign partner repacks, r=aki
This adds repackage-signing on mac and linux, depending on repackage and the chunking-dummy kinds respectively, and repackage-signing is extended to create gpg signatures. The signing_dependencies are no longer added because the beetmover_repackage_partner.py transform is going to set that up manually, and it avoids duplicate targets which the schema blocks.

Beetmover can depend now on repackage-signing for all platforms, and no longer has any indirect dependencies to worry about, but does need to know about copying the .asc files as upstream artifacts.

MozReview-Commit-ID: JcIdXQ2B7Rg

--HG--
extra : rebase_source : d05f1092b72e4241ff2f40b286cbe0f8af94ea67
2018-04-26 10:52:03 +12:00
Gregory Szorc 80069167e7 Bug 1456326 - Bump version of decision image; r=dustin
Version number is arbitrary.

MozReview-Commit-ID: EGfDiyGuCPI

--HG--
extra : rebase_source : e7412924db64446fcb9c3c11c100077376ef95ef
2018-04-23 17:53:16 -07:00
Gregory Szorc 3c563381fe Bug 1456326 - Trim some fat from decision image; r=dustin
The big win comes from removing the APT lists. We also reduce the
number of layers while we're here.

This makes the image 162 MB instead of 202 MB.

MozReview-Commit-ID: K2ic4zcr31j

--HG--
extra : rebase_source : afda144f1a1319971842642b58460de169e245fa
2018-04-23 17:52:45 -07:00
Geoff Brown 1670bd015f Bug 1460411 - Add taskcluster configuration for android-x86-7.0 tests; r=me,a=test-only
The new platform is disabled for now: Expect no changes, yet.
2018-05-14 08:12:46 -06:00
Justin Wood 7a24d336a5 Bug 1459198 - Set a validation method to make sure notification filters are accurately set. r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D1135

--HG--
extra : rebase_source : 7bea1d4a2ea48f1fa5df224be0ab5dffb3e84ad3
2018-05-04 09:44:57 -04:00
Mihai Tabara 0de0e21e8d Bug 1453993 - Update repo update owners for releaseduty change. r=sfraser
--HG--
extra : amend_source : 3566bdc350387d676e24e5955f146d27e2573868
2018-05-14 13:38:56 +01:00
Tom Prince 8ae52f6885 Bug 1456379: Remove references to `date` branch; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1028

--HG--
extra : rebase_source : d25e21bd7c0140392efdecf01fa3bd879a8a9779
2018-01-23 14:48:27 -07:00
Mathieu Leplatre a43f7613d3 Bug 1451040 - Download remote settings dumps regularly r=sfraser
MozReview-Commit-ID: BCCEplOq1O8

--HG--
extra : rebase_source : 4a9840b7a36b1d08e3fa012fcad755516e292ec2
2018-05-16 13:03:22 +02:00
Andrew Halberstadt 4296f8c8f5 Bug 1461980 - [taskgraph] Use run-task's 'use-artifacts' key to setup artifacts in mochitest and reftest selftests, r=dustin
Instead of downloading the build artifacts (rather hackily) in moztest.fixtures, this now happens
directly in the taskgraph module via the run-task script.

For now extraction and setup happens in the task's command key. It might be a good idea to figure
out a syntax to tell run-task to do this extraction, e.g something like:

run:
    using-artifacts:
        build:
            target.tar.bz2:
                extract: true
                path: /home/worker/build
                name: firefox

But for now I wanted to avoid this extra complexity, so maybe it could be done in a follow-up.

MozReview-Commit-ID: KOhFFpFdP7Y

--HG--
extra : rebase_source : dcea36661fa9c6442c76c850ccc67f8f6d924fda
2018-05-18 08:22:36 -04:00
Andrew Halberstadt dbbfae76db Bug 1461980 - [taskgraph] Add ability to download artifacts from dependencies in run-task script, r=dustin
This adds a 'use-artifacts' key to the run_task schema. Tasks can specify artifacts to download like this:

run:
    using: run-task
    use_artifacts:
        build:
            - target.tar.bz2
            - target.common.tests.zip
            - target.mochitest.tests.zip

This will cause the run-task script to download those three artifacts from the task's 'build' dependency.
If the task doesn't have a 'build' dependency, taskgraph generation will error. The artifacts will be
downloaded into $USE_ARTIFACT_PATH. It is up to the task to do whatever extracting/setup may be required.
E.g this setup could go in the task's command.

At this time, only 'run-task' tasks using docker-worker are supported.

MozReview-Commit-ID: 3f02oCys62i

--HG--
extra : rebase_source : e8a85040e45042b537d4119334c4a8b7280b295c
2018-05-17 10:04:23 -04:00
Johan Lorenzo 489364e307 Bug 1455143 - Stop beetmoving deleted testing artifacts r=gps,mtabara
MozReview-Commit-ID: L10NmJH7s2A

--HG--
extra : rebase_source : ffa89550eabfc367bae0d5e1794bc28d628b1d41
2018-04-20 16:13:43 +02:00
Andreea Pavel 5743b5b700 Merge mozilla-inbound to mozilla-central. a=merge 2018-04-21 12:31:28 +03:00
Dorel Luca 15813c8ca0 Merge mozilla-central to mozilla-inbound 2018-04-21 02:06:35 +03:00
Dorel Luca 65669dae30 Merge mozilla-inbound to mozilla-central. a=merge 2018-04-21 02:00:04 +03:00
Steve Fink 2c3ce821ef Bug 1455201 - Propagate failure out of set -e region and add verbose logging to autospider.py, r=jonco
--HG--
extra : rebase_source : 3b2b301e45e555de489ac26bc22e1e1e181c6357
2018-04-19 11:20:26 -07:00
Tom Prince 46b214367d Bug 1452179: [mozharness] Get rid of references to private pypi server; r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D999

--HG--
extra : rebase_source : 778e22131bcb22892d8ce457f598716b230a173f
2018-04-19 16:46:50 -06:00
Dorel Luca 3409e8f9fb Merge mozilla-central to autoland
--HG--
rename : testing/mochitest/tests/SimpleTest/SpawnTask.js => testing/mochitest/tests/SimpleTest/AddTask.js
rename : testing/mozharness/mozharness/mozilla/testing/verify_tools.py => testing/mozharness/mozharness/mozilla/testing/per_test_base.py
extra : rebase_source : 6f474049dab2c2979e13ea87114b82d2b04715d0
2018-04-21 02:03:27 +03:00
Andrew Halberstadt c52efbdc58 Bug 1410424 - [docs] Support live reloading with |mach doc| r=mshal
This changes the default to opening a livereload webserver after doc generation
(as opposed to opening the index file). Any changes to the specified path will
result in a rebuild and refresh of the browser.

For example, if you run:

    ./mach doc tools/lint

The linting docs will be built, served and opened in a browser. Modifying any
file under 'tools/lint/docs' will refresh the browser with your changes.

To disable this behaviour and simply open the index file, you can pass in
'--no-serve'. The '--no-open' flag will continue to work (both with http and
the file system).

One caveat to this patch is that when generating the root docs (by running
|mach doc|), we don't watch all possible doc paths (just the root one under
'tools/docs/'). This will probably be fixed in the follow-up bug 1454640.

MozReview-Commit-ID: FQecuePM0zZ

--HG--
extra : rebase_source : 3240402d7505e99a4f64dada309b1baec78306e1
2018-04-06 10:52:56 -04:00
Cosmin Sabou 5e9d16a446 Merge mozilla-central to autoland. a=merge CLOSED TREE 2018-04-20 01:37:07 +03:00
Brindusan Cristian de7724a73a Backed out 3 changesets (bug 1431753) for android mochitest failures on mozharness/base/script.py CLOSED TREE
Backed out changeset bc062fa71ca7 (bug 1431753)
Backed out changeset df038cacff14 (bug 1431753)
Backed out changeset 381cc9c492f3 (bug 1431753)

--HG--
rename : testing/mozharness/mozharness/mozilla/testing/per_test_base.py => testing/mozharness/mozharness/mozilla/testing/verify_tools.py
2018-04-19 22:31:24 +03:00
Marco Castelluccio ac95649c98 Bug 1431753 - Add a test-coverage test suite, similar to test-verify, that runs tests in isolation in coverage mode. r=gbrown,jmaher
--HG--
extra : rebase_source : 8e151ddc81d528f85e2a4acbd7623935d4246b4f
2018-04-19 19:19:31 +02:00
Gregory Szorc 6783cc56fe Bug 1441170 - Increase max run time for file metadata test; r=mshal
It was intermittently timing out.

MozReview-Commit-ID: BCgvvYMhHqR

--HG--
extra : rebase_source : 4ca3eb019f6d1f511545366b4ec36e15d4b5f28b
2018-04-19 15:10:55 -07:00
Johan Lorenzo 0a5d99fe57 Bug 1453275 - Fix file list to bump in esr60 r=Callek
MozReview-Commit-ID: HVWWh6745By

--HG--
extra : rebase_source : 2f51591be14560004ecd1dbecb2c49e5cfe778b9
2018-04-16 16:05:24 +02:00
Mihai Tabara 633c612131 Bug 1447688 - Retire first generation of in-tree beetmover and relpro postrelease scripts.r=rail 2018-04-18 18:58:27 +01:00
Andreea Pavel 465753992f Merge mozilla-central to mozilla-inbound. a=merge on a CLOSED TREE 2018-04-18 20:13:24 +03:00
Rob Wood 4af496d7f2 Bug 1454466 - Move raptor in-tree; r=ahal
MozReview-Commit-ID: AkqbROfvmbu

--HG--
extra : rebase_source : bf30030a333852d6d81c4278e91b1ac9fef237fe
2018-04-16 17:15:38 -04:00
Simon Fraser a1f260050b Bug 1355482 Fix partials documentation code block r=bhearsum
Summary: A space was needed to make the code block show up

Reviewers: bhearsum

Reviewed By: bhearsum

Bug #: 1355482

Differential Revision: https://phabricator.services.mozilla.com/D957

--HG--
extra : rebase_source : 58c163102ddfd9982a98c0bc2ef9967fbf883d15
2018-04-18 15:01:36 +01:00
Dorel Luca 97278c775c Backed out changeset f5f4089f457e (bug 1447688) for Gecko Decision Task failures. CLOSED TREE 2018-04-18 11:14:20 +03:00
Mihai Tabara bbffa87016 Bug 1447688 - Retire first generation of in-tree beetmover and relpro postrelease scripts.r=rail DONTBUILD 2018-04-18 09:01:20 +01:00
Csoregi Natalia 12a8bddd95 Merge inbound to mozilla-central. a=merge 2018-04-18 00:52:25 +03:00
Tom Prince 834d10278e Bug 1442545: [partner-repack] Sign repacked partner builds; r=Callek CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D983

--HG--
extra : source : d05a241acdea1cd4ccbdff66d3c5be5d3d90a26f
extra : amend_source : 5350b45cfad214caabaca89e00eca59727db3a2c
2018-04-18 12:17:09 -06:00
Tom Prince 2e749d3e5a Bug 1442545: [partner-repack] Beetmove the partner repacks; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D992

--HG--
extra : rebase_source : 66571663a4f3455a3f5b9d5afa616c48a35e46ad
extra : source : f292fad571a41e45706cd75a0b0afde7feff58e0
extra : histedit_source : 304e44cef85dfe8514748db3fad484a09cbca727
2018-04-18 12:19:14 -06:00
Tom Prince 5ab88d1ae9 Bug 1442545: [partner-repack] Repackage signed partner builds; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D982

--HG--
extra : rebase_source : 2ac19d749ba9f2dbbebb594d31b144c3d4cbf673
extra : histedit_source : e7f3fa0f7615bd3cd40eb73a49049364acc42d63
2018-04-18 12:06:17 -06:00
Tom Prince fd906f4207 Bug 1442545: [partner-repack] Sign partner builds; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D981

--HG--
extra : rebase_source : 70270db813298a871ca53dbe8c7aca57a12e4fb5
extra : histedit_source : 06fc88f9f5d1f008f9cc42a6c950ee471adeba56
2018-04-18 12:02:24 -06:00
Tom Prince c4549c8e6b Bug 1442545: [partner-repack] Add repack partner builds; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D980

--HG--
extra : rebase_source : cc2a3419115cd40f5cd3f997071b0e1b46324821
extra : histedit_source : 24f8156d534da14a89a149c86eeecb57eb74ec23
2018-04-18 11:02:02 -06:00
Ben Hearsum f6aa7204c0 Bug 1442545: [partner-repack] Add docker image for partner repacks; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D979

--HG--
extra : rebase_source : 9d5b469a66c872a3c9623e2f8afbe21c0514059e
extra : histedit_source : e2371130271cc7a44dab498ecc01c4f7d243e3bf
2018-04-19 10:00:47 -06:00
Tom Prince 5a831f2473 Bug 1442545: [partner-repack] Don't display partner repacks on treeherder; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D978

--HG--
extra : rebase_source : 6378eae5e6dde4fa4debc918dd95af3dc08ded82
extra : histedit_source : d24a7c5ec0fb52789392c1541fecd0b2100baf4c
2018-04-18 13:07:07 -06:00
Tom Prince 8ad6e70430 Bug 1442545: [partner-repack] Add parameters needed for doing partner repacks; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D977

--HG--
extra : rebase_source : 0f2ef4edf6093d644c82c6b0475ba7796ebaa90b
extra : histedit_source : b446b09b30a0f709f4c80eaf69ec40952562ce6d
2018-04-16 20:48:40 -06:00
Tom Prince eda1a9a23c Bug 1442545: Allow forcing artifact access to be via private URLs; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D976

--HG--
extra : rebase_source : 2c2c861ded410ca4d311ee2ec77010daffef6a62
extra : histedit_source : d0725429fa267be465f796ab85f356861bd91e71
2018-04-16 20:43:50 -06:00
Tom Prince abc1d69243 Bug 1442545: Propogate shipping-product/phase in signing; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D975

--HG--
extra : rebase_source : b45aee03fc2a3416e44e4c8dbd2adaa495fe0bab
extra : histedit_source : 0183e8fa43bd1ccbb4aefeb0ffa2192b549aaa1c
2018-04-18 13:05:21 -06:00
Tom Prince 04c60d2765 Bug 1442545: Add max-run-time to signing workers; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D974

--HG--
extra : rebase_source : 516e2ef631a24e89c8ae352749452b25766fa1fe
extra : histedit_source : 5791d6042e5ff4f58aa9e3671d38b578da4ac96a
2018-04-18 13:04:09 -06:00
Kartikaya Gupta 7552033883 Back out cset 93c851a45ec7 (bug 1453478) because it is failing spuriously and wasting people's time. r=backout 2018-04-19 10:16:34 -04:00
Chris AtLee 1ae20747ee Bug 1455726: Disable emails to release+tcstaging. r=bhearsum,tomprince
MozReview-Commit-ID: pbyLauEdDE

--HG--
extra : rebase_source : d63c0c3b6321a9463b1388ab4c380c37fd59d15d
2018-04-20 15:27:18 -04:00
Ben Hearsum 4cf1677084 bug 1455061: upgrade releng docker images to latest python + python dependency versions. r=rail 2018-04-19 09:13:29 -04:00
Johan Lorenzo 763a893e88 Bug 1453270 - taskgraph: Make snap tasks support esr60 r=rail
MozReview-Commit-ID: EcbRkQhazdf

--HG--
extra : rebase_source : 5053bbabbe84e03dfd9ecdad89bb7968b27957d7
2018-04-16 16:59:22 +02:00
shindli 805cb19c1d Merge mozilla-central to autoland. a=merge CLOSED TREE 2018-04-17 01:45:58 +03:00
Ben Hearsum f3da0aa384 bug 1355482: document taskcluster releng implementation and release promotion - add missing file. r=aki 2018-04-16 11:25:24 -04:00
Tom Prince c31f0f3cb8 Bug 1418058: [taskcluster] Update actions to take and use graph configuration; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D916

--HG--
extra : rebase_source : 5b12a52dfa146a0e33b93387deb3e5178a078b3a
2018-04-09 21:30:36 -06:00
Tom Prince d0d79d96e0 Bug 1418058: [taskcluster] Get the `.taskcluster.yml` from the current project; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D915

--HG--
extra : rebase_source : 0d627c485cfb2eedc713c404f03b9c8c5058e68a
2018-04-11 12:02:47 -06:00
Tom Prince 82818118aa Bug 1418058: [taskcluster] Load graph configuration for the correct project when running actions; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D914

--HG--
extra : rebase_source : f2e6591f3ac126b16070549789975fae58c0b3bc
2018-04-11 12:02:19 -06:00
Tom Prince fdb3fa18c8 Bug 1418058: [taskcluster] Add the prefix for the graph parameters of the primary repo to the graph config; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D913

--HG--
extra : rebase_source : 20c7b2e7537ea55a8191b86388175c1a3ea7c42c
2018-04-11 11:08:48 -06:00
Tom Prince ec7000854d Bug 1418058: [taskcluster] Pass a graph_config through action task generation; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D912

--HG--
extra : rebase_source : 7773c3f795e42e470c16986bd71e044169ac0f99
2018-04-11 10:24:14 -06:00
Tom Prince dcb92ef089 Bug 1410255: Use `is_try` in more places; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D411

--HG--
extra : amend_source : 04fc8eff00a0cafd3d9ce9950f1d953fb68f7bdc
2018-04-13 10:52:06 -06:00
Simon Fraser 528a2ea01a Bug 1453616 Disable buildbot periodic file updates r=Callek
Summary:
Disable just the buildbot version of the periodic file updates in the file_update action.
Removing the code will happen later.

Reviewers: Callek

Reviewed By: Callek

Bug #: 1453616

Differential Revision: https://phabricator.services.mozilla.com/D921

--HG--
extra : rebase_source : 929ac46305f72ef0355f040243270e2f1f032de3
2018-04-13 15:20:11 +01:00