5d99fc5820
Merge mozilla-central to autoland
2017-04-04 12:38:55 +02:00
530eaa4b4e
Bug 1352477 - taskgraph ignores run-on-project for fennec-nightlies r=aki
...
MozReview-Commit-ID: 2cdNTV11gdn
--HG--
extra : rebase_source : c6c8672be923a03a83ee8d833313bcf0d02c789a
2017-04-03 14:53:08 +02:00
c4ac3e36d2
Bug 1341352 - add balrogworker support for releases. r=aki a=release DONTBUILD"
...
MozReview-Commit-ID: KbkKMdKmQpG
--HG--
extra : source : dae947786d0c56bd96e63cf4d40e702db4694e16
2017-04-04 07:37:24 +08:00
75935fcc5c
Bug 1339542 - When Servo vcs sync service lands Servo commits in autoland repo, run linux64-stylo tests but skip other platforms (to reduce test load) r=dustin DONTBUILD
2017-04-03 15:48:09 -04:00
a3d05860ed
Bug 1352839 - Fix various typos of the word "taskcluster" in the tree. r=garndt
...
--HG--
extra : rebase_source : fc030f8f5761083f86485c883ba1c2b5f1266773
2017-04-02 09:13:00 -04:00
4cfcb8865a
Merge autoland to central, a=merge
2017-03-31 17:12:31 -07:00
30cd0565b2
Backed out changeset 0edd9de2ca10 (bug 1317783) for future nightly bustage a=backout
2017-03-31 11:09:13 -07:00
819ad4cb14
Bug 1350390: use optionally_keyed_by for worker-type; r=Callek
...
MozReview-Commit-ID: L2AxEZx1H0w
--HG--
extra : rebase_source : ec54f20e20e5297f07fda49a72bb7bdcca74232c
2017-03-27 16:09:44 +00:00
dc7a4bf28f
Bug 1350390: make fields that were unnecesarily optional, required; r=Callek
...
Docker-worker's `command` field is actually not required, as it will run a
docker image's default command when command is not specified.
MozReview-Commit-ID: I3vBHeixlxW
--HG--
extra : rebase_source : a5d02c3131dd6ffb307c37e827d58aa8686ccaf8
2017-03-24 17:53:57 +00:00
5e62d58f28
Bug 1350390: only require worker.implementation for jobs; r=Callek
...
MozReview-Commit-ID: 6VAQ5jJzBor
--HG--
extra : rebase_source : 1a08107b74f9b08e4f92aac2e1543d26ccb9f4e5
2017-03-27 16:04:59 +00:00
cca64f884f
Bug 1317783 - Put PushApk tasks in-tree r=aki
...
MozReview-Commit-ID: 8uGIuj7OXwZ
--HG--
extra : rebase_source : d9ff99b54a7cffb258cdfe390ab9f733cdffb4a3
2017-03-30 12:13:01 +02:00
c2e3800988
Bug 1350447 - Use lower compression level for level 1 tasks; r=dustin
...
A few commits ago, we bumped up the default zstandard compression level
from 3 to 10 when we switched to multi-threaded compression. Even with
multiple threads, this was a bit slower.
For images that will be built once and read multiple times, it is
worthwhile to burn extra CPU once and produce a small image. However,
for other tasks where the number of reads is limited, it isn't
worth it to use this extra CPU. This commit uses the SCM level as
a proxy for "optimize for speed." If the task is associated with level
1 (a try push), we lower the compression level and optimize for
speed. Otherwise, we keep the higher compression level and
optimize for image size.
Credit goes to Jonas for this terrific idea.
MozReview-Commit-ID: Hui97KsZpgw
--HG--
extra : rebase_source : 5a98e554166b51b8caa62b38d82e91c7b9fcb7ab
2017-03-28 18:40:20 -07:00
65493ac638
bug 1351272 - enable green windows 7 tests on taskcluster at tier 2; r=jmaher
...
MozReview-Commit-ID: EmJokcC2KE1
--HG--
extra : rebase_source : 30eda0e76292d687c5f60b788020fd5bcbc287ba
2017-03-28 10:31:09 +02:00
5cb56629e4
Bug 1338871 - Enable Talos tests for linux64-stylo builds r=Callek DONTBUILD
2017-03-27 13:25:55 -04:00
4b7908e0dd
Bug 1349667 - do not used files-changed to conditionally exclude tasks when run from a cron job. r=dustin
...
MozReview-Commit-ID: 9SOjTxPprMV
2017-03-24 14:02:08 -04:00
2ea6238e55
Merge inbound to central, a=merge
...
MozReview-Commit-ID: 6od53T3ozcm
2017-03-23 16:15:37 -07:00
fd887ab4d8
Bug 1338871 - Enable Talos tests for linux64-stylo builds r=jmaher DONTBUILD
2017-03-23 12:12:46 -04:00
93d11e3441
Backed out 7 changesets (bug 1333003) for windows asan failures a=backout
...
Backed out changeset 3d2b2eeda8d3 (bug 1333003)
Backed out changeset 400d409ba4ca (bug 1333003)
Backed out changeset 1ba027abdfc9 (bug 1333003)
Backed out changeset 70114135bd8c (bug 1333003)
Backed out changeset 5715b15e33c0 (bug 1333003)
Backed out changeset 375e952bd738 (bug 1333003)
Backed out changeset d5d4112599f2 (bug 1333003)
MozReview-Commit-ID: DZUHJTdjX7V
2017-03-23 11:01:44 -07:00
268724dbb0
Bug 1337360: remove unnecessary schema for attributes; r=Callek
...
MozReview-Commit-ID: H3TXMIUn7OT
--HG--
extra : rebase_source : e339b14ddb1ea4c074edc209527f5a3b7f4f0966
2017-03-22 18:00:03 +00:00
314731f034
Bug 1337360: move chainOfTrust into extra; r=Callek
...
MozReview-Commit-ID: 2bo60MFPoDG
--HG--
extra : rebase_source : 6fcdccf497e31a6e4155814f670af20436584548
2017-03-22 16:48:40 +00:00
f92b1e6c0b
Bug 1337360: check for schema elements that aren't dashed-identifiers, with whitelist; r=Callek
...
MozReview-Commit-ID: FirYCrjFXAS
--HG--
extra : rebase_source : e28844e9c5854b0b587fcea7b0533473376c5bf2
2017-03-22 16:24:38 +00:00
3cf5b9cc25
Bug 1333003 part 2 - Enable ASan builds and tests on Windows x64. r=dustin
...
MozReview-Commit-ID: GEYKhhuTNRD
--HG--
extra : rebase_source : d1cbd0f56795a87fecc527ebec1602682084ade6
2017-03-10 12:03:05 +08:00
6bc068f987
Bug 1349704 - set instance-size and e10s for linux64-ccov in test transform. r=jmaher
...
MozReview-Commit-ID: IvpDzLGApGj
--HG--
extra : rebase_source : f7dd5b0e4d1a4e3ed2bd6406ba41544c52e593da
2017-03-22 20:35:38 -07:00
e4b7948224
Backed out changeset 911cc14899c8 (bug 1333003)
2017-03-23 10:38:24 +01:00
68de69034f
Bug 1333003 part 2 - Enable ASan builds and tests on Windows x64. r=dustin
...
MozReview-Commit-ID: GEYKhhuTNRD
--HG--
extra : rebase_source : d1cbd0f56795a87fecc527ebec1602682084ade6
2017-03-10 12:03:05 +08:00
3a60baaf99
Bug 1346016 - Add a build to test --enable-fuzzing, r=dustin
...
MozReview-Commit-ID: Ko4SsdafxAN
--HG--
extra : rebase_source : 4648385bb95109a4cd964bb5b751ffeaa8cf614d
2017-03-01 14:43:19 -08:00
c9f5cc6b45
merge mozilla-inbound to mozilla-central. r=merge a=merge
...
MozReview-Commit-ID: 8nsStTZt40O
2017-03-18 16:24:53 +01:00
0b4c340936
Bug 1348286 - add awsy.tests within en-US mobile artifacts too. r=jlund a=release DONTBUILD
...
MozReview-Commit-ID: DB9Mf0HkohJ
--HG--
extra : rebase_source : 363dcf0b1f06a2455337a6fa66c7009df7040f22
extra : histedit_source : 1034bc0e5d0c81f79f9084000bdc6fc605c2a654
2017-03-17 21:27:03 +00:00
8989c781c9
Bug 1347698 - Add a tag for taskcluster reftest jobs r=dustin
...
MozReview-Commit-ID: JvBywJUgmkh
--HG--
extra : rebase_source : cce78a737e8a4f6e50d82bab424b3e6c8a108cab
2017-03-15 17:52:11 -04:00
54a5d59c87
Bug 1347889 - use 'relative-datestamp' instead of typo 'relative-timestamp' in morphs, to unbreak task submission. r=dustin
...
MozReview-Commit-ID: 8GCKi6r4WUD
--HG--
extra : rebase_source : 511a7d54d23133b255d364b87207244d4cff7775
2017-03-16 09:44:36 -04:00
a79ca50603
Bug 1272113: Creating awsy task and mozharness script r=jmaher
...
* * *
[mq]: test_only
MozReview-Commit-ID: AawtpSUIj0P
--HG--
extra : rebase_source : 147a97e07f00e352f30aa9d5d39aa34500ed2abb
2017-03-11 02:33:19 +08:00
8d0339f0a5
Bug 1272113: Packaging awsy in build job r=jmaher
...
MozReview-Commit-ID: 9VhsVIaaWqt
--HG--
extra : rebase_source : ce4768033b0f3a912be9790b5ebe06fa6a2a0803
2017-03-11 02:33:19 +08:00
b470c0ac31
Bug 1347569: don't add optmized tasks to task.dependencies; r=Callek
...
`task.dependencies` is part of the internal taskgraph calculations, so it must
only refer to tasks that are being created, and not to those which already
exist. `task.task['dependencies']`, on the other hand, is what is given to
`queue.createTask` and expresses all dependencies.
MozReview-Commit-ID: GJ6JVj6JMBz
--HG--
extra : rebase_source : 553aec85134fe0e41c53f917327b13d1b66592aa
2017-03-15 14:54:12 +00:00
0902d5e08e
Merge m-c to inbound, a=merge
...
MozReview-Commit-ID: AzYu7EXTIlg
2017-03-14 17:23:26 -07:00
8fa8e0511b
bug 1344321 - fix flake8. r=bustage a=release DONTBUILD
2017-03-14 16:39:03 -07:00
c43d8b4ff5
bug 1344321 - disable windows, mac, {win32,win64,linux}-pgo builds+tests on beta. r=dustin a=release
...
MozReview-Commit-ID: 3906jiTDdEv
--HG--
extra : rebase_source : b4f3164bf6a067eda385e7f150480a43ac532596
2017-03-14 07:19:47 -07:00
800e6bdd73
bug 1344321 - enable run-on-projects for nightlies. r=dustin a=release
...
This patch enables `run-on-projects` to work appropriately for
nightly builds and tests. Initially, we were setting an empty
`run-on-projects` for nightly `build_platform`s, then explicitly
targeting the platforms in nightly-specific `target_task_method`s.
Instead, this patch enables nightlies to `run-on-projects` everywhere,
but governs the use of nightlies by either the `include_nightly`
parameter, or the `--include-nightly` try option. This lets us filter
nightly-related `target_task_method`s against `run-on-projects` without
losing all nightly tasks.
Then, enable spidermonkey tests by removing optimization from beta and
release. This patch also enables everything then disables specific
tasks, rather than disabling everything and enabling specific tasks.
Since we're beginning with a `filter_for_project` call, we should be
able to reduce these if blocks to zero over time, if desired.
MozReview-Commit-ID: A9tolynaChF
--HG--
extra : rebase_source : 3465ee2c714de3e0359f14109096fc94de27aadf
2017-03-14 15:31:58 -07:00
c0b812c495
Bug 1338871 - Enable Talos tests for linux64-stylo builds r=bustage DONTBUILD
2017-03-13 17:48:28 -04:00
58975540b4
Bug 1338871 - Enable Talos tests for linux64-stylo builds r=dustin
2017-03-13 17:28:54 -04:00
335fa26ed0
Bug 1333255: introduce graph morphs, use them to make index tasks; r=jonasfj
...
Graph morphs modify the graph after optimization, without changing its meaning.
In this case, that means adding index tasks that will insert paths into the
index beyond the relatively limited number afforded in task.routes.
MozReview-Commit-ID: AJy4exX7q2v
--HG--
extra : rebase_source : d61e7462defd41e7112739fb057edb493f495430
extra : source : c580568ed47c1ed2af40d98b47fbb0d136e63060
2017-03-07 20:39:27 +00:00
378a0e0712
Bug 1333255: always include docker-image tasks in the target task graph; r=jonasfj
...
MozReview-Commit-ID: GX18D68TAWG
--HG--
extra : rebase_source : 1883fa5198f21354dbb9904a0ed28ad062f1f413
2017-03-10 17:08:34 +00:00
449d528cf3
Bug 1333255: rename taskgraph.task to taskgraph.loader; r=jonasfj
...
MozReview-Commit-ID: 6aPdGbxn0D1
--HG--
rename : taskcluster/taskgraph/task/__init__.py => taskcluster/taskgraph/loader/__init__.py
rename : taskcluster/taskgraph/task/balrog.py => taskcluster/taskgraph/loader/balrog.py
rename : taskcluster/taskgraph/task/beetmover.py => taskcluster/taskgraph/loader/beetmover.py
rename : taskcluster/taskgraph/task/beetmover_checksums.py => taskcluster/taskgraph/loader/beetmover_checksums.py
rename : taskcluster/taskgraph/task/checksums_signing.py => taskcluster/taskgraph/loader/checksums_signing.py
rename : taskcluster/taskgraph/task/post_build.py => taskcluster/taskgraph/loader/post_build.py
rename : taskcluster/taskgraph/task/repacks.py => taskcluster/taskgraph/loader/repacks.py
rename : taskcluster/taskgraph/task/signing.py => taskcluster/taskgraph/loader/signing.py
rename : taskcluster/taskgraph/task/test.py => taskcluster/taskgraph/loader/test.py
rename : taskcluster/taskgraph/task/transform.py => taskcluster/taskgraph/loader/transform.py
rename : taskcluster/taskgraph/task/base.py => taskcluster/taskgraph/task.py
extra : rebase_source : 42a183bae9aedfa04876d99a59119fd08bbf7d73
2017-03-09 19:00:49 -05:00
7e3408a70e
Bug 1333255: always transform tasks; r=jonasfj
...
MozReview-Commit-ID: 3A5wzXKG0Yp
--HG--
extra : rebase_source : 10063aa354d18b08db182b41e9ae61f2f884becd
2017-03-09 16:40:33 -05:00
d46264d259
Bug 1333255: and then there was only one Task class; r=jonasfj
...
Note that the to_json method prefers the taskgraph's dependencies information
(edges) to that from the task.dependencies entries. At a few points in
task-graph generation, these values differ, although that is expected (for
example, the full task set contains no edges, but that information is still in
task.dependencies). Unifying that representation leads to some difficulty with
task transforms that reach into the dependency tree (beetmover), so the
different representations are left as-is.
MozReview-Commit-ID: GeW8HNwFA9Z
--HG--
extra : rebase_source : 549773e05e18371a399612d9bceccffc29be8cf2
2017-03-09 23:14:30 -05:00
13461db882
Bug 1333255: handle when.files-changed at the job level; r=jonasfj
...
MozReview-Commit-ID: AbJcXu22dNP
--HG--
extra : rebase_source : 83e12588431d82260eccc6356207dabd4c85bae6
2017-03-09 15:16:25 -05:00
8bf935c9ee
Bug 1333255: only apply seta optimizations for tests; r=jonasfj
...
MozReview-Commit-ID: FoIlgwBe4Gd
--HG--
extra : rebase_source : 93a206dc9df029c23514f11d75e349d897dd44bf
2017-03-09 14:45:12 -05:00
5c257e8656
Bug 1333255: replace uses of index_paths with optimizations; r=jonasfj
...
MozReview-Commit-ID: 1w8HVv94xoD
--HG--
extra : rebase_source : 9a2c0191595d7b759b45b8d49d2814ae983235b0
2017-03-10 20:20:50 +00:00
bf33dfcabd
Bug 1333255: implement optimizations as named functions; r=jonasfj
...
MozReview-Commit-ID: 9xkHny7IYfA
--HG--
extra : rebase_source : 201cf73414aee4bab407c67cb95e08fd2b794ba5
2017-03-10 18:17:43 +00:00
4950be4e4f
Bug 1333255: remove t.get_dependencies(); r=jonasfj
...
MozReview-Commit-ID: 1UF9yKXeRt7
--HG--
extra : rebase_source : f2fd8d2bafb36f88f490ff31e50550e7b1f423ef
2017-03-08 21:22:31 +00:00
a39d3b7ea3
Bug 1333255: use transforms to make docker image tasks, too; r=jonasfj
...
MozReview-Commit-ID: Eke3TjLbEfE
--HG--
extra : rebase_source : b91aa6733c26aed2f8f40de73dfef6ae863d1899
2017-03-08 20:52:13 +00:00
Carsten "Tomcat" Book
Johan Lorenzo
Mihai Tabara
Kim Moir
Paul Bignier
Wes Kocher
Dustin J. Mitchell
Gregory Szorc
Rob Thijssen
Joel Maher
Ting-Yu Chou
Madeleine Chercover
Steve Fink
Sebastian Hengst
William Lachance
Justin Wood
Paul Yang
Aki Sasaki