Граф коммитов

1069 Коммитов

Автор SHA1 Сообщение Дата
Maja Frydrychowicz dcf67352b6 Bug 1347483 - blessings package should not be downloaded during mach virtualenv setup; r=mshal
This fixes a regression introduced in Bug 1335873, which changes the mozbase
packages.txt to call mozlog's setup.py. Calling setup.py registers the
pytest_mozlog plugin for marionette-harness tests.

Instead, we can register the pytest-mozlog plugin via command-line arguments
to pytest, which are set in pytest.ini for the marionette-harness tests.
As a result, we can revert the mozbase packages.txt to not refer to mozlog's
setup.py

I'm leaving the pytest entry-point in mozlog's setup.py so that external
consumers don't have to register the pytest_mozlog plugin manually.

MozReview-Commit-ID: I5wNq5H1x3X

--HG--
extra : rebase_source : 614a47995bc1655f36053d2a05b08f94bfdbe476
2017-03-22 14:26:18 -04:00
Carsten "Tomcat" Book 62f6c37109 merge mozilla-inbound to mozilla-central a=merge 2017-03-22 14:26:27 +01:00
Carsten "Tomcat" Book 4db6c8f1f4 merge autoland to mozilla-central a=merge 2017-03-22 14:24:35 +01:00
Dustin J. Mitchell 011018200a Bug 1349208: temporary fix to get flashplayer out of the 16.04 image while we find a better fix; r=jmaher, a=testers-only
MozReview-Commit-ID: IR2PVFXHlEa
2017-03-21 18:19:26 +00:00
Sebastian Hengst c9f5cc6b45 merge mozilla-inbound to mozilla-central. r=merge a=merge
MozReview-Commit-ID: 8nsStTZt40O
2017-03-18 16:24:53 +01:00
Mihai Tabara 0b4c340936 Bug 1348286 - add awsy.tests within en-US mobile artifacts too. r=jlund a=release DONTBUILD
MozReview-Commit-ID: DB9Mf0HkohJ

--HG--
extra : rebase_source : 363dcf0b1f06a2455337a6fa66c7009df7040f22
extra : histedit_source : 1034bc0e5d0c81f79f9084000bdc6fc605c2a654
2017-03-17 21:27:03 +00:00
William Lachance 891cd0c050 Bug 1347698 - Generalize tc mochitest retriggers to support reftest r=jmaher
Let's do this by modifying the mochitest retrigger action into a more
generic "test retrigger" action that supports both.

MozReview-Commit-ID: H3AbsJ58ASV

--HG--
extra : rebase_source : 048025a8665c6be54afa214355900a663fc84615
2017-03-15 18:01:17 -04:00
William Lachance 8989c781c9 Bug 1347698 - Add a tag for taskcluster reftest jobs r=dustin
MozReview-Commit-ID: JvBywJUgmkh

--HG--
extra : rebase_source : cce78a737e8a4f6e50d82bab424b3e6c8a108cab
2017-03-15 17:52:11 -04:00
Steve Fink 3a60baaf99 Bug 1346016 - Add a build to test --enable-fuzzing, r=dustin
MozReview-Commit-ID: Ko4SsdafxAN

--HG--
extra : rebase_source : 4648385bb95109a4cd964bb5b751ffeaa8cf614d
2017-03-01 14:43:19 -08:00
Bryce Van Dyk 0dbe2590b3 Bug 1348688 - Sunset the external media tests on Linux TaskCluster. r=dustin
As part of the media teams ongoing sunsetting of the external media tests, we
are disabling tests once they become problematic. This disables the Linux
TaskCluster tests, which have been over represented in failures recently.

MozReview-Commit-ID: BOJ7TyL5LYC

--HG--
extra : rebase_source : 4c00ad9f91e92d88c3f5c5c6c8e8565c3aae42b9
2017-03-20 08:48:19 +13:00
Justin Wood 54a5d59c87 Bug 1347889 - use 'relative-datestamp' instead of typo 'relative-timestamp' in morphs, to unbreak task submission. r=dustin
MozReview-Commit-ID: 8GCKi6r4WUD

--HG--
extra : rebase_source : 511a7d54d23133b255d364b87207244d4cff7775
2017-03-16 09:44:36 -04:00
William Lachance 1f7ddfa4f4 Bug 1347177 - When doing custom retrigger, job should fail when custom mach command fails r=dustin
MozReview-Commit-ID: A9A0yNkFFma

--HG--
extra : rebase_source : b3f1de0122d83631fda8d66fc176f07d7dcc3586
2017-03-14 11:23:06 -04:00
Paul Yang a79ca50603 Bug 1272113: Creating awsy task and mozharness script r=jmaher
* * *
[mq]: test_only

MozReview-Commit-ID: AawtpSUIj0P

--HG--
extra : rebase_source : 147a97e07f00e352f30aa9d5d39aa34500ed2abb
2017-03-11 02:33:19 +08:00
Paul Yang 8d0339f0a5 Bug 1272113: Packaging awsy in build job r=jmaher
MozReview-Commit-ID: 9VhsVIaaWqt

--HG--
extra : rebase_source : ce4768033b0f3a912be9790b5ebe06fa6a2a0803
2017-03-11 02:33:19 +08:00
Ralph Giles a6e5969607 Bug 1346897 - Indent tooltool manifests. r=mshal
Apply a 2-character indent to in-tree tooltool manifests to make
them easier to read, and to make the formatting more consistent
so automating updates is simpler.

Modern editors will maintain json indentation. The only long
lines we have are already over 80 characters, so the extra space
shouldn't create new long lines.

Also update mercurial installer script to generate json with
the same indentation, even though its output is temporary.

Tooltool itself was updated to generate manifests with this
indentation in Bug 1325225.

MozReview-Commit-ID: DKj6nL9OENv

--HG--
extra : rebase_source : fc3f8616ec689d74e06c0db84c2b261825f86453
2017-03-15 12:27:51 -07:00
Dustin J. Mitchell b470c0ac31 Bug 1347569: don't add optmized tasks to task.dependencies; r=Callek
`task.dependencies` is part of the internal taskgraph calculations, so it must
only refer to tasks that are being created, and not to those which already
exist.  `task.task['dependencies']`, on the other hand, is what is given to
`queue.createTask` and expresses all dependencies.

MozReview-Commit-ID: GJ6JVj6JMBz

--HG--
extra : rebase_source : 553aec85134fe0e41c53f917327b13d1b66592aa
2017-03-15 14:54:12 +00:00
Carsten "Tomcat" Book 7decdeb7c8 Merge mozilla-central to autoland 2017-03-15 13:19:12 +01:00
Carsten "Tomcat" Book f807b332df merge mozilla-inbound to mozilla-central a=merge 2017-03-15 13:12:42 +01:00
Wes Kocher 0902d5e08e Merge m-c to inbound, a=merge
MozReview-Commit-ID: AzYu7EXTIlg
2017-03-14 17:23:26 -07:00
Aki Sasaki 8fa8e0511b bug 1344321 - fix flake8. r=bustage a=release DONTBUILD 2017-03-14 16:39:03 -07:00
Aki Sasaki c43d8b4ff5 bug 1344321 - disable windows, mac, {win32,win64,linux}-pgo builds+tests on beta. r=dustin a=release
MozReview-Commit-ID: 3906jiTDdEv

--HG--
extra : rebase_source : b4f3164bf6a067eda385e7f150480a43ac532596
2017-03-14 07:19:47 -07:00
Aki Sasaki 800e6bdd73 bug 1344321 - enable run-on-projects for nightlies. r=dustin a=release
This patch enables `run-on-projects` to work appropriately for
nightly builds and tests.  Initially, we were setting an empty
`run-on-projects` for nightly `build_platform`s, then explicitly
targeting the platforms in nightly-specific `target_task_method`s.

Instead, this patch enables nightlies to `run-on-projects` everywhere,
but governs the use of nightlies by either the `include_nightly`
parameter, or the `--include-nightly` try option.  This lets us filter
nightly-related `target_task_method`s against `run-on-projects` without
losing all nightly tasks.

Then, enable spidermonkey tests by removing optimization from beta and
release.  This patch also enables everything then disables specific
tasks, rather than disabling everything and enabling specific tasks.
Since we're beginning with a `filter_for_project` call, we should be
able to reduce these if blocks to zero over time, if desired.

MozReview-Commit-ID: A9tolynaChF

--HG--
extra : rebase_source : 3465ee2c714de3e0359f14109096fc94de27aadf
2017-03-14 15:31:58 -07:00
Carsten "Tomcat" Book dba578960e merge mozilla-inbound to mozilla-central a=merge 2017-03-14 14:23:03 +01:00
Kim Moir c0b812c495 Bug 1338871 - Enable Talos tests for linux64-stylo builds r=bustage DONTBUILD 2017-03-13 17:48:28 -04:00
Kim Moir 58975540b4 Bug 1338871 - Enable Talos tests for linux64-stylo builds r=dustin 2017-03-13 17:28:54 -04:00
Bryce Van Dyk 7c7693d21d Bug 1347269 - Increase taskcluster instance size for linux twitch tests. r=dustin
This attempts to address intermittent twitch test failures on Linux by having
the tests run on beefier hardware. Bug 1344961 shows a number of failures
where tests timeout before page loading is complete, the hope here is that
more powerful hardware speed up these load times.

MozReview-Commit-ID: 2yBQvKS8Xlh

--HG--
extra : rebase_source : 2b803204e90a736b4634279ca8199cb8910551ba
2017-03-15 08:52:32 +13:00
Madeleine Chercover 99f76d739a Bug 1347241 - Enable linux64-ccov coverage collection for common tests set; r=gmierz,jmaher
MozReview-Commit-ID: FLyjCwMGb6L

--HG--
extra : rebase_source : 4c2c56c5ace6fd1f6b933a92ad0f69189ab1df69
2017-03-14 11:40:59 -07:00
Dustin J. Mitchell 335fa26ed0 Bug 1333255: introduce graph morphs, use them to make index tasks; r=jonasfj
Graph morphs modify the graph after optimization, without changing its meaning.
In this case, that means adding index tasks that will insert paths into the
index beyond the relatively limited number afforded in task.routes.

MozReview-Commit-ID: AJy4exX7q2v

--HG--
extra : rebase_source : d61e7462defd41e7112739fb057edb493f495430
extra : source : c580568ed47c1ed2af40d98b47fbb0d136e63060
2017-03-07 20:39:27 +00:00
Jonas Finnemann Jensen 654a2a08db Bug 1333255: Task for indexing other tasks. r=jonasfj
This introduces a new docker image: `index-task`,
which given a taskId and a set of namespaces will
index the given taskId under said namespaces.

Modified to include a script with a descriptive name that curious users can
find in the source code.

MozReview-Commit-ID: KPHVT0XPfsb

--HG--
extra : rebase_source : ed3abde6082f98b83bc5b13f65172562b8875263
extra : source : f8ca244c170f587ead852bb9fbdc99c9dec52f31
2017-03-14 15:25:57 +00:00
Dustin J. Mitchell 378a0e0712 Bug 1333255: always include docker-image tasks in the target task graph; r=jonasfj
MozReview-Commit-ID: GX18D68TAWG

--HG--
extra : rebase_source : 1883fa5198f21354dbb9904a0ed28ad062f1f413
2017-03-10 17:08:34 +00:00
Dustin J. Mitchell 449d528cf3 Bug 1333255: rename taskgraph.task to taskgraph.loader; r=jonasfj
MozReview-Commit-ID: 6aPdGbxn0D1

--HG--
rename : taskcluster/taskgraph/task/__init__.py => taskcluster/taskgraph/loader/__init__.py
rename : taskcluster/taskgraph/task/balrog.py => taskcluster/taskgraph/loader/balrog.py
rename : taskcluster/taskgraph/task/beetmover.py => taskcluster/taskgraph/loader/beetmover.py
rename : taskcluster/taskgraph/task/beetmover_checksums.py => taskcluster/taskgraph/loader/beetmover_checksums.py
rename : taskcluster/taskgraph/task/checksums_signing.py => taskcluster/taskgraph/loader/checksums_signing.py
rename : taskcluster/taskgraph/task/post_build.py => taskcluster/taskgraph/loader/post_build.py
rename : taskcluster/taskgraph/task/repacks.py => taskcluster/taskgraph/loader/repacks.py
rename : taskcluster/taskgraph/task/signing.py => taskcluster/taskgraph/loader/signing.py
rename : taskcluster/taskgraph/task/test.py => taskcluster/taskgraph/loader/test.py
rename : taskcluster/taskgraph/task/transform.py => taskcluster/taskgraph/loader/transform.py
rename : taskcluster/taskgraph/task/base.py => taskcluster/taskgraph/task.py
extra : rebase_source : 42a183bae9aedfa04876d99a59119fd08bbf7d73
2017-03-09 19:00:49 -05:00
Dustin J. Mitchell 7e3408a70e Bug 1333255: always transform tasks; r=jonasfj
MozReview-Commit-ID: 3A5wzXKG0Yp

--HG--
extra : rebase_source : 10063aa354d18b08db182b41e9ae61f2f884becd
2017-03-09 16:40:33 -05:00
Dustin J. Mitchell d46264d259 Bug 1333255: and then there was only one Task class; r=jonasfj
Note that the to_json method prefers the taskgraph's dependencies information
(edges) to that from the task.dependencies entries. At a few points in
task-graph generation, these values differ, although that is expected (for
example, the full task set contains no edges, but that information is still in
task.dependencies). Unifying that representation leads to some difficulty with
task transforms that reach into the dependency tree (beetmover), so the
different representations are left as-is.

MozReview-Commit-ID: GeW8HNwFA9Z

--HG--
extra : rebase_source : 549773e05e18371a399612d9bceccffc29be8cf2
2017-03-09 23:14:30 -05:00
Dustin J. Mitchell 13461db882 Bug 1333255: handle when.files-changed at the job level; r=jonasfj
MozReview-Commit-ID: AbJcXu22dNP

--HG--
extra : rebase_source : 83e12588431d82260eccc6356207dabd4c85bae6
2017-03-09 15:16:25 -05:00
Dustin J. Mitchell 8bf935c9ee Bug 1333255: only apply seta optimizations for tests; r=jonasfj
MozReview-Commit-ID: FoIlgwBe4Gd

--HG--
extra : rebase_source : 93a206dc9df029c23514f11d75e349d897dd44bf
2017-03-09 14:45:12 -05:00
Dustin J. Mitchell 5c257e8656 Bug 1333255: replace uses of index_paths with optimizations; r=jonasfj
MozReview-Commit-ID: 1w8HVv94xoD

--HG--
extra : rebase_source : 9a2c0191595d7b759b45b8d49d2814ae983235b0
2017-03-10 20:20:50 +00:00
Dustin J. Mitchell bf33dfcabd Bug 1333255: implement optimizations as named functions; r=jonasfj
MozReview-Commit-ID: 9xkHny7IYfA

--HG--
extra : rebase_source : 201cf73414aee4bab407c67cb95e08fd2b794ba5
2017-03-10 18:17:43 +00:00
Dustin J. Mitchell 4950be4e4f Bug 1333255: remove t.get_dependencies(); r=jonasfj
MozReview-Commit-ID: 1UF9yKXeRt7

--HG--
extra : rebase_source : f2fd8d2bafb36f88f490ff31e50550e7b1f423ef
2017-03-08 21:22:31 +00:00
Dustin J. Mitchell a39d3b7ea3 Bug 1333255: use transforms to make docker image tasks, too; r=jonasfj
MozReview-Commit-ID: Eke3TjLbEfE

--HG--
extra : rebase_source : b91aa6733c26aed2f8f40de73dfef6ae863d1899
2017-03-08 20:52:13 +00:00
Dustin J. Mitchell b0117f4f53 Bug 1333255: use normal old functions to load tasks; r=jonasfj
Instead of using a class's static method, use a simple function, specified by
the `loader` key.

MozReview-Commit-ID: IeOl9qiSCXf

--HG--
extra : rebase_source : 72e0a9dd8385b250a46c9f4adf8a8a0e5b01c156
2017-03-09 23:14:40 -05:00
William Lachance c6017076fc Bug 1346383 - Reset artifact expiry times when executing mochitest retrigger r=jonasfj
MozReview-Commit-ID: 4p8GKWLCrf1

--HG--
extra : rebase_source : 7edf6108df090aef3b08b6b6b190c4209e5be35c
2017-03-10 15:48:35 -05:00
William Lachance 14d7f2ffdb Bug 1346333 - Ensure all TC mochitests get correct 'test-type' tag r=dustin
The previous attempt at this didn't handle jobs that were keyed by platform,
which was most of them.

MozReview-Commit-ID: IC602td532T

--HG--
extra : rebase_source : 95cdf9ad37df8ef6665665f11e59f8ae8304dbd2
2017-03-10 13:55:55 -05:00
Xidorn Quan b3e8f1b558 Bug 1346047 - Enable chrome style system mochitests and run style system mochitests on e10s. r=jmaher
MozReview-Commit-ID: 9Vj3mZL3IhJ

--HG--
extra : rebase_source : aaf926fa895c4d42da5b89ea7650a99f6967fec2
2017-03-10 12:38:38 +11:00
Aki Sasaki 09a3273546 bug 1344321 - remove linux64-pgo from target_tasks_mozilla_beta. r=dustin a=release
MozReview-Commit-ID: AVai8RLFTVo

--HG--
extra : rebase_source : 7ff580ef887b7f1bd4a8a055fc9bc9ec75f77b1a
2017-03-08 22:23:57 -08:00
Aki Sasaki 7d51677840 bug 1344321 - add nightly test support. r=dustin a=release
this patch:

- adds linux{32,64}-nightly/opt test platforms that mirror the non-nightly test platforms.

- adds an `include_nightly` per-project parameter; this is refered to in the default `target_task_method`.  It's still possible to launch custom `target_task_method`s to trigger nightlies against, say, try.

- adds a `filter_for_project` method in `target_tasks.py` that allows for `include_nightly` and `run_on_projects` filtering in the various `target_task_method`s.

- adds nightly filtering into the `TryOptionSyntax` object.  By default, this will be off.  To trigger nightly tests on try, either submit a new decision task with a different `target_task_method` (e.g. `nightly_fennec`) or flip the `include_nightly` flag to True.

- adds the `nightly` attribute to tests if their builds have that attribute.

MozReview-Commit-ID: DttIZH0BHS2

--HG--
extra : rebase_source : d8acbe4c741f570b2e8d33a8e6a7f5c791b24ff6
2017-03-09 16:32:41 -08:00
William Lachance e5660aefa8 Bug 1345980 - Mark up all taskcluster mochitest jobs with tag 'test-type: mochitest' r=dustin
Necessary for treeherder action retriggering code to recognize them as supporting
this action.

MozReview-Commit-ID: BY6OCUFsYlK

--HG--
extra : rebase_source : 6cc4bc8b1cfde29f793fd910bf99f8d3e36603da
2017-03-09 14:41:14 -05:00
William Lachance 02aec90e78 Bug 1343327 - Add taskcluster mochitest retrigger action r=ahal,jonasfj
MozReview-Commit-ID: A1SOeVo6eu4

--HG--
extra : rebase_source : 596ac7ee190ae56d20527e04168b0a190d3588b0
2017-02-22 22:11:46 -05:00
William Lachance 7a49c8f30a Bug 1343327 - Export more test job state as environment vars in taskcluster r=dustin
MozReview-Commit-ID: GBmL4lhAa8u

--HG--
extra : rebase_source : 2ec4a7e709280420c2e08e58864b1a3c2f5514e7
2017-03-01 13:07:04 -05:00
Dustin J. Mitchell b884691b8f Bug 1337903: add support for OS X in run-task; r=ahal
* add run.using = 'run-task' for native-engine
* modify run-task to run on OS X
  - not as root
  - without assuming /home/worker (using ~ and os.expanduser instead)
  - hg is in /usr/local/bin on OS X; trust the PATH
* add_build_dependency isn't docker-worker specific, so just rename
* support_vcs_checkout modified to omit caches on native-engine
* don't download fingerprints on OS X; these hosts are configured with
  the proper fingerprint via puppet

MozReview-Commit-ID: C83XClXtcn4

--HG--
extra : rebase_source : 2ef1e8dced12ccc4acb7706d7f4587df19a379fc
2017-03-03 22:49:23 +00:00
Dustin J. Mitchell b87d4c3e3b Bug 1337903: add and use a job_try_name attribute; r=ahal
This fixes the ability to run mozbase via `-j mozbase`, with the
added advantage that it will obey `-p` too.

MozReview-Commit-ID: 1zkitUephXk

--HG--
extra : rebase_source : 0ebb65363d5f5813bc7ccb379768df54310d39c1
2017-03-08 17:28:34 +00:00