Граф коммитов

131 Коммитов

Автор SHA1 Сообщение Дата
Gregory Szorc 7398a36b0a Bug 1372721 - Add a "trunk" alias for run-on-projects; r=dustin
{central, autoland, inbound} are logically treated as a single unit for
many tasks and policies. Let's formalize that collection via a "trunk"
alias.

MozReview-Commit-ID: H4JPTyu2J2F

--HG--
extra : rebase_source : f4cabfc48e24b9f55b833bd95bdbf81b036cee6d
2017-06-13 14:42:04 -07:00
Dustin J. Mitchell 8e0e299dc8 Bug 1359942: rename optimization to skip-unless-changed; r=glandium
MozReview-Commit-ID: 4d4zoDDJYnz

--HG--
extra : rebase_source : c458cdbe898755f33eb207f2af2c5f4efb7a4702
2017-05-23 10:22:53 -04:00
Dustin J. Mitchell 76cf6b7b0f Bug 1351011: remove unused triggered_by property; r=Callek
The purpose of this parameter has been superseded by the `include_nightly`
property.

MozReview-Commit-ID: 4iXQsv9Drqg

--HG--
extra : rebase_source : c94142282909a88c29fe6809d87721bef1f198c2
2017-03-27 20:10:08 +00:00
Dustin J. Mitchell 3c508e3d49 Bug 1340564: use an attribute to identify signed tasks; r=Callek
This is a more robust approach than using substring matching on task labels.

As an optimization, this simply avoids creating balrog tasks for unsigned beets
using only-for-attributes, rather than omitting them in a transform.

MozReview-Commit-ID: 8MNOxu0WgXo

--HG--
extra : source : 1aeb99ce3e6c2576b7b9b71c1cdf97a1d1889a49
2017-02-05 14:08:10 -05:00
Carsten "Tomcat" Book e2e90c1b4e Backed out changeset 1aeb99ce3e6c (bug 1340564) for hoping that fix the packageName issue
--HG--
extra : rebase_source : e3bb10d7ab090692114ccf3b20c5e6263fe14957
2017-05-12 15:59:56 +02:00
Dustin J. Mitchell a52ef5b1e8 Bug 1340564: use an attribute to identify signed tasks; r=Callek
This is a more robust approach than using substring matching on task labels.

As an optimization, this simply avoids creating balrog tasks for unsigned beets
using only-for-attributes, rather than omitting them in a transform.

MozReview-Commit-ID: 8MNOxu0WgXo

--HG--
extra : rebase_source : 9e93a996241bcb0d345c18813919a41320e95651
2017-02-05 14:08:10 -05:00
Dustin J. Mitchell 34f10e53bc Bug 1359997: update docs to point users to the parameters artifact; r=bdahl
MozReview-Commit-ID: KGt3MIniUe6

--HG--
extra : rebase_source : 5bcc577a5fb82be098d69eb3def3c9704ddfa3fb
2017-04-26 21:16:16 +00:00
Justin Wood e79bb0b9f0 Bug 1357867 - Add balrog and beetmover support to cross compiled OSX, allow dependencies on repackage jobs. r=dustin
MozReview-Commit-ID: Frc0sMaC1o0

--HG--
extra : rebase_source : 2fd438259806204e42565502a807f7064d6fff0a
2017-04-19 15:49:55 -04:00
Justin Wood 6592bde39e Bug 1357867 - Add repackage tasks suited for generating a .dmg from a signed tarball of OSX binaries. r=dustin
MozReview-Commit-ID: 7TdQxTlKm9D

--HG--
extra : rebase_source : f4e899a3701eff3fc0b655603772b421c924e846
2017-04-19 15:18:44 -04:00
Peter Moore f1992a1f4b Bug 1349980 - Highlight the '-J' flag of mach taskgraph command in taskcluster docs,r=dustin 2017-04-06 19:10:52 +02:00
Johan Lorenzo 656b85567c Bug 1317783 - Put PushApk tasks in-tree r=aki
MozReview-Commit-ID: 8uGIuj7OXwZ

--HG--
extra : rebase_source : 6c1e7364bb0a232ef4451a3c497db3415a42629e
2017-04-04 11:21:07 +02:00
Paul Bignier ff2e59d1cd Bug 1352802 - Typo fixes around 'accessible'. r=MattN
MozReview-Commit-ID: 27CyNOMXkRq

--HG--
extra : rebase_source : 30e8891fa40cb497ab695e72b179c850a3a5c8d9
2017-04-03 09:47:00 -07:00
Paul Bignier a3d05860ed Bug 1352839 - Fix various typos of the word "taskcluster" in the tree. r=garndt
--HG--
extra : rebase_source : fc030f8f5761083f86485c883ba1c2b5f1266773
2017-04-02 09:13:00 -04:00
Wes Kocher 30cd0565b2 Backed out changeset 0edd9de2ca10 (bug 1317783) for future nightly bustage a=backout 2017-03-31 11:09:13 -07:00
Carsten "Tomcat" Book 095969b8ee merge mozilla-inbound to mozilla-central a=merge 2017-03-31 14:45:33 +02:00
Iris Hsiao c598161942 Backed out changeset 0edd9de2ca10 (bug 1317783) for duplicate checkin to autoland 2017-03-31 14:02:07 +08:00
Johan Lorenzo cca64f884f Bug 1317783 - Put PushApk tasks in-tree r=aki
MozReview-Commit-ID: 8uGIuj7OXwZ

--HG--
extra : rebase_source : d9ff99b54a7cffb258cdfe390ab9f733cdffb4a3
2017-03-30 12:13:01 +02:00
Dustin J. Mitchell 8887c3cee9 Bug 1349662: remove leftover document link; DONTBUILD r=jonasfj
MozReview-Commit-ID: Ao06Fo85Kge

--HG--
extra : source : 791a39dc041296a49bc702598dfef84de63cf569
extra : amend_source : e340f471319cc850753691f7fe6f48ef2da5256a
2017-03-27 18:54:54 +00:00
Johan Lorenzo 24983ae451 Bug 1317783 - Put PushApk tasks in-tree r=aki
MozReview-Commit-ID: 8uGIuj7OXwZ
2017-03-30 12:13:01 +02:00
Dustin J. Mitchell 6d5f9c378e Bug 1349662: minor reorganizaiton of action documentation; r=jonasfj
MozReview-Commit-ID: 9XZaOG9rF60

--HG--
extra : rebase_source : 838b613f0e5e5cacfc89b95e1f0bd6e2a4a8e1c5
2017-03-22 19:40:10 +00:00
Justin Wood 54a5d59c87 Bug 1347889 - use 'relative-datestamp' instead of typo 'relative-timestamp' in morphs, to unbreak task submission. r=dustin
MozReview-Commit-ID: 8GCKi6r4WUD

--HG--
extra : rebase_source : 511a7d54d23133b255d364b87207244d4cff7775
2017-03-16 09:44:36 -04:00
Wes Kocher 0902d5e08e Merge m-c to inbound, a=merge
MozReview-Commit-ID: AzYu7EXTIlg
2017-03-14 17:23:26 -07:00
Aki Sasaki 800e6bdd73 bug 1344321 - enable run-on-projects for nightlies. r=dustin a=release
This patch enables `run-on-projects` to work appropriately for
nightly builds and tests.  Initially, we were setting an empty
`run-on-projects` for nightly `build_platform`s, then explicitly
targeting the platforms in nightly-specific `target_task_method`s.

Instead, this patch enables nightlies to `run-on-projects` everywhere,
but governs the use of nightlies by either the `include_nightly`
parameter, or the `--include-nightly` try option.  This lets us filter
nightly-related `target_task_method`s against `run-on-projects` without
losing all nightly tasks.

Then, enable spidermonkey tests by removing optimization from beta and
release.  This patch also enables everything then disables specific
tasks, rather than disabling everything and enabling specific tasks.
Since we're beginning with a `filter_for_project` call, we should be
able to reduce these if blocks to zero over time, if desired.

MozReview-Commit-ID: A9tolynaChF

--HG--
extra : rebase_source : 3465ee2c714de3e0359f14109096fc94de27aadf
2017-03-14 15:31:58 -07:00
Dustin J. Mitchell 335fa26ed0 Bug 1333255: introduce graph morphs, use them to make index tasks; r=jonasfj
Graph morphs modify the graph after optimization, without changing its meaning.
In this case, that means adding index tasks that will insert paths into the
index beyond the relatively limited number afforded in task.routes.

MozReview-Commit-ID: AJy4exX7q2v

--HG--
extra : rebase_source : d61e7462defd41e7112739fb057edb493f495430
extra : source : c580568ed47c1ed2af40d98b47fbb0d136e63060
2017-03-07 20:39:27 +00:00
Dustin J. Mitchell 7e3408a70e Bug 1333255: always transform tasks; r=jonasfj
MozReview-Commit-ID: 3A5wzXKG0Yp

--HG--
extra : rebase_source : 10063aa354d18b08db182b41e9ae61f2f884becd
2017-03-09 16:40:33 -05:00
Dustin J. Mitchell d46264d259 Bug 1333255: and then there was only one Task class; r=jonasfj
Note that the to_json method prefers the taskgraph's dependencies information
(edges) to that from the task.dependencies entries. At a few points in
task-graph generation, these values differ, although that is expected (for
example, the full task set contains no edges, but that information is still in
task.dependencies). Unifying that representation leads to some difficulty with
task transforms that reach into the dependency tree (beetmover), so the
different representations are left as-is.

MozReview-Commit-ID: GeW8HNwFA9Z

--HG--
extra : rebase_source : 549773e05e18371a399612d9bceccffc29be8cf2
2017-03-09 23:14:30 -05:00
Dustin J. Mitchell bf33dfcabd Bug 1333255: implement optimizations as named functions; r=jonasfj
MozReview-Commit-ID: 9xkHny7IYfA

--HG--
extra : rebase_source : 201cf73414aee4bab407c67cb95e08fd2b794ba5
2017-03-10 18:17:43 +00:00
Dustin J. Mitchell b0117f4f53 Bug 1333255: use normal old functions to load tasks; r=jonasfj
Instead of using a class's static method, use a simple function, specified by
the `loader` key.

MozReview-Commit-ID: IeOl9qiSCXf

--HG--
extra : rebase_source : 72e0a9dd8385b250a46c9f4adf8a8a0e5b01c156
2017-03-09 23:14:40 -05:00
Aki Sasaki 7d51677840 bug 1344321 - add nightly test support. r=dustin a=release
this patch:

- adds linux{32,64}-nightly/opt test platforms that mirror the non-nightly test platforms.

- adds an `include_nightly` per-project parameter; this is refered to in the default `target_task_method`.  It's still possible to launch custom `target_task_method`s to trigger nightlies against, say, try.

- adds a `filter_for_project` method in `target_tasks.py` that allows for `include_nightly` and `run_on_projects` filtering in the various `target_task_method`s.

- adds nightly filtering into the `TryOptionSyntax` object.  By default, this will be off.  To trigger nightly tests on try, either submit a new decision task with a different `target_task_method` (e.g. `nightly_fennec`) or flip the `include_nightly` flag to True.

- adds the `nightly` attribute to tests if their builds have that attribute.

MozReview-Commit-ID: DttIZH0BHS2

--HG--
extra : rebase_source : d8acbe4c741f570b2e8d33a8e6a7f5c791b24ff6
2017-03-09 16:32:41 -08:00
Dustin J. Mitchell b87d4c3e3b Bug 1337903: add and use a job_try_name attribute; r=ahal
This fixes the ability to run mozbase via `-j mozbase`, with the
added advantage that it will obey `-p` too.

MozReview-Commit-ID: 1zkitUephXk

--HG--
extra : rebase_source : 0ebb65363d5f5813bc7ccb379768df54310d39c1
2017-03-08 17:28:34 +00:00
Andrew Halberstadt 6b9bf4adbf Bug 1335873 - Convert marionette harness unittests to standard python unittests, r=maja_zf
This formats the marionette-harness python tests to be a regular |mach python-test| suite. Though
we add subsuite=marionette, this is just for automation purposes. The new preferred way to run the
marionette harness tests locally is:
./mach python-test testing/marionette

They will also run if running the full suite.

The mozbase packages.txt file modifies mozlog to use 'setup.py' instead of 'pth'. The reason for
this is that the marionette-harness tests use the pytest_mozlog pytest plugin for formatting
their results (converts pytest format into something resembling the standard tbpl logging format).
In order for this plugin to get picked up however, mozlog's setup.py file needs to be processed.

MozReview-Commit-ID: Ata99evHxbd

--HG--
extra : rebase_source : 22382e3d65ce8454a1682cfced0d03477762e8fe
2017-02-15 16:38:45 -05:00
Sebastian Hengst 964fc701a8 Backed out changeset 3c0a7527608a (bug 1335873) 2017-03-01 17:35:06 +01:00
Andrew Halberstadt 0fa9f19bdf Bug 1335873 - Convert marionette harness unittests to standard python unittests, r=maja_zf
This formats the marionette-harness python tests to be a regular |mach python-test| suite. Though
we add subsuite=marionette, this is just for automation purposes. The new preferred way to run the
marionette harness tests locally is:
./mach python-test testing/marionette

They will also run if running the full suite.

The mozbase packages.txt file modifies mozlog to use 'setup.py' instead of 'pth'. The reason for
this is that the marionette-harness tests use the pytest_mozlog pytest plugin for formatting
their results (converts pytest format into something resembling the standard tbpl logging format).
In order for this plugin to get picked up however, mozlog's setup.py file needs to be processed.

MozReview-Commit-ID: Ata99evHxbd

--HG--
extra : rebase_source : 16ed70edd38a53c3279d8632d7cba3df4d5216c3
2017-02-15 16:38:45 -05:00
Andrew Halberstadt 2d476494f7 Bug 1336559 - Rename source-check kind to source-test, r=dustin
The name 'source-check' is a bit of a misnomer, because it already includes a bunch
of tasks that are proper unittests, not lints. Some of these unittests will soon
depend on a build task, which makes 'source-check' feel even more wrong.

They still have a lot in common with the lint tasks though, so it's probably not
worth splitting this into two separate kinds. Instead, let's just rename this kind
to 'source-test', which means, any task that tests stuff and is run from the source
directory (instead of a tests.zip). I think both lints and python-tests fall squarely
under this definition.

MozReview-Commit-ID: K0gZ5rVLyeD

--HG--
rename : taskcluster/ci/source-check/doc.yml => taskcluster/ci/source-test/doc.yml
rename : taskcluster/ci/source-check/kind.yml => taskcluster/ci/source-test/kind.yml
rename : taskcluster/ci/source-check/mozlint.yml => taskcluster/ci/source-test/mozlint.yml
rename : taskcluster/ci/source-check/python-tests.yml => taskcluster/ci/source-test/python-tests.yml
rename : taskcluster/ci/source-check/webidl.yml => taskcluster/ci/source-test/webidl.yml
extra : rebase_source : a683b5b6e243849de57f2681993046c776d6a8f2
2017-02-02 16:16:06 -05:00
Johan Lorenzo d1082915e4 Bug 1337825 - Schedule l10n repacks for fennec with specified locale revisions using an intree changesets file r=aki
MozReview-Commit-ID: 1DEIjFYAx74

--HG--
extra : histedit_source : fe73d536f0ae6bf1d60279fec210e16b7ffb913f%2Ca439f62086a4b85a8d46edd0fcf0000bc376f2f0
2017-02-17 15:57:11 +01:00
Carsten "Tomcat" Book 5f96998164 Backed out changeset c7c9f7712163 (bug 1337825) for flake8 failure 2017-02-17 15:52:10 +01:00
Johan Lorenzo 903b044aae Bug 1337825 - Schedule l10n repacks for fennec with specified locale revisions using an intree changesets file r=aki
MozReview-Commit-ID: 1DEIjFYAx74
2017-02-14 15:04:54 +01:00
Hammad Akhtar 9477d8c0f5 Bug 1325701 - test transform should produce a job description, not a task description; r=dustin
MozReview-Commit-ID: CrSSWI0aBCZ

--HG--
extra : rebase_source : a7e6c4fcaa59c593ae05b2a28eccfa9cf2e88947
extra : source : 57a270511494875bd76a4c72065fa5320159090f
2017-01-18 16:55:53 +05:30
Jonas Finnemann Jensen 24c8b38973 Bug 1332506 - Treeherder actions defined in-tree. r=dustin
Framework for defining actions in-tree that can be displayed
and triggered from Treeherder.

MozReview-Commit-ID: 3rvwgy2i4xu

--HG--
extra : rebase_source : beca394f4337aae4ab149e4db810352f57ec4988
2017-01-31 15:34:05 -08:00
Jonas Finnemann Jensen f9108552c0 Bug 1332506 - Spec for in-tree treeherder actions. r=dustin
Add specification for actions.json to be used as contract
between in-tree logic and Treeherder. Such that Treeherder
can provide actions that callback into the in-tree logic.

MozReview-Commit-ID: JM1ebU8zNK5

--HG--
extra : rebase_source : 289c7c800f214ccde99adfbdf58bba614b957fe6
2017-01-31 15:33:14 -08:00
Mihai Tabara 0065603413 Bug 1305139 - schedule checksums related tasks in nightly graph. r=aki,Callek
MozReview-Commit-ID: 659wCXm3ob5

--HG--
extra : rebase_source : 356175ba6ffa8678f412d333376d3a86e7919988
2017-02-07 22:44:12 -05:00
Dustin J. Mitchell e8eacef251 Bug 1334167: use run-on-projects to parallel task graph generation; r=Callek
MozReview-Commit-ID: EQMuh4hN9Ya

--HG--
extra : rebase_source : 49eeeb005d5e74ee415add12a897b1767ee0bbd8
2017-01-31 19:49:18 +00:00
Wander Lairson Costa 56c96fa18d Bug 1333167: Add extra try options to taskcluster. r=dustin a=jmaher
We add the following command line options to Taskcluster try syntax:

--spsProfile - enable profile mode.
--rebuild-talos <N> - retrigger talos tests N times.
--setenv <VAR>=<val> - add extra environments variables.
--tag <TAG> - run tests only the tag TAG.
--no-retry - doesn't retry failed jobs.

We have a chicken-egg problem, as we first generate the full task graph
and then parse the try message. But the graph generation step needs to
know the try message to process the aforementioned options. The
solution is to parse the message before graph generation and then
pass the command line options to the transforms. Then, each transform
can look at the option that interests it and process it accordingly.

The message parse function is configured in kind.yml, which gives some
flexibility for future implementations of alternative syntaxes.

MozReview-Commit-ID: GPFdi0FD6Vn

--HG--
extra : rebase_source : b992786158851f1099aedfce8669a163228edc51
2017-02-02 09:34:43 -02:00
Sebastian Hengst c69d28f8f8 Backed out changeset d6648b8f36ed (bug 1333167) for breaking gecko decision task. r=backout on a CLOSED TREE 2017-01-31 21:47:45 +01:00
Wander Lairson Costa aa5f7afcb9 Bug 1333167: Add extra try options to taskcluster. r=dustin a=jmaher
We add the following command line options to Taskcluster try syntax:

--spsProfile - enable profile mode.
--rebuild-talos <N> - retrigger talos tests N times.
--setenv <VAR>=<val> - add extra environments variables.
--tag <TAG> - run tests only the tag TAG.
--no-retry - doesn't retry failed jobs.

We have a chicken-egg problem, as we first generate the full task graph
and then parse the try message. But the graph generation step needs to
know the try message to process the aforementioned options. The
solution is to parse the message before graph generation and then
pass the command line options to the transforms. Then, each transform
can look at the option that interests it and process it accordingly.

The message parse function is configured in kind.yml, which gives some
flexibility for future implementations of alternative syntaxes.

MozReview-Commit-ID: DMwRjuV2vpf

--HG--
extra : rebase_source : 211ecf52694078986caf290c5b0cca35c775da61
2017-01-31 18:16:07 -02:00
Sebastian Hengst aed3479d18 Backed out changeset 50cf83b69046 (bug 1333167) for breaking gecko decision task. r=backout 2017-01-31 18:25:50 +01:00
Wander Lairson Costa cd15766fd6 Bug 1333167: Add extra try options to taskcluster. r=dustin a=jmaher
We add the following command line options to Taskcluster try syntax:

--spsProfile: enable profile mode.
--rebuild-talos <N>: retrigger talos tests N times.
--setenv <VAR>=<val>: add extra environments variables.
--tag <TAG>: run tests only the tag TAG.
--no-retry: doesn't retry failed jobs.

We have a chicken-egg problem, as we first generate the full task graph
and then parse the try message. But the graph generation step needs to
know the try message to process the aforementioned options. The
solution is to parse the message before graph generation and then
pass the command line options to the transforms. Then, each transform
can look at the option that interests it and process it accordingly.

The message parse function is configured in kind.yml, which gives some
flexibility for future implementations of alternative syntaxes.

MozReview-Commit-ID: EQlE6q5E8z7

--HG--
extra : rebase_source : 4b7323cd915e8ef9820816015b4b45524811eaf1
2017-01-31 15:03:10 -02:00
Dustin J. Mitchell b8d8f8a712 Bug 1252948: support for periodic taskgraphs; r=Callek,jonasfj,kmoir
This adds `.cron.yml` and a new mach command to interpret it.  While
functionality is limited to nightlies right now, there is room to expand to
more diverse periodic tasks.  Let your imagination run wild!

MozReview-Commit-ID: KxQkaUbsjQs

--HG--
extra : rebase_source : ddf0a1eadae5a1169c0ead7bcb7b9ce61b255fbf
2017-01-18 19:45:53 +00:00
Justin Wood 18aa1bdfa6 Bug 1330668 - Schedule balrog submission tasks. r=dustin a=me
MozReview-Commit-ID: ASBDESDps8G
2017-01-12 21:01:54 -05:00
Justin Wood 670cc01865 Bug 1330668 - Schedule beetmover tasks. r=dustin
ToDo: attribute this cset to changes on date.

MozReview-Commit-ID: 7gl3aLGNWvP

--HG--
extra : rebase_source : dd2736c8f683350655628b3411cea82319f4ddae
2017-01-12 17:45:36 -05:00