Граф коммитов

8877 Коммитов

Автор SHA1 Сообщение Дата
Emil Farisan affc18cdb6 Bug 1661434 - added mozilla symbol server and source server page to in-tree. r=sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D88729
2020-08-31 11:51:58 +00:00
Emil Farisan 7a87d13818 Bug 1661434 - made content changes to some of the pages. r=sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D88727
2020-08-31 11:50:47 +00:00
Emil Farisan d68985630c Bug 1661434 - added debugging and taskcluster pages from MDN to in-tree. r=sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D88580
2020-08-31 11:16:52 +00:00
Joel Maher 8526914633 Bug 1661351 - Move windows10 web-platform-tests from aws to hardware. r=NarcisB
Move windows10 web-platform-tests from aws to hardware

Differential Revision: https://phabricator.services.mozilla.com/D88693
2020-08-29 00:04:20 +00:00
Ricky Stewart 1f935a2867 Bug 1660548 - Don't globally install Python packages for linting r=ahal
`flake8`, `black`, and `pylint` are all installed in `virtualenv`s when running `mach lint`, so installing these packages globally on image setup isn't necessary.

Differential Revision: https://phabricator.services.mozilla.com/D87904
2020-08-21 21:03:28 +00:00
Narcis Beleuzu f81ec36d9c Backed out 3 changesets (bug 1660340, bug 1641674, bug 1660896) for causing Btime failures on Android 7.0 . CLOSED TREE
Backed out changeset d445d03a6ca0 (bug 1660340)
Backed out changeset 94c19736f73e (bug 1660896)
Backed out changeset 0ba092f930cc (bug 1641674)
2020-08-28 23:31:52 +03:00
Aki Sasaki 172cef5128 Bug 1661637 - upload image_builder:5.0.0 r=releng-reviewers,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D88660
2020-08-28 19:34:14 +00:00
Andrew Halberstadt 3c28444d2d Bug 1660506 - Move backstop determination to the decision task and store it in a parameter, r=marco,taskgraph-reviewers,jmaher
We want to be able to retroactively tell whether a push was a backstop or not.
This patch stores whether or not a push was a "backstop" directly in the
parameters. The optimization strategy now simply returns 'not
params["backstop"]'.

For simplicity, I'm not counting the 'optimized-backstop' as a backstop. It's
unclear if we'll want to be able to detect these types of the pushes in the
future or not, but we can cross that bridge when we get there.

Differential Revision: https://phabricator.services.mozilla.com/D88151
2020-08-26 21:56:05 +00:00
Andrew Halberstadt 0def0cc961 Bug 1660506 - Drop the 'remove_on_projects' feature from the Backstop optimization, r=marco
In the past, the 'backstop' optimization was applied to tasks by default across
all projects, even though it only really made sense on autoland. To choose what
would happen on non-autoland branches, we invented this 'remove_on_projects'
concept.

These days, we only apply the backstop optimization in the first place for
autoland. So 'remove_on_projects' is no longer necessary.

Depends on D88149

Differential Revision: https://phabricator.services.mozilla.com/D88150
2020-08-26 19:11:22 +00:00
Andrew Halberstadt 81eecf7f8c Bug 1660506 - Simplify the backstop optimizations, r=marco
This patch cleans up some of the backstop strategy names. Specifically:

1. Rename 'full-backstop' -> 'backstop'. The old 'backstop' algorithm was
unused anyway, so there is no conflict. It is also just defined directly in
the decorator rather than using 'Alias'.

So now rather than 'full-backstop' and 'optimized-backstop', it's just
'backstop' and 'optimized-backstop'.


2. Remove 'backstop-X-hours-Y-minutes' strategies, and replace them with
the corresponding 'push-interval-X' strategy.

This means we lose the time component in the 'optimized-backstop'. But it isn't
a problem, because we shouldn't be using a time component there at all anyway
(we should just use it with the 'backstop').

Differential Revision: https://phabricator.services.mozilla.com/D88149
2020-08-26 21:40:05 +00:00
Mike Hommey 9071c354c3 Bug 1661659 - Reimplement optionally_keyed_by as a validator function rather than in terms of nested Any. r=taskgraph-reviewers,ahal
Using nested Any generates deeply nested non-trivial schemas because we
also end up nesting optionally_keyed_by's, and the addition of one field
in one optionally_keyed_by in bug 1657769 made the whole schema
compilation step an order of magnitude slower.

Even before bug 1657769, the schema compilation step was slow for tests,
and with this change, it's virtually instantaneous.

Differential Revision: https://phabricator.services.mozilla.com/D88543
2020-08-28 12:47:19 +00:00
Andrew Halberstadt 629b7f62ad Bug 1650406 - [ci] Use 'if-dependencies' with upload-symbols tasks r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D87777
2020-08-27 20:50:32 +00:00
Andrew Halberstadt eaeb3565d0 Bug 1659187 - [ci] Use 'if-dependencies' for build-signing and repackage tasks r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D87775
2020-08-27 20:45:00 +00:00
Andrew Halberstadt e07398454b Bug 1659187 - [taskgraph] Implement a mechanism to only run tasks when a specified dependency is present, r=bhearsum
Certain tasks are meant to perform follow-up work to another task. For example,
a 'signing' task signs an artifact from a dependency task. An 'upload-symbols'
tasks uploads an artifact from a dependency task.

In general, we only want to run these types of tasks when the dependency task
is running. But in practice, these tasks often cause the dependency to get
pulled in.

We've tried to fix this in the past by making the 'run-on-projects' and
'optimization' keys match their primary dependency. But it's very easy to
mess this up, and some optimizations (like bugbug) take the content of the
task definition into account. So even if both tasks use the same optimization,
they could have different results.

This revision adds a new 'if-dependencies' key that denotes a task that should
only run if one of the dependencies specified in this list is also run. It
will allow us to stop playing whack-a-mole when trying to make sure tasks
aren't being pulled in solely due to these types of dependencies.

This feature is implemented independently of the 'optimization', so tasks that
specify this can still be optimized even if their primary dependency does run.

Differential Revision: https://phabricator.services.mozilla.com/D80508
2020-08-27 20:45:33 +00:00
Andrew Halberstadt 18cca882f7 Bug 1659187 - [taskgraph.test] Automatically set dependencies based on edges in test_optimize.py, r=taskgraph-reviewers,bhearsum
Edges are defined as a (left, right, name) tuple, which means task left depends on task right using an edge called name. Previously the optimization code never took dependencies into account, so the mock graph generator never bothered to create them. But in the child revision, we start using these values, so the generation should set it up appropriately.

I had to make it conditional due to the way the assertions in the test_get_subgraph test are set up. I figured it was easier to do that than to re-write the assertions.

Depends on D88483

Differential Revision: https://phabricator.services.mozilla.com/D88484
2020-08-28 12:28:04 +00:00
Andrew Halberstadt 59d997abe4 Bug 1659187 - [taskgraph.test] Convert test_optimize.py to the pytest format and use parametrization, r=taskgraph-reviewers,aki
This removes boiler plate around adding new test cases.

Depends on D88482

Differential Revision: https://phabricator.services.mozilla.com/D88483
2020-08-27 21:36:14 +00:00
Andrew Halberstadt b84d7787f5 Bug 1659187 - [taskgraph.test] Ensure logs are displayed when a test fails, r=taskgraph-reviewers,aki
Differential Revision: https://phabricator.services.mozilla.com/D88482
2020-08-27 21:32:32 +00:00
Mike Hommey 2df59e529f Bug 1661589 - Track decision task duration on perfherder. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D88495
2020-08-28 10:45:23 +00:00
David Major 587cfc4989 Bug 1660340 - Switch builds to clang 11.0.0 rc2 r=froydnj
This changes most of our automation builds to clang 11.0.0 rc2.

Not included:
* code coverage builds, per bug 1660341
* mingw builds, which have traditionally been on their own update cadence, and in this case are blocked anyway by bug 1658632

This will leave some unused clang-9 task definitions. I intend to clean them up, but at a later date. For now I want to focus on making sure this update sticks, since patches like this have a tendency to bounce.

Differential Revision: https://phabricator.services.mozilla.com/D88313
2020-08-27 16:26:23 +00:00
Razvan Maries cd42d16e28 Backed out 3 changesets (bug 1660340, bug 1641674, bug 1660896) for browser time time outs. CLOSED TREE
Backed out changeset edb1d37f48f4 (bug 1660340)
Backed out changeset 9c8388c30032 (bug 1660896)
Backed out changeset 9bf1c5e44a13 (bug 1641674)
2020-08-28 11:44:25 +03:00
Mike Hommey 9c50aac4ea Bug 1660964 - Upgrade skopeo to 1.1.1 and kaniko to 1.0.0. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D88116
2020-08-26 04:53:42 +00:00
Nick Thomas ffceb1c957 Bug 1653476 - import partner repack script into tree and convert to py3, r=aki
Differential Revision: https://phabricator.services.mozilla.com/D88374
2020-08-27 22:19:32 +00:00
Nick Thomas 718f929f20 Bug 1630809 - generate beetmover tasks for partner attribution r=aki
This is a fork of the release-partner-repack-beetmover kind and transform. It's modified to cope with having one upstream task with many partner builds, rather than a many beetmover tasks dealing with a single config-platform-locale combination.

Differential Revision: https://phabricator.services.mozilla.com/D87730
2020-08-27 22:19:34 +00:00
Nick Thomas e9938dc1de Bug 1630809 - generate partner attribution task r=aki
A single task is created to do all partner attributions. The partner_attribution transform processes the configuration into an environment variable for the tools/attribution/attribute.py script to use. This is quite verbose so a large number of configurations may cause problems.

Applies the same priority modification to attribution tasks as to partner repacks, to not impede the main part of the graph.

Differential Revision: https://phabricator.services.mozilla.com/D87729
2020-08-27 22:19:36 +00:00
Nick Thomas c51ceb7354 Bug 1630809 - read attribution configuration from github r=aki
The partner attribution config is stored in the same repository as the repo manifest for partner repacks, but all in attribution_config.yml instead of default.xml. This extends the existing support for using the Github API to read files to retrieve and process the attribution config.

Differential Revision: https://phabricator.services.mozilla.com/D87728
2020-08-27 22:19:39 +00:00
Nick Thomas 5d6881468d Bug 1630809 - add initial support for partner attribution in release promotion r=aki
Renames the release_enable_partners parameter to release_enable_partner_repack, and adds release_enable_partner_attribution for attribution. This it to provide support for disabling them independently in main releases, and in respins.
Adds docs for attribution, update docs for repacks.
Hardwire values for the enable params for the respin flavors, other wise read from the input (defaulting to on in promotion, off otherwise).
Fixes up the rebuild-kinds for partner repacks so that they reflect the current set, although the top level may be all that is needed.

Differential Revision: https://phabricator.services.mozilla.com/D87727
2020-08-27 22:19:41 +00:00
Nick Thomas 30281b78b1 Bug 1630809 - check_if_partners_enabled() is only needed on the top kind for each partner branch r=aki
If the partner repack task are already removed then there can be no downstreams to disable.

Differential Revision: https://phabricator.services.mozilla.com/D87726
2020-08-27 22:19:43 +00:00
Nick Thomas 0c309d25d1 Bug 1630809 - when downloading artifacts using fetch-content, optionally verify hash using chain-of-trust.json r=aki
This improves the integrity of downloads of upstream artifacts when using fetch-content. If `verify-hash: True` is set on the fetch config, then the chain-of-trust.json of the upstream is used to retieve the expected sha256 of the artifact, and this is checked.

Differential Revision: https://phabricator.services.mozilla.com/D87725
2020-08-27 22:19:46 +00:00
Nick Thomas 68740debe6 Bug 1630809 - only generate release-partner-repack tasks for enabled platforms r=aki
Prior to this patch the task graph would always include a release-partner-repack-<platform> task for all 6 platforms, regardless of what was specified in release_partner_config. This was particularly obvious in the off-cycle respin scenario when a single partner is repacked. By moving and reusing get_repack_ids_by_platform() it's easy to skip unneeded platforms.

Differential Revision: https://phabricator.services.mozilla.com/D87724
2020-08-27 22:19:48 +00:00
Nick Thomas aaa9dbde9d Bug 1630809 - python3 compatibility for off-cycle partner respins, typo fixes r=aki
Differential Revision: https://phabricator.services.mozilla.com/D87723
2020-08-27 22:19:30 +00:00
Butkovits Atila b8629b8d1e Backed out 9 changesets (bug 1630809, bug 1653476) for Gecko Decision failures. CLOSED TREE
Backed out changeset 02a27bfc76dd (bug 1653476)
Backed out changeset afb5df61943a (bug 1630809)
Backed out changeset 04628c1f98e9 (bug 1630809)
Backed out changeset 4b4d50e0b1bf (bug 1630809)
Backed out changeset 2fa2deb5c993 (bug 1630809)
Backed out changeset d6652114cac3 (bug 1630809)
Backed out changeset ad5e4caa3291 (bug 1630809)
Backed out changeset d3d841cd14f3 (bug 1630809)
Backed out changeset b3746502e227 (bug 1630809)
2020-08-28 01:15:03 +03:00
Nick Thomas 9c0467f88b Bug 1653476 - import partner repack script into tree and convert to py3, r=aki
Differential Revision: https://phabricator.services.mozilla.com/D88374
2020-08-27 14:56:47 +00:00
Nick Thomas df0eba30f9 Bug 1630809 - generate beetmover tasks for partner attribution r=aki
This is a fork of the release-partner-repack-beetmover kind and transform. It's modified to cope with having one upstream task with many partner builds, rather than a many beetmover tasks dealing with a single config-platform-locale combination.

Differential Revision: https://phabricator.services.mozilla.com/D87730
2020-08-27 05:30:40 +00:00
Nick Thomas c5e9d12304 Bug 1630809 - generate partner attribution task r=aki
A single task is created to do all partner attributions. The partner_attribution transform processes the configuration into an environment variable for the tools/attribution/attribute.py script to use. This is quite verbose so a large number of configurations may cause problems.

Applies the same priority modification to attribution tasks as to partner repacks, to not impede the main part of the graph.

Differential Revision: https://phabricator.services.mozilla.com/D87729
2020-08-27 05:46:51 +00:00
Nick Thomas 6130e5258f Bug 1630809 - read attribution configuration from github r=aki
The partner attribution config is stored in the same repository as the repo manifest for partner repacks, but all in attribution_config.yml instead of default.xml. This extends the existing support for using the Github API to read files to retrieve and process the attribution config.

Differential Revision: https://phabricator.services.mozilla.com/D87728
2020-08-27 05:29:18 +00:00
Nick Thomas ba595e786b Bug 1630809 - add initial support for partner attribution in release promotion r=aki
Renames the release_enable_partners parameter to release_enable_partner_repack, and adds release_enable_partner_attribution for attribution. This it to provide support for disabling them independently in main releases, and in respins.
Adds docs for attribution, update docs for repacks.
Hardwire values for the enable params for the respin flavors, other wise read from the input (defaulting to on in promotion, off otherwise).
Fixes up the rebuild-kinds for partner repacks so that they reflect the current set, although the top level may be all that is needed.

Differential Revision: https://phabricator.services.mozilla.com/D87727
2020-08-27 05:28:53 +00:00
Nick Thomas f0a5c5a65b Bug 1630809 - check_if_partners_enabled() is only needed on the top kind for each partner branch r=aki
If the partner repack task are already removed then there can be no downstreams to disable.

Differential Revision: https://phabricator.services.mozilla.com/D87726
2020-08-27 05:28:09 +00:00
Nick Thomas a2c4b8f1ea Bug 1630809 - when downloading artifacts using fetch-content, optionally verify hash using chain-of-trust.json r=aki
This improves the integrity of downloads of upstream artifacts when using fetch-content. If `verify-hash: True` is set on the fetch config, then the chain-of-trust.json of the upstream is used to retieve the expected sha256 of the artifact, and this is checked.

Differential Revision: https://phabricator.services.mozilla.com/D87725
2020-08-27 05:28:00 +00:00
Nick Thomas e1d61c2ad2 Bug 1630809 - only generate release-partner-repack tasks for enabled platforms r=aki
Prior to this patch the task graph would always include a release-partner-repack-<platform> task for all 6 platforms, regardless of what was specified in release_partner_config. This was particularly obvious in the off-cycle respin scenario when a single partner is repacked. By moving and reusing get_repack_ids_by_platform() it's easy to skip unneeded platforms.

Differential Revision: https://phabricator.services.mozilla.com/D87724
2020-08-27 05:27:44 +00:00
Nick Thomas 9f6c1df957 Bug 1630809 - python3 compatibility for off-cycle partner respins, typo fixes r=aki
Differential Revision: https://phabricator.services.mozilla.com/D87723
2020-08-27 05:27:40 +00:00
David Major ffe0607216 Bug 1660340 - Switch builds to clang 11.0.0 rc2 r=froydnj
This changes most of our automation builds to clang 11.0.0 rc2.

Not included:
* code coverage builds, per bug 1660341
* mingw builds, which have traditionally been on their own update cadence, and in this case are blocked anyway by bug 1658632

This will leave some unused clang-9 task definitions. I intend to clean them up, but at a later date. For now I want to focus on making sure this update sticks, since patches like this have a tendency to bounce.

Differential Revision: https://phabricator.services.mozilla.com/D88313
2020-08-27 16:26:23 +00:00
Gregory Mierzwinski 49e80e0625 Bug 1660278 - Add libtinfo5 requirement to custom-v8 docker. r=jmaher
This patch fixes an issue in the custom-v8 toolchain where there is tooling missing that is needed to build v8 (the libtinfo5 package).

Differential Revision: https://phabricator.services.mozilla.com/D88310
2020-08-27 14:29:13 +00:00
Florin Strugariu e7a92c2122 Bug 1625965 - Raptor Youtube-Playback Fenix tests are silently failing on VP9 r=perftest-reviewers,sparky
Depends on D67437

Differential Revision: https://phabricator.services.mozilla.com/D69510
2020-08-27 13:12:32 +00:00
Aki Sasaki ad0733dd86 Bug 1644574 - run codeql on firefox ship phase r=releng-reviewers,jlorenzo DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D88235
2020-08-27 00:23:25 +00:00
James Willcox 3f3208d559 Bug 1657713 - Include GeckoView example and test APKs in multi-locale builds r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D87102
2020-08-25 16:30:39 +00:00
Andrew Halberstadt 99654d61b3 Bug 1657769 - [ci] Run talos bcv on -qr platforms when software webrender is enabled, r=jmaher
From mwoodrow:

bcv is 'basic compositor video', which explicitly disables acceleration using a
pref and then runs some video tests. For normal -qr platforms this isn't
useful, since the pref would disable WebRender, and it'd be an identical
configuation to the non-qr variant.

When software webrender is enabled, disabling acceleration won't disable WR,
and test remains useful (testing video performance of the software webrender
configuration).

The baseline I want to compare against here is the non-qr bcv, to see if
webrender-software is worse than layers-software.

Differential Revision: https://phabricator.services.mozilla.com/D88192
2020-08-25 21:30:43 +00:00
Andrew Halberstadt b7b4be8d91 Bug 1657769 - [taskgraph] Add ability to 'defer' some keys in resolve_keyed_by, r=taskgraph-reviewers,aki
It's often useful to nest 'by-*' statements in the CI configs. However, calling
'resolve_keyed_by' will keep drilling down and resolving these statements all
at once. Normally this is fine, but sometimes we may want to use, e.g 'by-foo'
when 'foo' hasn't been resolved yet (i.e, it is being set by a later transform
or something like that).

Currently, this means that we'll hit the 'default' case as 'foo' doesn't exist.
This revision adds the ability to 'defer' evaluation of 'foo' until a later
time.

While running into this scenario might be a code smell, re-organizing
transforms to untangle these kinds of ordering dependencies will be a major
undertaking.  Plus, there are legitimate reasons we might want one kind of
ordering with certain tasks, then another ordering for other tasks.

Differential Revision: https://phabricator.services.mozilla.com/D88191
2020-08-26 13:39:51 +00:00
Mihai Alexandru Michis 4a7490750d Backed out changeset 8b1447160ba4 (bug 1651542) as requested by whimboo. 2020-08-26 11:57:30 +03:00
Razvan Maries b3380a4504 Backed out changeset a716e6202487 (bug 1660964) for Gecko Decision Task bustage. CLOSED TREE 2020-08-26 07:47:14 +03:00
Mike Hommey 9cdb5268e6 Bug 1660964 - Upgrade skopeo to 1.1.1 and kaniko to 1.0.0. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D88116
2020-08-25 20:25:36 +00:00
David Major 3e160f998a Bug 1661129 - Add toolchain tasks for clang 11.0.0 rc2 (not yet used) r=nalexander
This adds toolchain definitions for clang 11.0.0 rc2, so that developers can get a sneak peek, but nothing in automation uses these tasks yet. We'll make the switch in a later patch.

NB: most of `clang.yml` is rote copy-paste, except for `macosx64-clang-11` which makes a deliberate departure, described in a comment.

Differential Revision: https://phabricator.services.mozilla.com/D88189
2020-08-25 22:22:12 +00:00
David Major 00d90b6c8a Bug 1661126 - Update wasi-sdk to pick up clang-11 build fixes r=firefox-build-system-reviewers,rstewart
Also reflects the move from CraneStation to the WebAssembly account. And we need a small tweak to the build script to accommodate one of the changes that got picked up along the way.

Differential Revision: https://phabricator.services.mozilla.com/D88187
2020-08-25 22:19:08 +00:00
Ricky Stewart d14df1032e Bug 1660614 - Upgrade `sccache` to pick up more resilient behavior in the presence of cache read failures r=froydnj
This avoids a set of intermittent issues related to `zstd` decompression failures, which in the absence of these changes break the entire build.

This also requires [updating an environment variable](https://github.com/mozilla/sccache/pull/822), which we do in `client.mk` as well as documentation.

Differential Revision: https://phabricator.services.mozilla.com/D88184
2020-08-25 21:16:53 +00:00
Mihai Tabara 6f13573a77 Bug 1660771 - default mergeduty bump-esr to esr78. r=releng-reviewers,bhearsum,jlorenzo DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D88140
2020-08-25 13:27:41 +00:00
Tom Prince 5266998a5b Bug 1492362: [taskgraph] Don't delete fetches after running a task; r=glandium
In Bug 1466660, we started deleting the fetches after a task had run, to avoid
interference between tasks. It turns out the only tasks this was for were the
`source-test-jsshell` tasks, which were changed to use an absolute directory in
Bug 1465181. However, since Bug 1568460 we've always used a per-task directory
for fetches, so can remove the work-around of removing fethes.

Differential Revision: https://phabricator.services.mozilla.com/D86670
2020-08-19 11:02:22 +00:00
Tom Prince d3dcf1b0e8 Bug 1492362: [taskgraph] Stop setting `workdir` on generic-worker tasks; r=glandium
After changing the default checkout path on linux generic-worker tasks to be
relative these settings have no effect.

Differential Revision: https://phabricator.services.mozilla.com/D86669
2020-08-19 11:02:26 +00:00
Tom Prince bcca419aba Bug 1492362: [taskgraph] Only use absolute paths for checkouts in docker; r=glandium
We define a value `run.workdir` to point to the defaut directory to use for
all sorts of paths, including checkouts, in the job transform. However, that
directory only makes sense for docker-worker tasks, and relative paths should
be used elsewhere. Adjust the paths on non-docker-worker linux tasks to match
macOS paths.

Differential Revision: https://phabricator.services.mozilla.com/D86668
2020-08-19 11:02:29 +00:00
Andrew Halberstadt 77abfc0039 Bug 1657769 - Run some Talos tests with software webrender on linux64-qr, r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D86456
2020-08-24 16:23:02 +00:00
David Major b43ea36da9 Bug 1660341 - Pin code coverage builds to clang-9 r=froydnj
At the upcoming upgrade to clang-11, we'll need to keep code coverage builds on clang-9, so that their file format is understandable our currently LLVM-9-based rustc.

As currently written this change is NFC, but for the future it will opt-out ccov builds from the retargeting of the `linux64-clang` alias.

The macosx.yml change looks larger than it really is, it's mostly pushing defaults down into the tasks so that coverage builds can override them.

Differential Revision: https://phabricator.services.mozilla.com/D87901
2020-08-22 13:56:36 +00:00
Mitchell Hentges f48b90e9fc Bug 1656403: Bump rust nightly toolchain version to 1.44 r=glandium
The Firefox build requires features of Rust 1.43. However, a given Rust 1.43 nightly might be missing components that exist in the stable release.

By bumping the nightly version in the toolchain to 1.44 (first released on March 18), we ensure that we won't run into an unexpected missing feature.

Depends on D87650

Differential Revision: https://phabricator.services.mozilla.com/D87651
2020-08-19 21:28:23 +00:00
Aki Sasaki 16c7337f1e Bug 1600657 - l10n-bumper should use the latest revisions. r=releng-reviewers,bhearsum DONTBUILD
- disable esr l10n-bumper on 81
- use l10n-repo-url instead of revision-url (l10n-central instead of elmo)

Differential Revision: https://phabricator.services.mozilla.com/D87693
2020-08-21 03:14:19 +00:00
Mike Hommey b49cc98477 Bug 1660385 - Fix android-hw-p2-8-0-android-aarch64-{,shippable-}qr/opt tests to use the aarch64 build. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D87828
2020-08-21 01:46:48 +00:00
Joel Maher 09c938e9e8 Bug 1660221 - migrate windows hardware tasks to new 1803 image. r=taskgraph-reviewers,aki
migrate windows hardware tasks to the new 1803 image.

Differential Revision: https://phabricator.services.mozilla.com/D87740
2020-08-20 15:47:18 +00:00
Andrew Halberstadt 38e3b0a2ae Bug 1659187 - [taskgraph] Require '--run-slow' for test_util_chunking.py, r=taskgraph-reviewers,aki
This test takes a long time and is annoying when it's included by default.

Depends on D87772

Differential Revision: https://phabricator.services.mozilla.com/D87773
2020-08-20 16:50:16 +00:00
Andrew Halberstadt 54dac3bfb2 Bug 1659187 - [taskgraph] Move optimization reason logging to the _log_optimizations function, r=taskgraph-reviewers,aki
This is needed as future revisions will refactor the optimization process to be
two pass. So we can't be sure if a task is optimized or not until the very end.

Depends on D87771

Differential Revision: https://phabricator.services.mozilla.com/D87772
2020-08-20 16:39:19 +00:00
Andrew Halberstadt cf9986de30 Bug 1659187 - [taskgraph] Add clarifying note to the TaskGraph docstring, r=taskgraph-reviewers,aki
I got tripped up by the docs for Graph.visit_preorder/visit_postorder which
talks about nodes linking to and from other nodes, but makes no mention of
which direction the linking happens practically (in my mind I thought "linking
to" meant going from task -> dependent).

This blurb would have helped me catch my mistake.

Differential Revision: https://phabricator.services.mozilla.com/D87771
2020-08-20 17:24:46 +00:00
Aki Sasaki 04d714ebd6 no bug - fix try taskgraph-gen r=taskgraph-reviewers,jmaher DONTBUILD
taskgraph-gen.py dies on try.yml currently.
I'm not sure what the underlying issue is, but this gets things working again.

Differential Revision: https://phabricator.services.mozilla.com/D87691
2020-08-20 15:23:54 +00:00
Henrik Skupin 1106232b74 Bug 1651542 - Force font cache generation for ubuntu1804-test docker image. r=jmaher
Fixing the font cache issue the 3rd time now by just running "fc-cache" as the worker user should hopefully fix it for real, and no longer be regressed by some docker image changes.

The Puppeteer jobs will keep the 15s startup timeout for Firefox, so that we could detect another fallout again.

Differential Revision: https://phabricator.services.mozilla.com/D87745
2020-08-20 13:22:26 +00:00
Tom Prince 02890a5a1a Bug 1658468: Only run system-symbols-upload tasks on cron; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D86663
2020-08-11 01:50:41 +00:00
Mike Hommey 072e615263 Bug 1658515 - Upgrade cctools-port and libtapi. r=dmajor
This brings support for tbd-v4, used in SDK 11.0.

Differential Revision: https://phabricator.services.mozilla.com/D86689
2020-08-18 13:27:07 +00:00
Narcis Beleuzu 9b1cd3b0bd Backed out 4 changesets (bug 1492362) for android wpt failures. CLOSED TREE
Backed out changeset ac0fdd0c661e (bug 1492362)
Backed out changeset 89ecd6ee8edd (bug 1492362)
Backed out changeset ae17b683bf71 (bug 1492362)
Backed out changeset 485f333bc3b7 (bug 1492362)
2020-08-19 13:54:36 +03:00
Tom Prince 3ffe1948d3 Bug 1492362: [taskgraph] Don't delete fetches after running a task; r=glandium
In Bug 1466660, we started deleting the fetches after a task had run, to avoid
interference between tasks. It turns out the only tasks this was for were the
`source-test-jsshell` tasks, which were changed to use an absolute directory in
Bug 1465181. However, since Bug 1568460 we've always used a per-task directory
for fetches, so can remove the work-around of removing fethes.

Differential Revision: https://phabricator.services.mozilla.com/D86670
2020-08-19 01:05:42 +00:00
Tom Prince a0b7e33bea Bug 1492362: [taskgraph] Stop setting `workdir` on generic-worker tasks; r=glandium
After changing the default checkout path on linux generic-worker tasks to be
relative these settings have no effect.

Differential Revision: https://phabricator.services.mozilla.com/D86669
2020-08-19 01:05:46 +00:00
Tom Prince 4a99315c95 Bug 1492362: [taskgraph] Only use absolute paths for checkouts in docker; r=glandium
We define a value `run.workdir` to point to the defaut directory to use for
all sorts of paths, including checkouts, in the job transform. However, that
directory only makes sense for docker-worker tasks, and relative paths should
be used elsewhere. Adjust the paths on non-docker-worker linux tasks to match
macOS paths.

Differential Revision: https://phabricator.services.mozilla.com/D86668
2020-08-19 01:05:50 +00:00
Narcis Beleuzu 6cc48251bb Backed out changeset 3755692f8d5f (bug 1649987) as per glandium req 2020-08-19 10:32:09 +03:00
Csoregi Natalia 2dd1b9f726 Backed out 4 changesets (bug 1492362) for gecko decision bustage. CLOSED TREE
Backed out changeset 8e6cf79c70f7 (bug 1492362)
Backed out changeset 225a6bfe8cbf (bug 1492362)
Backed out changeset ea667ccd4b19 (bug 1492362)
Backed out changeset a20562dbfece (bug 1492362)
2020-08-19 04:01:35 +03:00
Tom Prince c76e62f3a3 Bug 1492362: [taskgraph] Don't delete fetches after running a task; r=glandium
In Bug 1466660, we started deleting the fetches after a task had run, to avoid
interference between tasks. It turns out the only tasks this was for were the
`source-test-jsshell` tasks, which were changed to use an absolute directory in
Bug 1465181. However, since Bug 1568460 we've always used a per-task directory
for fetches, so can remove the work-around of removing fethes.

Differential Revision: https://phabricator.services.mozilla.com/D86670
2020-08-18 07:49:40 +00:00
Tom Prince 9ae4ede956 Bug 1492362: [taskgraph] Stop setting `workdir` on generic-worker tasks; r=glandium
After changing the default checkout path on linux generic-worker tasks to be
relative these settings have no effect.

Differential Revision: https://phabricator.services.mozilla.com/D86669
2020-08-18 07:48:30 +00:00
Tom Prince dbe6d42aca Bug 1492362: [taskgraph] Only use absolute paths for checkouts in docker; r=glandium
We define a value `run.workdir` to point to the defaut directory to use for
all sorts of paths, including checkouts, in the job transform. However, that
directory only makes sense for docker-worker tasks, and relative paths should
be used elsewhere. Adjust the paths on non-docker-worker linux tasks to match
macOS paths.

Differential Revision: https://phabricator.services.mozilla.com/D86668
2020-08-18 07:43:33 +00:00
Joel Maher 955e4bc421 Bug 1649987 - Set default task expiry to 12 weeks r=bhearsum
Set default task expiry for artifacts

Differential Revision: https://phabricator.services.mozilla.com/D87496
2020-08-18 20:39:58 +00:00
Tom Prince 47e9105c81 No bug: Allow diffoscope wrapper to unpack arbitrary packages, not just ones named target; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D86758
2020-08-18 07:54:20 +00:00
Ricky Stewart 9719a9a5a9 Bug 1636797 - In `hash.py`, enumerate files from the VCS rather than searching the filesystem directly r=ahal
This resolves a long-standing issue in development where `mach artifact` (and therefore `mach bootstrap`) would fail unpredictably if you had dirty, but ignored, files in your checkout. Resolving this problem often required unwieldy `hg purge`/`git ignore` incantations that are easy to get wrong.

This patch addresses the problem by doing what we "should" have been doing all along, and consulting the VCS to list tracked files rather than listing EVERY file on disk and applying heuristics to determine whether they should be included in the hash.

Differential Revision: https://phabricator.services.mozilla.com/D86780
2020-08-17 15:19:34 +00:00
Henrik Skupin 072b4d9e85 Bug 1644235 - [marionette] Enable Marionette unit tests with Fission in CI. r=cpeterson,marionette-reviewers,maja_zf
Differential Revision: https://phabricator.services.mozilla.com/D87053
2020-08-14 18:09:31 +00:00
Mihai Alexandru Michis df36200714 Backed out changeset d244e80dc826 (bug 1649987) for causing builds to fail as exceptions.
CLOSED TREE
2020-08-13 17:56:12 +03:00
Chris AtLee 08158e2184 Bug 1649987: Set default task expiry to 12 weeks r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D82229
2020-08-12 20:54:39 +00:00
Bogdan Tara c203033e7b Backed out changeset 49da43027193 (bug 1649987) for gecko decision bustage CLOSED TREE 2020-08-12 18:18:23 +03:00
Chris AtLee 547fc35411 Bug 1649987: Set default task expiry to 12 weeks r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D82229
2020-08-12 14:51:05 +00:00
Ben Hearsum 9ece148d45 Bug 1607619: only run rusttests when rust files are modified. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D86434
2020-08-12 14:36:12 +00:00
alexandru.ionescu b8de5629f2 Bug 1638934 Run Talos tests with Fission enabled on macOS as tier 2 r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D85582
2020-08-12 14:00:32 +00:00
Sylvestre Ledru 5ea6c250c3 Bug 1657926 - firefox doc: fix some warnings r=championshuttler
Differential Revision: https://phabricator.services.mozilla.com/D86732
2020-08-11 23:20:25 +00:00
Joel Maher e68bae6ef9 Bug 1656625 - disable dock on osx. r=dividehex,bc
disble dock on osx.

Differential Revision: https://phabricator.services.mozilla.com/D86426
2020-08-11 23:01:50 +00:00
Tarek Ziadé 2909efb662 Bug 1650363 - Performance testing of HTTP3 in Firefox using only xpcshell tests r=michal,sparky
Differential Revision: https://phabricator.services.mozilla.com/D84021
2020-08-10 06:26:39 +00:00
june wilde 103a325162 Bug 1598226 - Create task definitions for external clang-tidy checks; r=andi,tjr,glandium
Depends on D81448

Differential Revision: https://phabricator.services.mozilla.com/D84769
2020-08-10 21:02:04 +00:00
Razvan Maries 6fa43f1893 Backed out changeset 9251996ce8c9 (bug 1657939) for Gecko Decision Task failures. CLOSED TREE 2020-08-11 00:32:44 +03:00
Justin Wood b78899c21d Bug 1657939 - Output an artifact that identifies replaced taskID's. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D86379
2020-08-10 19:20:28 +00:00
Simon Fraser 6f3132e158 Bug 1658079 Disable resource-monitor support for aarch64 workers r=mtabara
Differential Revision: https://phabricator.services.mozilla.com/D86525
2020-08-10 12:49:08 +00:00
Simon Fraser 3befe6d707 Bug 1657409 Remove obsolete S3 bucket r=nthomas,Callek
Differential Revision: https://phabricator.services.mozilla.com/D86168
2020-08-06 21:41:46 +00:00
Kimberly Sereduck 66f2b807f4 Bug 1656979 - Add chromedriver for Chrome 84 r=perftest-reviewers,sparky
fixed browsertime.yaml file

Differential Revision: https://phabricator.services.mozilla.com/D85906
2020-08-06 17:28:04 +00:00
Kershaw Chang e8d27d2d2e Bug 1640105 - Add socketprocess_networking variant for mochitest r=ahal,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D77302
2020-08-10 09:21:03 +00:00
Gregory Mierzwinski f87d8a4859 Bug 1657898 - Fix fenix artifact paths. r=jlorenzo,tarek
Differential Revision: https://phabricator.services.mozilla.com/D86351
2020-08-08 12:16:49 +00:00
Andreea Pavel ee6c26bbf4 Backed out changeset efb80bd836f6 (bug 1657834) for causing bug 1577076 to permafail 2020-08-08 00:50:58 +03:00
Ricky Stewart 31755b431d Bug 1657650 - Require that Mach command providers subclass MachCommandBase. r=remote-protocol-reviewers,marionette-reviewers,maja_zf,mhentges,froydnj
Today we don't require that `mach` `CommandProvider`s subclass from any particular parent class and we're very lax about the requirements they must meet. While that's convenient in certain circumstances, it has some unfortunate implications for feature development.

Today the only requirements that we have for `CommandProvider`s are that they have an `__init__()` method that takes either 1 or 2 arguments, the second of which must be called `context` and is populated with the `mach` `CommandContext`. Again, while this flexibility is occasionally convenient, it is limiting. As we add features to `mach`, having a better idea what the shape of our `CommandProvider`s are and how we can instantiate them and use them is increasingly important, and this gives us additional control when having `mach` configure `CommandProvider`s based on data that is only available at the `mach` level. In particular, we plan to leverage this in bugs 985141 and 1654074.

Here we add validation to the `CommandProvider` decorator to ensure all classes inherit from `MachCommandBase`, update all `CommandProvider`s in-tree to inherit from `MachCommandBase`, and update source and test code accordingly.

Follow-up work: we now require (de facto) that the `context` be populated with a `topdir` attribute by the `populate_context_handler` function, since instantiating the `MachCommandBase` requires a `topdir` be provided. This is fine for now in the interest of keeping this patch reasonably sized, but some additional refactoring could make this cleaner.

Differential Revision: https://phabricator.services.mozilla.com/D86255
2020-08-07 18:24:59 +00:00
Geoff Brown 17aa606fd7 Bug 1656811 - Run linux64/debug reftests with software webrender; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D86284
2020-08-07 19:59:57 +00:00
Chris Fallin 227741192b Bug 1649928: add CI jobs for Cranelift/aarch64 Wasm backend using simulator. r=sfink
This adds a new job variant `arm64-cranelift-sim` to the SpiderMonkey
build configurations, and adds a Taskherder CI configuration to run it.
The job uses the aarch64 simulator support built-in to SpiderMonkey, so
it does not need to run on native aarch64 hardware.

A few tests needed to be added to the "slow tests" list as they time out
under the simulator otherwise.

This also fixes an issue with an error message in `build-sm.sh` in which
the overloading of the backtick's meaning (code-quotes in
Markdown-world, and command interpolation in shell scripts) led to an
amusing attempt to execute parts of the error message.

Finally, this fixes an error that seems unrelated to Cranelift or
WebAssembly in a GC jit-test, wherein its way of measuring maximum stack
recursion depth was failing.

Differential Revision: https://phabricator.services.mozilla.com/D86131
2020-08-07 18:17:37 +00:00
Andrew Halberstadt b311f0f9b4 Bug 1650406 - [ci] Add more tests for tasks that shouldn't be running on |mach try auto| pushes, r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D86387
2020-08-07 18:08:58 +00:00
Andrew Halberstadt 8ba595615e Bug 1657948 - [ci] Run firefox-ci python tests with Python 3, r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D86385
2020-08-07 18:08:58 +00:00
Marco Castelluccio 3fe74901e4 Bug 1656465 - Run fuzzing builds on backstop pushes. r=ahal DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D86357
2020-08-07 15:08:53 +00:00
Simon Fraser 822f5512e5 Bug 1657834 Enable resource-monitor r=mtabara
Differential Revision: https://phabricator.services.mozilla.com/D86319
2020-08-07 10:16:08 +00:00
Andrew Halberstadt 5c5ab01583 Bug 1657649 - [taskgraph] Remove the SETA optimizer, r=jmaher
Depends on D86251

Differential Revision: https://phabricator.services.mozilla.com/D86252
2020-08-06 20:01:39 +00:00
Andrew Halberstadt 1be2069331 Bug 1657649 - [taskgraph] Fallback to relevant_tests instead of seta in the bugbug optimizer, r=jmaher
Depends on D86250

Differential Revision: https://phabricator.services.mozilla.com/D86251
2020-08-06 20:14:59 +00:00
Andrew Halberstadt 8733547d93 Bug 1657649 - [ci] Remove the SETA shadow-scheduler, r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D86250
2020-08-06 20:27:26 +00:00
Andrew Halberstadt 31d5259a1a Bug 1657622 - [taskgraph] Revert to 'bugbug-reduced-fallback' optimization strategy on autoland, r=marco
Differential Revision: https://phabricator.services.mozilla.com/D86219
2020-08-06 19:52:05 +00:00
shravanrn@gmail.com 12c83a7c60 Bug 1649631 - Fix wasi issues in clang-11 builds r=froydnj,dmajor
Differential Revision: https://phabricator.services.mozilla.com/D85741
2020-08-06 19:22:24 +00:00
Andrew Halberstadt d25129dd6f Bug 1634679 - [ci] Output full taskgraph JSON from shadow-schedulers, r=marco
Differential Revision: https://phabricator.services.mozilla.com/D85885
2020-08-06 16:05:47 +00:00
Marco Castelluccio 893866a2ee Bug 1657097 - Stop running all builds on autoland, only run builds selected by bugbug and builds that are dependencies of test tasks. r=ahal,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D85976
2020-08-06 14:25:17 +00:00
Steve Fink 14202a2c79 Bug 1655789 - Use build/moz.build for JS standalone builds r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D85178
2020-08-05 21:27:10 +00:00
Simon Fraser 27e5ba55f3 Bug 1648051 Task resource monitor r=mtabara,tomprince
I've left the monitor disabled for now, so that we can have a smaller pushes for enabling and disabling it if needed. It should allow more fine grained control.

We may also want to include extracting the monitor tool from a github version instead, and also removing the assumption and it being forked from the parent, so that it's instead given a process ID to treat as the parent it should watch.

Differential Revision: https://phabricator.services.mozilla.com/D84374
2020-08-06 01:21:24 +00:00
Gregory Mierzwinski d2c77fe8bd Bug 1651311 - Disable talos-svgr for high intermittent failure rate. r=kimberlythegeek
Differential Revision: https://phabricator.services.mozilla.com/D86066
2020-08-05 20:35:32 +00:00
Tom Prince 6b70269804 Bug 1604749: Get misc worker-type from graph config; r=Callek
The original patch calculated the worker type, but didn't use it in the
generated task.

Differential Revision: https://phabricator.services.mozilla.com/D61643
2020-08-05 19:54:49 +00:00
Florin Strugariu 53d2757276 Bug 1656475 - Activate performance alerting on multi commit Fenix performance tests r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D86020
2020-08-05 16:06:17 +00:00
Marco Castelluccio eea7750416 Bug 1657192 - Add a 'tests_grouped' tag to tasks for suites that are chunked in the taskgraph. r=ahal DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D85908
2020-08-05 14:27:31 +00:00
Geoff Brown 2b894fb716 Bug 1656372 - Add a test-info task to identify tests disabled on xorigin; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D85913
2020-08-05 13:34:00 +00:00
Marco Castelluccio 1f770c10a5 Bug 1655515 - Remove temporary workaround to consider shippable tasks returned by bugbug as opt tasks. r=bhearsum DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D85159
2020-08-05 12:32:49 +00:00
Marco Castelluccio ba8d99b8aa Bug 1648723 - Run full backstops every 20 pushes, and backstops optimized by bugbug every 10 pushes. r=ahal,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D81874
2020-08-05 11:25:20 +00:00
Bogdan Tara abfa3262b8 Backed out changeset 1ccda1d0c3ea (bug 1650363) for causing a serious regression in packaging time 2020-08-05 04:23:20 +03:00
Tom Prince e20e896219 Bug 1657199: Generate the same docker-image digests locally as in automation; r=Callek
In bug 1626058, I changed how the docker image digest was generated:

- I used the same directory structure to generate the digest as was used for generating the context
- I moved context generation to the decision task, and used the hash of that as part of the digest.

Unfortunately, it turns out the file name in the gzip header of the context
.tar.gz differed between when we are creating a context to write out, and when
were just generating the hash.

This adjust the name used in the gzip header to be consistent.

Differential Revision: https://phabricator.services.mozilla.com/D84753
2020-08-04 19:50:05 +00:00
Tom Prince 0fe74d5a31 Bug 1653171: Run windows L10n repacks on linux; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D85894
2020-08-04 18:47:55 +00:00
Marco Castelluccio d2811763c6 Bug 1656315 - Update json-pushes mock after the changes from bug 1648723. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D85743
2020-08-04 14:50:48 +00:00
Tom Prince e74feb3286 No bug: [taskgraph] Remove unused scriptengine-autophone worker support; r=bc DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D84046
2020-08-04 17:59:27 +00:00
Anny Gakhokidze e93d7c8e15 Bug 1654922 - Part 4: Remove DocumentChannel pref usage from taskcluster, raptor and talos tools, r=mattwoodrow,perftest-reviewers,sparky
Depends on D85485

Differential Revision: https://phabricator.services.mozilla.com/D85486
2020-07-31 14:33:54 +00:00
Tom Prince a5db55b4fd No bug: [taskgrah] Fix `mach taskgraph full --tasks <...>` on python 3; r=Callek DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D85895
2020-08-04 17:16:15 +00:00
Geoff Brown 697ca6ed56 Bug 1617684 - Run existing fission web-platform tests as tier 1; r=jmaher
For all fission web-platform tests currently running on mozilla-central as tier 2,
promote to tier 1 and run on all trunk trees.

Differential Revision: https://phabricator.services.mozilla.com/D85512
2020-08-04 14:12:11 +00:00
Gregory Mierzwinski 4f1cccc879 Bug 1656855 - Make perfherder-metrics character escapes OS-specific. r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D85761
2020-08-04 14:40:02 +00:00
Tom Ritter e6b8454b50 Bug 1616925 - Support a taskcluster-based ssh key for fetch jobs r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D81448
2020-08-03 15:33:01 +00:00
Noemi Erli e91002b722 Backed out changeset 359f9a3acc75 (bug 1616925) for causing failures in test_2_conformance2__glsl3__matrix-row-major-dynamic-indexing.html CLOSED TREE 2020-08-03 22:35:34 +03:00
Andrew McCreight 53a1604965 Bug 1655536, part 3 - Re-enable Fission AWSY on Windows. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D85500
2020-07-31 17:16:07 +00:00
Tom Prince c48cf82439 Bug 1653173: [release] Block push-to-release on update-verify being complete; r=RyanVM
Differential Revision: https://phabricator.services.mozilla.com/D84198
2020-08-03 17:22:30 +00:00
Tom Ritter 58fc2fa062 Bug 1616925 - Support a taskcluster-based ssh key for fetch jobs r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D81448
2020-08-03 15:33:01 +00:00
Tarek Ziadé 03cbd4d536 Bug 1650363 - Performance testing of HTTP3 in Firefox using only xpcshell tests r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D84021
2020-08-02 17:28:57 +00:00
Gregory Mierzwinski a4e1ebe204 Bug 1656540 - Allow specifying perfherder settings on a per-metric basis. r=tarek
This patch fixes an issue where the metric settings were not being used because they don't use the test name. It also handles some changes (from a bad copy-paste) that didn't make it into the last live-site patch series.

Differential Revision: https://phabricator.services.mozilla.com/D85609
2020-08-01 16:13:28 +00:00
Mike Hommey 38cc2e0609 Bug 1654994 - Switch full symbols archive to tar.zst. r=firefox-build-system-reviewers,rstewart,tomprince
Differential Revision: https://phabricator.services.mozilla.com/D85252
2020-07-31 20:27:54 +00:00
Mike Hommey 13b57c569e Bug 1654994 - Make full symbols archive opt-in rather than opt-out. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D85354
2020-07-31 10:01:54 +00:00
Joel Maher abf17d06e7 Bug 1643689 - disable 1st round of manifest scheduling. r=aryx
disable 1st round of manifest scheduling

Differential Revision: https://phabricator.services.mozilla.com/D85621
2020-07-31 20:15:34 +00:00
Joel Maher 0d05d91906 Bug 1652881 - filter out remaining debug tasks on beta/release. r=Callek
filter out remaining debug tasks on beta/release.

Differential Revision: https://phabricator.services.mozilla.com/D85511
2020-07-31 20:10:37 +00:00
sachin a1654899f8 Bug 1654056: Rename app-link tests to VIEW and home_activity to MAIN r=acreskey,sparky,tarek
Rename app-link tests to VIEW and home_activity to MAIN

Differential Revision: https://phabricator.services.mozilla.com/D84400
2020-07-31 18:54:27 +00:00
Ben Hearsum 2c33b47941 Bug 1656534: devtools preset no longer runs linux opt fission tests (moved to --full task list). r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D85614
2020-07-31 18:22:02 +00:00
Gregory Mierzwinski 21952648e0 Bug 1655031 - Enable HTTP/3 live site tests in CI. r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D84932
2020-07-31 15:33:12 +00:00
alexandru.ionescu 112daf28c8 Bug 1643825 Disable T-Prof windows shippable tests r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D85574
2020-07-31 14:38:11 +00:00
Florin Strugariu 9c012844a3 Bug 1652438 - Schedule all tests to run nightly on test-windows10-64-ref-hw-2017 r=perftest-reviewers,davehunt,jmaher,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D83485
2020-07-31 11:04:21 +00:00
Dorel Luca 0226b8feef Backed out 6 changesets (bug 1654994) for build bustage on fuzzy builds. DONTBUILD
Backed out changeset cd3e1074b785 (bug 1654994)
Backed out changeset 45ee50e76d61 (bug 1654994)
Backed out changeset 77f1b667baec (bug 1654994)
Backed out changeset 9fca8b0bf8c1 (bug 1654994)
Backed out changeset 7131943d8db9 (bug 1654994)
Backed out changeset 435b90f6ca70 (bug 1654994)
2020-07-31 12:36:14 +03:00
Ben Hearsum 23a8387aec Bug 1655703: Can't schedule opt tests on try without --full r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D85197
2020-07-30 20:56:36 +00:00
Mike Hommey 311e167747 Bug 1654994 - Switch full symbols archive to tar.zst. r=firefox-build-system-reviewers,rstewart,tomprince
Differential Revision: https://phabricator.services.mozilla.com/D85252
2020-07-30 22:21:28 +00:00
Mike Hommey fb02e02524 Bug 1654994 - Make full symbols archive opt-in rather than opt-out. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D85354
2020-07-30 11:30:34 +00:00
Nathan Froyd 9d38c2fd4a Bug 1655929 - bump upstream versions of rlbox + lucet; r=firefox-build-system-reviewers,rstewart
We need this bump for a couple of reasons:

1. It enables floating the libc crate version, which makes keeping up-to-date
   with upstream changes easier.
2. It enables floating the getrandom crate version, which enables updating
   getrandom to a version with less buggy behavior around the Linux
   `getrandom` syscall on some architectures.

We also take this opportunity to sync up our vendored lucet with the lucet
that we use to build things in taskcluster.

Differential Revision: https://phabricator.services.mozilla.com/D85408
2020-07-30 15:55:30 +00:00
Marco Castelluccio f092f2d06e Bug 1648723 - Define a new push-interval-20 strategy that optimizes everything except every 20th push. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D85277
2020-07-30 17:14:21 +00:00
Marco Castelluccio f4e638b22d Bug 1648723 - Use the util/hg.py module in the backstop module to avoid code duplication. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D85276
2020-07-30 17:14:09 +00:00
Marco Castelluccio f3f890a7de Bug 1648723 - Make it possible to run the bugbug optimization strategy on a set of pushes. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D85275
2020-07-30 17:13:56 +00:00
Justin Wood 60067b8e97 Bug 1653050 followup, import copy. CLOSED TREE r=CosminS
Differential Revision: https://phabricator.services.mozilla.com/D85442
2020-07-30 17:23:12 +00:00
Justin Wood 847dc95734 Bug 1653050 - Allow optimizing by replacement existing (pending/unscheduled) cached tasks. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D83280
2020-07-30 16:14:15 +00:00
Csoregi Natalia 55d6683aab Backed out changeset c2746ff5e6b4 (bug 1653050) for failing gecko decision task. CLOSED TREE 2020-07-30 05:31:21 +03:00
Justin Wood ab8f9ee286 Bug 1653050 - Allow optimizing by replacement existing (pending/unscheduled) cached tasks. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D83280
2020-07-28 19:58:14 +00:00
Nick Thomas 0d86e577c0 Bug 1653171 - bump timeout for windows l10n up to 45 minutes, r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D85350
2020-07-30 00:38:52 +00:00
Rail Aliiev a01bf96790 Bug 1655893 - docker_image.py transform should set `artifact_prefix`; r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D85232
2020-07-29 16:56:37 +00:00
Andrew Halberstadt b4a179f22b Bug 1643689 - [taskgraph] enable manifest-scheduling on autoland, r=marco
Sets autoland to use the 'bugbug' test manifest loader. This is being enabled
as part of a temporary trial to see the impact it has on sheriffing.

Differential Revision: https://phabricator.services.mozilla.com/D85011
2020-07-29 17:05:48 +00:00
Andrew Halberstadt 68f7267822 Bug 1655978 - [taskgraph] Allow missing tests in 'verify_test_packaging' if manifest scheduling is enabled, r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D85291
2020-07-29 15:34:02 +00:00
Christian Holler f6063473ab Bug 1655742 - Package gtests for fuzzing-debug build. r=truber
Differential Revision: https://phabricator.services.mozilla.com/D85153
2020-07-28 17:47:56 +00:00
Tom Prince c111c5f3d4 Bug 1628832: Make secret scope generic over trust domain; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D85177
2020-07-28 18:16:47 +00:00
Andrew Sutherland 1c5fa6b08f Bug 1653986 - Add new test metadata taskcluster searchfox task deps. r=kats
The enhancements in Bug 1653986 to display information about tests derives its
data from these 2 jobs and so it's appropriate to explicitly depend on them.

The current status of these jobs in the tree as far as I can tell is that:
- "source-test-file-metadata-test-info-all": Seems to get automatically
  triggered by someone's regularly, so it's always likely to be there for
  our searchfox cron jobs, but it's nice to not depend on that.
- "source-test-wpt-metadata-summary" : Seems to get automatically run, but
  only on commits that touch meta files change, per
  https://searchfox.org/mozilla-central/rev/cf561cece0ca9aeaf0202e68699836d957d0c670/taskcluster/ci/source-test/wpt-metadata.yml#31
  and indeed it wasn't there on today's searchfox jobs.

Differential Revision: https://phabricator.services.mozilla.com/D84933
2020-07-28 09:59:02 +00:00
Bogdan Tara 244125ea67 Backed out changeset 9be5f086895c (bug 1643689) for busting gecko decision task and causig bug 1655807 CLOSED TREE 2020-07-28 19:46:47 +03:00
Johan Lorenzo cca531a4a4 Bug 1655669 - part 2: Install snap binary because it's now required by snapcraft r=sfraser
It became mandatory in https://github.com/snapcore/snapcraft/pull/3173/files#diff-84615e6204c0bf79064d03915b64c656R196

Differential Revision: https://phabricator.services.mozilla.com/D85151
2020-07-28 15:44:25 +00:00
Johan Lorenzo 725f4f63b9 Bug 1655669 - part 1: Improve logging by notably outputting what snap dependencies are downloaded r=sfraser
Differential Revision: https://phabricator.services.mozilla.com/D85150
2020-07-28 15:31:32 +00:00
Andrew Halberstadt 512734fa0a Bug 1643689 - [taskgraph] enable manifest-scheduling on autoland, r=marco
Sets autoland to use the 'bugbug' test manifest loader. This is being enabled
as part of a temporary trial to see the impact it has on sheriffing.

Differential Revision: https://phabricator.services.mozilla.com/D85011
2020-07-28 14:40:40 +00:00
Andrew Halberstadt dfdb95e779 Bug 1636271 - Fix flake8 issue arising from merge conflict CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com/D85155
2020-07-28 14:15:27 +00:00
Andrew Halberstadt 8f7d414a21 Bug 1636271 - [taskgraph] Set autoland optimizations via per-project parameter, r=tomprince
This creates a new set of optimization strategies
(taskgraph.optimize:project.autoland) to use with autoland. Among other things,
it also means there's no need for the 'test-try' optimization as the autoland
strategies are no longer the default behaviour.

Differential Revision: https://phabricator.services.mozilla.com/D79705
2020-07-28 13:22:48 +00:00
Andrew Halberstadt 1468afcc00 Bug 1636271 - [taskgraph] Move 'optimize-strategies' from try_task_config.json to a parameter, r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D79704
2020-07-28 13:21:05 +00:00
Andrew Halberstadt c8cae8562c Bug 1636271 - [taskgraph] Create utility function for listing all tasks in a task group, r=tomprince
Creates a new utility function in 'taskgraph.util.taskcluster' to return task
definitions from a task group. Also refactors the existing
'list_task_group_incomplete_tasks' function to use it.

Differential Revision: https://phabricator.services.mozilla.com/D74407
2020-07-28 13:19:32 +00:00
Brindusan Cristian 5c589ffc95 Bug 1653171 - Updated shippable-l10n/kind.yml for trailing spaces. CLOSED TREE 2020-07-28 06:27:54 +03:00
Nick Thomas 59f1996c61 Bug 1653171 - Shorten max run time for l10n repacks, r=Callek
Windows jobs typically take 23 minutes, so limit to 30 minutes so that cloning hangs terminate earlier than 2 hours.
Mac and Linux jobs are typically 5 minutes long, so bring the limit in to 15 minutes from an hour.

Also refactors so this the max run time is only specified in the kind, rather than some in the kind and some in the transform.

Differential Revision: https://phabricator.services.mozilla.com/D85077
2020-07-28 02:02:59 +00:00
Marco Castelluccio 95435d9556 Bug 1654988 - Use response.json to parse the response from SETA. r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D84998
2020-07-27 18:09:07 +00:00
Mike Hommey 905496641e Bug 1654882 - Add a makecab toolchain. r=froydnj
This adds a makecab toolchain for Linux. It's not hooked anywhere
because bug 1654994 will also move the use of makecab to upload-symbols
tasks, so hooking the toolchain up with builds would be a waste of
time.

Differential Revision: https://phabricator.services.mozilla.com/D84789
2020-07-24 13:03:44 +00:00
Ben Hearsum c0a843be6b Bug 1650208: run opt builds by default on autoland; shippable builds by default on central r=tomprince,ahal,marco
Differential Revision: https://phabricator.services.mozilla.com/D83186
2020-07-27 16:25:40 +00:00
Andrew Halberstadt 7a6078f5fb Bug 1655499 - [taskgraph] Decode slugid to text in create_task, r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D85031
2020-07-27 18:52:22 +00:00
Gregory Mierzwinski a75df86e8b Bug 1652451 - Re-enable youtube-playback 2020 tests. r=perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D84184
2020-07-27 11:53:38 +00:00
Joel Maher 8951306649 Bug 1652881 - reduce debug build/test on mozilla-beta and mozilla-release branches r=Callek
reduce debug build/test on mozilla-beta and mozilla-release branches

Differential Revision: https://phabricator.services.mozilla.com/D84279
2020-07-22 08:33:57 +00:00
Nathan Froyd 0d1891b9cf Bug 1654845 - use new dump_syms for Mac builds; r=dmajor
Faster (although not by much) and more maintainable is good.

Depends on D84728

Differential Revision: https://phabricator.services.mozilla.com/D84729
2020-07-23 17:01:21 +00:00
Miko Mynttinen cfec27a6b4 Bug 1653982 - Enable talos tests on Mac with WebRender r=jrmuizel,perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D84178
2020-07-24 20:33:09 +00:00
Miko Mynttinen 12f626cb8d Bug 1653963 - Part 2: Enable web-platform reftests on Mac with WebRender r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D84177
2020-07-24 20:28:46 +00:00
Andrew Halberstadt d60afdfad9 Bug 1654591 - [taskgraph] Fallback all manifests if there was a timeout in the bugbug loader, r=marco
Differential Revision: https://phabricator.services.mozilla.com/D84835
2020-07-24 15:19:11 +00:00
Andrew Halberstadt 93de92455b Bug 1654591 - [taskgraph] Ensure manifest chunking doesn't prune manifests on backstop pushes, r=marco
Differential Revision: https://phabricator.services.mozilla.com/D84599
2020-07-24 15:11:16 +00:00
Andrew Halberstadt 1193a05962 Bug 1654591 - Format 'taskcluster/test' with black, r=marco
Depends on D84598

Differential Revision: https://phabricator.services.mozilla.com/D84750
2020-07-24 13:02:33 +00:00
Andrew Halberstadt b9521fc7b0 Bug 1654591 - [taskgraph] Move logic that determines a backstop to utility file, r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D84598
2020-07-23 20:25:13 +00:00
Andreea Pavel 1add6a2ce1 Bug 1641328 - delete tab spacing on a CLOSED TREE 2020-07-24 18:41:47 +03:00
Andreea Pavel 6050a45122 Bug 1641328 - delete extra space and add missing one on a CLOSED TREE 2020-07-24 18:25:57 +03:00
Andreea Pavel 2be2d6d677 Bug 1641328 - disable test_memory_usage.py on win fission r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D84830
2020-07-24 14:53:54 +00:00
Marco Castelluccio cbf78e529e Bug 1654828 - [taskgraph] Set bugbug timeout to 9 minutes for autoland and 12 minutes for try. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D84718
2020-07-23 18:01:08 +00:00
Ricky Stewart 3419d4de1d Bug 1654589 - Move `libpref` Python unit test to `mozbuild` suite r=froydnj,mccr8
It could go into its own test suite, but it 1) depends on `mozbuild` code, so the `mozbuild` suite as well as this new suite would be running on any push that touches `mozbuild` code anyway, and 2) this is code that runs during the build, so it's not out of place.

Differential Revision: https://phabricator.services.mozilla.com/D84547
2020-07-23 22:00:46 +00:00
Geoff Brown da6aa9958e Bug 1647720 - Replace fission with fission-xorigin variant, for linux64 mochitest-plain only; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D84611
2020-07-23 13:12:54 +00:00
Dorel Luca b992d3ed4c Backed out changeset 9168828ce9e9 (bug 1654589) as requested by dev for breaking fuzzy on a build. CLOSED TREE 2020-07-23 22:33:52 +03:00
Tom Prince 7e34cea23e Bug 1638990: [taskgraph] More python 3 fixes; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D84639
2020-07-23 18:01:44 +00:00
Ricky Stewart 72fd050de5 Bug 1654589 - Move `libpref` Python unit test to `mozbuild` suite r=froydnj
It could go into its own test suite, but it 1) depends on `mozbuild` code, so the `mozbuild` suite as well as this new suite would be running on any push that touches `mozbuild` code anyway, and 2) this is code that runs during the build, so it's not out of place.

Differential Revision: https://phabricator.services.mozilla.com/D84547
2020-07-23 17:30:18 +00:00
Andrew Creskey c6c9bc4f6f Bug 1648857 - Add applink perftest for the reference browser r=tarek,sparky
The Reference Browser represents our tech stack up to and including the Android-Components layer.
It would be useful to have an applink startup test for this browser to detect improvements and regressions.

Differential Revision: https://phabricator.services.mozilla.com/D81407
2020-07-23 14:11:38 +00:00
David Major 8867ebcf80 Bug 1654673 - Build dump_syms with linux64-clang-9 r=froydnj
Using the generic moving target linux64-clang adds an extra dependency that slows down clang-trunk builds.

Differential Revision: https://phabricator.services.mozilla.com/D84608
2020-07-23 00:02:57 +00:00
Narcis Beleuzu ef290a86e8 Backed out 3 changesets (bug 1636271) for breaking the Gecko Decision Task. CLOSED TREE
Backed out changeset 4b0f13fcf941 (bug 1636271)
Backed out changeset 4250f49877ba (bug 1636271)
Backed out changeset d3f93bd6b1f9 (bug 1636271)
2020-07-22 23:40:32 +03:00
Andrew Halberstadt 268c833ffc Bug 1636271 - [taskgraph] Set autoland optimizations via per-project parameter, r=tomprince
This creates a new set of optimization strategies
(taskgraph.optimize:project.autoland) to use with autoland. Among other things,
it also means there's no need for the 'test-try' optimization as the autoland
strategies are no longer the default behaviour.

Differential Revision: https://phabricator.services.mozilla.com/D79705
2020-07-22 17:09:02 +00:00
Andrew Halberstadt 8d40cc05d4 Bug 1636271 - [taskgraph] Move 'optimize-strategies' from try_task_config.json to a parameter, r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D79704
2020-07-22 15:36:55 +00:00
Andrew Halberstadt 2d5688e974 Bug 1636271 - [taskgraph] Create utility function for listing all tasks in a task group, r=tomprince
Creates a new utility function in 'taskgraph.util.taskcluster' to return task
definitions from a task group. Also refactors the existing
'list_task_group_incomplete_tasks' function to use it.

Differential Revision: https://phabricator.services.mozilla.com/D74407
2020-07-22 15:09:56 +00:00
Butkovits Atila 39f2bd0971 Backed out changeset e890ed131173 (bug 1654589) for bustage at Punion_Uncomparable.ipdl. CLOSED TREE 2020-07-22 23:01:51 +03:00
Ricky Stewart 9ac27d3247 Bug 1654589 - Move `libpref` Python unit test to `mozbuild` suite r=froydnj
It could go into its own test suite, but it 1) depends on `mozbuild` code, so the `mozbuild` suite as well as this new suite would be running on any push that touches `mozbuild` code anyway, and 2) this is code that runs during the build, so it's not out of place.

Differential Revision: https://phabricator.services.mozilla.com/D84547
2020-07-22 17:05:24 +00:00
Ricky Stewart f52f291457 Bug 1654602 - Run `xpidl` unit tests as part of `xpcom` subsuite r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D84557
2020-07-22 17:51:14 +00:00
Sebastian Hengst 28dbe41408 Bug 1654424 - Don't run webgl-ipc on trunk by default.
Differential Revision: https://phabricator.services.mozilla.com/D84466
2020-07-22 08:02:05 +00:00
Jeff Gilbert db06b9e526 Bug 1607940 - Add webgl-ipc (gli) CI variant. r=ahal,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D83290
2020-07-21 22:56:54 +00:00
Mike Hommey 39971257b1 Bug 1654158 - Improve symbols list diffs in diffoscope tasks. r=froydnj
This helps a little with the diffs from bug 1654123.

Differential Revision: https://phabricator.services.mozilla.com/D84289
2020-07-21 13:17:56 +00:00
Cosmin Sabou 1d24c0738c Bug 1641928 - Add linux64-dump-syms to valgrind/kind.yml. r=froydnj CLOSED TREE 2020-07-21 23:23:24 +03:00
Nathan Froyd 0b1387e22e Bug 1641928 - use new dump_syms for Linux builds; r=firefox-build-system-reviewers,rstewart
Faster and more maintainable is better.

Differential Revision: https://phabricator.services.mozilla.com/D83654
2020-07-21 13:07:31 +00:00
Andrew Halberstadt 357240a389 Bug 1652572 - [taskgraph] Temporarily double the bugbug timeout on try to work around perf bug, r=marco
Differential Revision: https://phabricator.services.mozilla.com/D84219
2020-07-20 20:37:58 +00:00
Gregory Mierzwinski 14830697f7 Bug 1652979 - Use org.mozilla.fenix package name in mozperftest. r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D84375
2020-07-21 17:07:00 +00:00
Nathan Froyd 8bf888eb87 Bug 1654292 - remove Cargo.toml hacks from toolchain build scripts; r=firefox-build-system-reviewers,rstewart
I suspect these were an artifact of building the checked-out repository
inside the Firefox source directory, but that is not a problem anymore.

Differential Revision: https://phabricator.services.mozilla.com/D84363
2020-07-21 17:04:49 +00:00
Ricky Stewart d2ada4e5e9 Bug 1651829 - Run Python telemetry unit tests in separate task and not in `make check` r=janerik
Differential Revision: https://phabricator.services.mozilla.com/D83131
2020-07-21 16:17:07 +00:00
Gregory Mierzwinski 4642f05a11 Bug 1609295 - Disable yahoo-mail and wikipedia on fission with webrender enabled. r=perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D84180
2020-07-21 15:00:39 +00:00
Gregory Mierzwinski a1395faaf5 Bug 1652979 - Use org.mozilla.fenix package name for raptor/browsertime tests. r=jlorenzo
Differential Revision: https://phabricator.services.mozilla.com/D83677
2020-07-21 14:45:01 +00:00
Nathan Froyd bc1c3d9c34 Bug 1652782 - add a taskcluster task for building dump_syms for Mac; r=firefox-build-system-reviewers,rstewart
We don't need this for our (current) builds, which are cross-builds, but we
would need this at some future date if we ditched the breakpad `dump_syms`.

Depends on D83528

Differential Revision: https://phabricator.services.mozilla.com/D83529
2020-07-20 21:46:52 +00:00
Nathan Froyd ebcefd4229 Bug 1652782 - remove the Cargo.toml hacks from build-dump-syms.sh; r=nalexander
I suspect these were an artifact of building the checked-out repository
inside the Firefox source directory, but that is not a problem anymore.

Differential Revision: https://phabricator.services.mozilla.com/D83528
2020-07-14 16:18:16 +00:00
Nathan Froyd 7aa28553cb Bug 1654233 - add new dump syms to Android searchfox builds; r=kats
This build was missed in the previous update.

Differential Revision: https://phabricator.services.mozilla.com/D84347
2020-07-21 13:39:27 +00:00
Razvan Maries 49a45e41a5 Backed out changeset d2c74fe4f71f (bug 1609295) for Gecko Decision Task bustage. CLOSED TREE 2020-07-21 16:13:59 +03:00
Gregory Mierzwinski 2a8f3f0c69 Bug 1609295 - Disable yahoo-mail and wikipedia on fission with webrender enabled. r=perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D84180
2020-07-21 12:26:38 +00:00
Tarek Ziadé cb88926dd6 Bug 1651624 - Add a macOS layer r=sparky
Adds a macOS layer that provides the ability to
mount DMGs on the fly. For instance Firefox's distribution.

Differential Revision: https://phabricator.services.mozilla.com/D84162
2020-07-21 12:51:58 +00:00
Andrew Creskey 07a4b7496e Bug 1653861 - Enable conditioned profiles for existing android perf tests r=tarek,sparky
Conditioned profiles allow us to re-create a more common user environment than a fresh install.

Differential Revision: https://phabricator.services.mozilla.com/D84107
2020-07-20 20:30:16 +00:00
Andrew Halberstadt fe6fcd8288 Bug 1650406 - [ci] Ensure 'upload-symbols' tasks don't cause builds to run with |mach try auto|, r=Callek,froydnj
Differential Revision: https://phabricator.services.mozilla.com/D82572
2020-07-20 19:08:36 +00:00
Andrew Halberstadt 1d0050a3ae Bug 1650406 - [ci] Ensure 'build-win64-aarch64-shippable-no-eme/opt' runs everywhere, r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D83676
2020-07-20 19:08:36 +00:00
Nathan Froyd 4f9a75cfd6 Bug 1652870 - use new dump_syms for Android builds; r=geckoview-reviewers,snorp
Faster and more maintainable is good.

Differential Revision: https://phabricator.services.mozilla.com/D83561
2020-07-20 19:02:30 +00:00
Tom Prince 2b53c0c278 Bug 1638990: [taskgraph] Apply appropriate change from python-modernize; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D84086
2020-07-20 19:27:46 +00:00
Tom Prince b5bfe5d07e Bug 1638990: [taskgraph] Store task ids as text, rather than bytes; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D84085
2020-07-20 19:27:44 +00:00
Tom Prince 3eb5c76e3a Bug 1638990: [taskgraph] Make `taskgraph.action.util.create_task_from_def` generate the task id; r=ahal
All the callers generate a fresh task id, so refactor that logic into the
function.

Differential Revision: https://phabricator.services.mozilla.com/D84084
2020-07-20 19:27:36 +00:00
Tom Prince bc2b9501bb Bug 1638990: [taskgraph] Make `taskgraph.decision.write_artifact` work on python 3; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D84083
2020-07-20 19:27:34 +00:00
Tom Prince 732240dc4a Bug 1638990: [taskgraph] Use `time.monotonic` for bugbug timing when avaiable; r=ahal
In any case, `time.time` is preferable to `time.clock` when `time.monotonic` is
not available.

Differential Revision: https://phabricator.services.mozilla.com/D84082
2020-07-20 19:27:32 +00:00
Tom Prince 6d3ff10755 Bug 1638990: [taskgraph] Make test_morph pass on python 3; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D84081
2020-07-20 19:27:24 +00:00
Tom Prince 39874ef7e9 Bug 1638990: [taskgraph] Make test_optimize pass on python 3; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D84080
2020-07-20 19:27:22 +00:00
Tom Prince f4bb27e422 Bug 1638990: [taskgraph] Make test_create pass on python 3; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D84079
2020-07-20 19:27:19 +00:00
Tom Prince e99a78f6de Bug 1638990: [taskgraph] Make test_taskcluster_yml pass on python 3; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D84078
2020-07-20 19:27:12 +00:00
Tom Prince 847aa1938f Bug 1638990: [taskgraph] Make test_util_runnable_jobs pass on python 3; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D84077
2020-07-20 19:27:09 +00:00
Tom Prince 945a1bc550 Bug 1638990: [taskgraph] Make test_util_parameterization.py pass on python 3; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D84076
2020-07-20 19:27:07 +00:00
Tom Prince e837225a92 Bug 1638990: [taskgraph] Make test_generator pass on python 3; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D84075
2020-07-20 19:26:59 +00:00
Tom Prince 65572b1ec0 Bug 1638990: [taskgraph] Make test_decision pass on python 3; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D84074
2020-07-20 19:26:57 +00:00
Tom Prince 066d97917f Bug 1638990: [taskgraph] Make test_try_option_syntax pass on python 3; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D84073
2020-07-20 19:26:47 +00:00
Tom Prince 7c05ff5c43 Bug 1653717: [taskgraph] Handle composite description nicely; r=Callek
When links to specific tasks in treeherder was added to the description in
Bug 1630710, This caused the descriptions for several derived tasks to include
the `{'task-reference': '...'}` wrapper in the derived description. This is
in addition to the already duplicate links to treeherder those tasks had.

To ameliorate this issue, keep track of the original description without the
treeherder link and use that in derived tasks.

Differential Revision: https://phabricator.services.mozilla.com/D84047
2020-07-18 15:59:27 +00:00
Kartikaya Gupta c1424e1a0c Bug 1643847 - Allow running talos-profiling jobs on QR platforms. r=perftest-reviewers,sparky
This adds the talos-profiling jobs to the relevant test-platforms so that they
can be run for Linux and Windows shippable builds with WebRender enabled.
However they are also disabled from running on m-c by default; they must be
run explicitly using `./mach try fuzzy --full` or using the TreeHerder add jobs
feature.

Differential Revision: https://phabricator.services.mozilla.com/D84011
2020-07-20 18:14:26 +00:00
Kartikaya Gupta 3424be1f06 Bug 1643847 - Remove redundant run-on-projects block. r=ahal
This block is identical to the run-on-projects applied to all the talos
profiling jobs in the defaults section at the top of the file. Therefore
it is redundant.

Differential Revision: https://phabricator.services.mozilla.com/D84010
2020-07-17 21:14:25 +00:00
Kartikaya Gupta 38770c344a Bug 1486004 - Part 18 - Update wrench to use mozdevice 4.0.0 on bitbar. r=gbrown
Since the system mozdevice version on bitbar is old, and mozharness now requires
mozdevice 4.0.0, we simply have the build job make a tarball of mozdevice 4.0.0
from the gecko source tree and export it as an artifact. The wrench job that
runs on bitbar can unpack the tarball and add it to the python path so it gets
picked up.

Differential Revision: https://phabricator.services.mozilla.com/D84070
2020-07-20 15:51:45 +00:00
Andrew Halberstadt 85e7c622aa No bug: [taskgraph] Simplify bugbug strategies; r=ahal
This change the strategy aliases that have bugbug, so that they handle the extra
arguments that are needed by bugbug.

Differential Revision: https://phabricator.services.mozilla.com/D83438
2020-07-20 15:10:41 +00:00
Johan Lorenzo b651a3366d Bug 1631839 - Update mobile routes to use new namespace r=tarek,sparky,acreskey
Differential Revision: https://phabricator.services.mozilla.com/D81038
2020-07-17 16:00:57 +00:00