This patch modifies the target tasks so that we don't run the sp3 tests
more than once a day for the Android custom-CaR application. This is for
consistency as this is already taken care of in the
`custom-car_perf_testing` which handles custom-car for all platforms.
Differential Revision: https://phabricator.services.mozilla.com/D192518
This patch sets up the paths for DMG extraction for Mochitest mozperftest tests. It also adds some additional artifacts for the mac tests to pull and extract.
Differential Revision: https://phabricator.services.mozilla.com/D192071
This does the plumbing work for adding jobs here. a few things remain:
1) getting the resolution to be ideal on the machines, right now it
fails to adjust
2) getthing the mda-gpu job green
3) setting the branches to run on for mda-gpu hw-ref
Differential Revision: https://phabricator.services.mozilla.com/D192681
Removes the direct relationship between hardened-signing type (production/developer) and project/release level. Having them separate should make it more explicit on when to use production entitlements or not.
Differential Revision: https://phabricator.services.mozilla.com/D191705
To close the gap in performance testing on Android and Desktop, as well as a new governance model which leads us to believe motionmark will be more relavent in the future we are adding the motionmark benchmark to android
Differential Revision: https://phabricator.services.mozilla.com/D191086
There's no reason we need to back out all of the attribution job changes - we can just pull the dmgs directly from `repackage` instead.
Differential Revision: https://phabricator.services.mozilla.com/D192599
The docker image is actually old, and they recently changed their
repo certificate, making the url hardcoded in the docker image fail.
Fix that up manually before doing anything.
While we're here, we can remove the mercurial workaround, as voidlinux
has contained a fixed version of mercurial for a while now.
Differential Revision: https://phabricator.services.mozilla.com/D192506
This patch adds some code to handle when the virtualenv lib path changes between the different platforms. In this case, the change makes it possible to use mochitest-mozperftest on winows machines in CI. It also adds some additional artifacts that the windows tests need to pull.
Differential Revision: https://phabricator.services.mozilla.com/D191741
Reverts the order of transforms so padding happens after task-context
Prevents run-task from removing the tab characters when passing in the values to bash
Differential Revision: https://phabricator.services.mozilla.com/D191696
Portable Baseline (PBL) is a tier-2 SpiderMonkey feature. The patch to
add PBL builds and tests to CI inadvertently missed a `tier: 2` option
on one of the jobs; this patch fixes that.
Differential Revision: https://phabricator.services.mozilla.com/D191808
This patch adds a new layer that allows developers to run mochitest tests as performance tests directly. It provides the ability to run them in CI on linux, and locally through `./mach test` using the FunctionalTestRunner. Some additional try mapping is also added for future tests. The remote run (CI) method uses the mochitest run_test_harness method directly, along with the mochitest argument parser.
Differential Revision: https://phabricator.services.mozilla.com/D190994
This patch adds portable baseline builds for SpiderMonkey on both the
native Linux/x86-64 test platform and on `wasm32-wasi`, and runs tests
on the former.
Differential Revision: https://phabricator.services.mozilla.com/D190973
Chromium-as-Release (CaR) is a custom upstream chromium build (configured as "release")
On the desktop platform we have these builds running already.
This patch adds support for custom-car Android builds to be useable in performance testing.
Since android tests are run on a linux host, we make use of the existing chromium linux chromedriver fetch.
At the moment we only want the performance tests to run on speedometer.
Differential Revision: https://phabricator.services.mozilla.com/D191212
This patch adds the ability to build custom chromium-as-release (CaR) for the android platform (arm64).
A linux host is used for the android builds so a new dockerfile is added to maintain as either platform (e.g. Linux and Android) may
have differing dependencies and potentially diverge further in the future.
We can look into consolidating them into one dockerfile later if needed.
Differential Revision: https://phabricator.services.mozilla.com/D189604
On OSX, depending on the node used to build python, lzma support was
available or not (depending on local setup). Then it could fail at
runtime if another node was used.
Build xz from source and use it as a build dependency to always provide
lzma on OSX, as we already do on Linux and Windows.
As a side effect, provide more verbose output during the post link
process.
Differential Revision: https://phabricator.services.mozilla.com/D191044
Adding a wait time greater than the default 900s (now 1500s) for the
wasm-misc-baseline benchmark fixes the permafail occuring on the linux
platform.
Differential Revision: https://phabricator.services.mozilla.com/D191132
Mike Hommey
Andrew Halberstadt
Heitor Neiva
KS
Greg Mierzwinski
Joel Maher
Cristian Tuns
ahochheiden
Logan Rosen
Norisz Fay
owlishDeveloper
Bobby Holley
andrej
Ben Hearsum
ChaseKnowlden
Gabriele Svelto
Alex Ionescu
Rob Lemley
Chris Fallin
Jesse Schwartzentruber
Tooru Fujisawa
Ryan VanderMeulen
Kash Shampur
Sylvestre Ledru
serge-sans-paille
Julien Cristau