This patch adds a new layer that allows developers to run mochitest tests as performance tests directly. It provides the ability to run them in CI on linux, and locally through `./mach test` using the FunctionalTestRunner. Some additional try mapping is also added for future tests. The remote run (CI) method uses the mochitest run_test_harness method directly, along with the mochitest argument parser.
Differential Revision: https://phabricator.services.mozilla.com/D190994
This patch adds portable baseline builds for SpiderMonkey on both the
native Linux/x86-64 test platform and on `wasm32-wasi`, and runs tests
on the former.
Differential Revision: https://phabricator.services.mozilla.com/D190973
Chromium-as-Release (CaR) is a custom upstream chromium build (configured as "release")
On the desktop platform we have these builds running already.
This patch adds support for custom-car Android builds to be useable in performance testing.
Since android tests are run on a linux host, we make use of the existing chromium linux chromedriver fetch.
At the moment we only want the performance tests to run on speedometer.
Differential Revision: https://phabricator.services.mozilla.com/D191212
This patch adds the ability to build custom chromium-as-release (CaR) for the android platform (arm64).
A linux host is used for the android builds so a new dockerfile is added to maintain as either platform (e.g. Linux and Android) may
have differing dependencies and potentially diverge further in the future.
We can look into consolidating them into one dockerfile later if needed.
Differential Revision: https://phabricator.services.mozilla.com/D189604
On OSX, depending on the node used to build python, lzma support was
available or not (depending on local setup). Then it could fail at
runtime if another node was used.
Build xz from source and use it as a build dependency to always provide
lzma on OSX, as we already do on Linux and Windows.
As a side effect, provide more verbose output during the post link
process.
Differential Revision: https://phabricator.services.mozilla.com/D191044
Adding a wait time greater than the default 900s (now 1500s) for the
wasm-misc-baseline benchmark fixes the permafail occuring on the linux
platform.
Differential Revision: https://phabricator.services.mozilla.com/D191132
If called with no arguments it'll update all files (except try.yml and
mr-onpush-geckoview.yml). It can also be called with a set of filenames
as arguments and will update just those files.
For on-push and cron tasks, we look up the taskcluster index for the
latest corresponding decision task. For release promotion actions, we
query the public shipit API to find the latest matching task.
Differential Revision: https://phabricator.services.mozilla.com/D187137
If called with no arguments it'll update all files (except try.yml and
mr-onpush-geckoview.yml). It can also be called with a set of filenames
as arguments and will update just those files.
For on-push and cron tasks, we look up the taskcluster index for the
latest corresponding decision task. For release promotion actions, we
query the public shipit API to find the latest matching task.
Differential Revision: https://phabricator.services.mozilla.com/D187137
We are temporarily disabling speedometer3 tests on mac osx1300 M2s while we debug issues related to tests taking much longer to complete than it should
Depends on D188866
Differential Revision: https://phabricator.services.mozilla.com/D190801
It was noted by a performance engineer that we are using the interactive runner for testing speedometer rather than the regular runner.
This patch modifies speedometer to use that runner for desktop and mobile
Differential Revision: https://phabricator.services.mozilla.com/D188866
This happened because I made changes to `--target-kind` in upstream Taskgraph,
but forgot to sync the `main.py` bits over to `gecko_taskgraph`.
Differential Revision: https://phabricator.services.mozilla.com/D190807
In some recent changes upstream, a function caching method was added that
uses functionality introduced in python 3.8. Presently the OSX workers
only have 3.7 by default, so this patch fetches the 3.8 toolchain and
makes use of that binary instead.
Differential Revision: https://phabricator.services.mozilla.com/D190388
Greg Mierzwinski
Mike Hommey
Jesse Schwartzentruber
Joel Maher
Tooru Fujisawa
Chris Fallin
Ryan VanderMeulen
Kash Shampur
Sylvestre Ledru
serge-sans-paille
Gabriele Svelto
Norisz Fay
Julien Cristau
Gregory Pappas
Narcis Beleuzu
Cosmin Sabou
Erich Gubler
andrej
Alexandre Lissy
Andrew Halberstadt
Heitor Neiva
Noemi Erli