This mechanical transform lays the foundation for generalizing the
underlying test runner.
Differential Revision: https://phabricator.services.mozilla.com/D37132
--HG--
extra : moz-landing-system : lando
Bug 1547135 added functionality to configure specific Android devices
for performance tests. That code landed as part of device setup in
`testing/raptor/raptor.py` but there is nothing Raptor-specific
(indeed, nothing harness-specific) about this configuration.
Rather than lift it to `mozdevice`, this commit moves it into a
`performance_tuning` module. That's enough to slim down `raptor.py`.
Differential Revision: https://phabricator.services.mozilla.com/D37128
--HG--
extra : moz-landing-system : lando
Handle the exception ADBProcessError raised by
thermal_zone0 = self.device.shell_output('cat sys/class/thermal/thermal_zone0/temp')
on the emulator
Differential Revision: https://phabricator.services.mozilla.com/D38859
--HG--
extra : moz-landing-system : lando
Added the crash method for RaptorLogger class,
which will call structuredlog.py crash method.
Differential Revision: https://phabricator.services.mozilla.com/D38055
--HG--
extra : moz-landing-system : lando
This patch adds an additional data output to android power tests. This data is the power usage of the test calculated as a percentage increase relative to the OS baseline. test_power.py needed to be changed to accommodate these changes as well.
Differential Revision: https://phabricator.services.mozilla.com/D37462
--HG--
extra : moz-landing-system : lando
Changed the required yml, ini, json, js and html files to migrate ARES6 benchmark test to Raptor.
Differential Revision: https://phabricator.services.mozilla.com/D34178
--HG--
extra : moz-landing-system : lando
This avoids error messages about missing minidump directories when an unrelated failure aborts a run before launching the test app.
Differential Revision: https://phabricator.services.mozilla.com/D36925
--HG--
extra : moz-landing-system : lando
This patch adds three unit tests (in one file) to the set of the raptor tests. The tests include (i) an Android 8 power parsing test, (ii) an android 7 power parsing test, and (iii) a test for android OS baseline parsing (tested using android 8 data).
Differential Revision: https://phabricator.services.mozilla.com/D36926
--HG--
extra : moz-landing-system : lando
For the Raptor 'scenario' test type, this patch prevents PERFHERDER_DATA from being output when `--power-test`, `--cpu-test`, or `--memory-test` are not used.
Differential Revision: https://phabricator.services.mozilla.com/D31665
--HG--
extra : moz-landing-system : lando
This patch adds an Android OS baseline test which runs before all tests when '--power-test' is supplied. The data is then added to the test's PERFHERDER_DATA blob as power data that is suffixed with '-baseline'.
Differential Revision: https://phabricator.services.mozilla.com/D33238
--HG--
extra : moz-landing-system : lando
This patch makes Raptor check if the web extension was installed before attempting to uninstall it.
Differential Revision: https://phabricator.services.mozilla.com/D36622
--HG--
extra : moz-landing-system : lando
RaptorLogger class is using object composition to create its logger field.
Because the inheritance is not used to achieve that, there is no need to extend ProxyLogger class.
Differential Revision: https://phabricator.services.mozilla.com/D35661
--HG--
extra : moz-landing-system : lando
This patch adds idle browser (*-idle-bg)tests to Raptor which have the app running on about:blank in the background for 20 minutes. It adds the 'background_test' flag to 'scenario' type Raptor tests to make a test run in the background. Furthermore, a unit test is added to the Raptor control server tests as well as methods to check if the app was properly backgrounded or foregrounded.
Differential Revision: https://phabricator.services.mozilla.com/D32428
--HG--
extra : moz-landing-system : lando
This patch fixes the regular expressions used to parse power usage info from `batterystats` output on Android 7+. With these changes, we no longer intermittently obtain measurements (such as `proportional`) due to pattern matching failures.
Differential Revision: https://phabricator.services.mozilla.com/D35665
--HG--
extra : moz-landing-system : lando
Nick Alexander
Marian Raiciof
Gijs Kruitbosch
Gregory Mierzwinski
alexandru.ionescu
Florin Strugariu
Alexandru Irimovici
Rob Wood
Geoff Brown
Henrik Skupin
Victor Porof
Ionut Goldan
Kartikaya Gupta
Armen Zambrano G.
Stephen Donner
krubin
Arnold Iakab