Граф коммитов

324 Коммитов

Автор SHA1 Сообщение Дата
Henrik Skupin 4af7918854 Bug 1509877 - [raptor] Refactor mach script for code readability and PEP 8. r=perftest-reviewers,Bebe
Depends on D32801

Differential Revision: https://phabricator.services.mozilla.com/D32802

--HG--
extra : moz-landing-system : lando
2019-05-31 14:43:39 +00:00
Henrik Skupin cb6ce127a9 Bug 1509877 - [raptor] Allow the use of a custom binary for desktop browsers. r=sparky
Depends on D32800

Differential Revision: https://phabricator.services.mozilla.com/D32801

--HG--
extra : moz-landing-system : lando
2019-05-31 00:04:35 +00:00
Henrik Skupin 7ab8eca5d6 Bug 1509877 - [raptor] Fix detection of Android as platform. r=Bebe
Differential Revision: https://phabricator.services.mozilla.com/D32800

--HG--
extra : moz-landing-system : lando
2019-05-31 14:43:05 +00:00
Gregory Mierzwinski 8ed4beb45e Bug 1555748 - Remove proportional power usage measurement from perfherder data on Android 7 and lower. r=perftest-reviewers,rwood
This patch prevents proportional power usage data from being output when the android version is 7 or lower since it does not exist on these OS versions.

Differential Revision: https://phabricator.services.mozilla.com/D33214

--HG--
extra : moz-landing-system : lando
2019-05-31 18:44:50 +00:00
Noemi Erli e28515ee12 Backed out changeset 9137795c6779 (bug 1544470) for linting failure in raptor.py CLOSED TREE 2019-05-30 22:56:54 +03:00
Chris Hartjes d03d62e5f9 Bug 1544470 - Added in code that can be used to take a snapshot of CPU usage on Android devices; r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D27954

--HG--
extra : moz-landing-system : lando
2019-05-30 19:33:08 +00:00
Arnold Iakab 3a496ddefa Bug 1554681 Re-record youtube.com to reflect Polymer update Desktop r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D32998

--HG--
extra : moz-landing-system : lando
2019-05-30 13:06:00 +00:00
Alexandru Irimovici 7b87be76cf Bug 1449572 - Bug 1449571 - raptor unit test for pageload timeouts r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D32670

--HG--
extra : moz-landing-system : lando
2019-05-29 19:23:13 +00:00
Rob Wood 09454f678d Bug 1554311 - Start page timeout timer only after the test tab has actually been updated r=acreskey
Differential Revision: https://phabricator.services.mozilla.com/D32531

--HG--
extra : moz-landing-system : lando
2019-05-27 17:48:42 +00:00
alexandru.ionescu a712b0f753 Bug 1546119 Raptor warm page-load tests on Firefox android fenix r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D32101

--HG--
extra : moz-landing-system : lando
2019-05-27 17:56:14 +00:00
Henrik Skupin 6689e0a3a3 Bug 1554645 - [raptor] Use dedicated message type for shutting down the browser. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D32683

--HG--
extra : moz-landing-system : lando
2019-05-27 18:48:44 +00:00
Ivan Yung b4030f9fc6 Bug 1545117: added message which includes the local perf-automation github repo clone path r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D31177

--HG--
extra : moz-landing-system : lando
2019-05-15 14:27:57 +00:00
alexandru.ionescu fa583b7a2f Bug 1545055 Run warm page load tests against Fennec v64 in CI r=Bebe,stephendonner
Differential Revision: https://phabricator.services.mozilla.com/D31770

--HG--
extra : moz-landing-system : lando
2019-05-24 11:19:07 +00:00
Henrik Skupin 59b691b66e Bug 1546880 - [raptor] Remove proxy workaround from raptor-youtube-playback tests. r=perftest-reviewers,stephendonner
Differential Revision: https://phabricator.services.mozilla.com/D32378

--HG--
extra : moz-landing-system : lando
2019-05-24 05:36:42 +00:00
alexandru.ionescu 2f37f5f55a Bug 1546323 Run cold page load tests against Fennec v64 in CI r=Bebe
Differential Revision: https://phabricator.services.mozilla.com/D31773

--HG--
extra : moz-landing-system : lando
2019-05-24 07:12:19 +00:00
Stephen Donner 168232fa40 Bug 1553623: Fix typos in Raptor's cmdline.py; r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D32215

--HG--
extra : moz-landing-system : lando
2019-05-22 21:12:28 +00:00
Henrik Skupin a85b69685d Bug 1552484 - [raptor] Add geckoview support to raptor-youtube-playback test suite. r=perftest-reviewers,rwood
Adding those tests with the premise to run all the videos as muted,
at least as long as bug 1547717 hasn't been fixed.

Differential Revision: https://phabricator.services.mozilla.com/D32040

--HG--
extra : moz-landing-system : lando
2019-05-22 14:27:14 +00:00
Andrew Creskey ad2afb1825 Bug 1550075 - Add android user profile to raptor, enable smart disk cache sizing r=rwood
A new user profile, raptor-android, was added. This profile is merged with existing profiles in RaptorAndroid.
browser.cache.disk.smart_size.enabled was enabled in test since it is enabled in shipped apps.
See https://searchfox.org/mozilla-central/rev/11cfa0462a6b5d8c5e2111b8cfddcf78098f0141/mobile/android/app/mobile.js#74

Differential Revision: https://phabricator.services.mozilla.com/D31336

--HG--
extra : moz-landing-system : lando
2019-05-22 13:23:05 +00:00
Brindusan Cristian 5b1da8059b Backed out changeset 09df445cbdd9 (bug 1550075) for f8 linting failure at raptor.py:857:10. CLOSED TREE 2019-05-22 15:47:40 +03:00
Andrew Creskey d3c69a3d77 Bug 1550075 - Add android user profile to raptor, enable smart disk cache sizing r=rwood
A new user profile, raptor-android, was added. This profile is merged with existing profiles in RaptorAndroid.
browser.cache.disk.smart_size.enabled was enabled in test since it is enabled in shipped apps.
See https://searchfox.org/mozilla-central/rev/11cfa0462a6b5d8c5e2111b8cfddcf78098f0141/mobile/android/app/mobile.js#74

Differential Revision: https://phabricator.services.mozilla.com/D31336

--HG--
extra : moz-landing-system : lando
2019-05-22 12:13:47 +00:00
alexandru.ionescu 1a8f3c3864 Bug 1543369 Raptor cold page-load tests on Firefox android fennec r=Bebe
Differential Revision: https://phabricator.services.mozilla.com/D31251

--HG--
extra : moz-landing-system : lando
2019-05-21 12:03:03 +00:00
Cosmin Sabou 17df5e7158 Backed out changeset 5862c607fcc2 (bug 1550075) for eslint failure on raptor-android/user.js. 2019-05-22 01:50:11 +03:00
Andrew Creskey 8cd21a5822 Bug 1550075 - Add android user profile to raptor, enable smart disk cache sizing r=rwood
A new user profile, raptor-android, was added. This profile is merged with existing profiles in RaptorAndroid.
browser.cache.disk.smart_size.enabled was enabled in test since it is enabled in shipped apps.
See https://searchfox.org/mozilla-central/rev/11cfa0462a6b5d8c5e2111b8cfddcf78098f0141/mobile/android/app/mobile.js#74

Differential Revision: https://phabricator.services.mozilla.com/D31336

--HG--
extra : moz-landing-system : lando
2019-05-21 22:13:07 +00:00
Henrik Skupin c69340b591 Bug 1548845 - [raptor] Integrate Youtube video playback performance suite as benchmark test. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30483

--HG--
extra : moz-landing-system : lando
2019-05-17 20:16:12 +00:00
Gregory Mierzwinski d36b68fefc Bug 1552548 - Set screen brightness to 50% on reference phones for power tests. r=perftest-reviewers,stephendonner
This patch sets the screen brightness on the reference Moto G5 and Pixel 2 phones to 50% before starting power tests and resets it to its original value once the test is complete.

Differential Revision: https://phabricator.services.mozilla.com/D31662

--HG--
extra : moz-landing-system : lando
2019-05-18 14:01:05 +00:00
Stephen Donner 6d86a346d7 Bug 1551324: Hook up remaining Fennec and Fenix jobs in CI for scn-power-idle tests. r=perftest-reviewers,rwood,sparky
Differential Revision: https://phabricator.services.mozilla.com/D31025

--HG--
extra : moz-landing-system : lando
2019-05-18 00:10:05 +00:00
Henrik Skupin 25e8969644 Bug 1548845 - [raptor] Don't filter-out tests which are white-listed for "use_live_sites". r=perftest-reviewers,stephendonner,rwood
Depends on D31681

Differential Revision: https://phabricator.services.mozilla.com/D31682

--HG--
extra : moz-landing-system : lando
2019-05-17 20:58:12 +00:00
Henrik Skupin 53ac5b9613 Bug 1548845 - [raptor] Log discarded tests in filter_live_sites. r=perftest-reviewers,rwood
Depends on D30532

Differential Revision: https://phabricator.services.mozilla.com/D31681

--HG--
extra : moz-landing-system : lando
2019-05-17 20:45:13 +00:00
Henrik Skupin bc20797022 Bug 1548845 - [raptor] Fix local import of filter module. r=perftest-reviewers,rwood
To not collide with the built-in "filter" method, the local
filter module should be named as filters.

Differential Revision: https://phabricator.services.mozilla.com/D30532

--HG--
rename : testing/raptor/raptor/filter.py => testing/raptor/raptor/filters.py
extra : moz-landing-system : lando
2019-05-17 20:16:12 +00:00
Henrik Skupin 4e8e65b9a9 Bug 1548845 - [raptor] Allow tests to specify the alertChangeType. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30531

--HG--
extra : moz-landing-system : lando
2019-05-17 20:14:25 +00:00
Henrik Skupin a092be21b1 Bug 1548845 - [raptor] Use a multiplier for page timeout when using live sites. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30530

--HG--
extra : moz-landing-system : lando
2019-05-17 20:14:23 +00:00
Rob Wood 8fdc5e82c4 Bug 1551972 - Fix Fenix cold page load by clearing app data before subsequent subtests; #perftest-reviewers r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D31632

--HG--
extra : moz-landing-system : lando
2019-05-17 16:55:05 +00:00
Mihai Alexandru Michis 724354e338 Backed out 5 changesets (bug 1548845) for failing new youtube playback raptor tests. CLOSED TREE
Backed out changeset 934d2f88195d (bug 1548845)
Backed out changeset 609f489bdc8c (bug 1548845)
Backed out changeset a2544ca8c593 (bug 1548845)
Backed out changeset 152615db9db6 (bug 1548845)
Backed out changeset 6b3a8394727f (bug 1548845)

--HG--
rename : testing/raptor/raptor/filters.py => testing/raptor/raptor/filter.py
2019-05-17 16:17:06 +03:00
Henrik Skupin 85b0987a4f Bug 1548845 - [raptor] Integrate Youtube video playback performance suite as benchmark test. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30483

--HG--
extra : moz-landing-system : lando
2019-05-17 11:12:53 +00:00
Henrik Skupin 992c3cdb7d Bug 1548845 - [raptor] Fix local import of filter module. r=perftest-reviewers,rwood
To not collide with the built-in "filter" method, the local
filter module should be named as filters.

Differential Revision: https://phabricator.services.mozilla.com/D30532

--HG--
rename : testing/raptor/raptor/filter.py => testing/raptor/raptor/filters.py
extra : moz-landing-system : lando
2019-05-17 11:12:40 +00:00
Henrik Skupin 11d84bf86a Bug 1548845 - [raptor] Allow tests to specify the alertChangeType. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30531

--HG--
extra : moz-landing-system : lando
2019-05-17 11:12:20 +00:00
Henrik Skupin 9eeae6d8c8 Bug 1548845 - [raptor] Use a multiplier for page timeout when using live sites. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30530

--HG--
extra : moz-landing-system : lando
2019-05-17 11:12:02 +00:00
Edwin Gao d05d708389 Bug 1552000 - move root-required tuning commands to its appropriate location for Raptor Android r=acreskey
Changes:

- move the I/O scheduler modification subroutine under the block that checks for `root` availability of device.

This change should not be visible on CI systems; all devices there are already rooted. Where this change makes an impact is for developers running Raptor Android tests on non-rooted devices.

Differential Revision: https://phabricator.services.mozilla.com/D31339

--HG--
extra : moz-landing-system : lando
2019-05-16 11:57:31 +00:00
shindli d1ef75d446 Backed out changeset 90a51dbd6ee1 (bug 1528236) for causing permafailures in raptor tests CLOSED TREE 2019-05-15 00:48:21 +03:00
Henrik Skupin dceb981485 Bug 1528236 - [raptor] Use opt-out mechanism for setting test specific preferences. r=perftest-reviewers,stephendonner
Due to missing class abstractions for Gecko- and non-Gecko based
browsers it's currently sub-optimal to define when preferences
as defined by tests will be set.

Given that by default we run Gecko-based applications other
browsers should opt-out from setting test preferences.

Differential Revision: https://phabricator.services.mozilla.com/D30923

--HG--
extra : moz-landing-system : lando
2019-05-14 19:32:27 +00:00
Henrik Skupin 22364e41eb Bug 1528236 - [raptor] Fix root permission failures for device tuning. r=perftest-reviewers,stephendonner
Differential Revision: https://phabricator.services.mozilla.com/D30922

--HG--
extra : moz-landing-system : lando
2019-05-14 19:29:53 +00:00
Henrik Skupin 1fb0816fdd Bug 1528236 - [raptor] Environment variables should not be set via extra args. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29333

--HG--
extra : moz-landing-system : lando
2019-05-14 19:32:15 +00:00
Henrik Skupin 33461df3ea Bug 1528236 - [raptor] Update profile building code to align with mochitests. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29332

--HG--
extra : moz-landing-system : lando
2019-05-14 19:32:13 +00:00
Henrik Skupin d93887ea36 Bug 1528236 - [raptor] Use constructor for initialization of raptor instances. r=perftest-reviewers,rwood
The patch tries to reduce the amount of initialization code
to call when creating a new Raptor class.

Initializing the ADBDevice already in the constructor of the
RaptorAndroid class is currently not possible because it would
mean that a device is immediately created but the "adb" binary
is not available for python test jobs. This has to be fixed later.

Differential Revision: https://phabricator.services.mozilla.com/D29331

--HG--
extra : moz-landing-system : lando
2019-05-14 19:32:11 +00:00
Henrik Skupin c1ba84a470 Bug 1528236 - [raptor] Allow Raptor to run the tests all at once. r=perftest-reviewers,stephendonner,rwood
Differential Revision: https://phabricator.services.mozilla.com/D31047

--HG--
extra : moz-landing-system : lando
2019-05-14 19:32:01 +00:00
Henrik Skupin d529cab0f1 Bug 1528236 - [raptor] Remove test root folder during clean-up. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29330

--HG--
extra : moz-landing-system : lando
2019-05-14 19:31:57 +00:00
Henrik Skupin 908e40dddf Bug 1528236 - [raptor] Refactor handling of remote profiles. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29329

--HG--
extra : moz-landing-system : lando
2019-05-14 19:30:11 +00:00
alexandru.ionescu 40ff099e27 Bug 1549669 - [raptor] Handle "--disable-e10s" argument to avoid causing fennec tests to fail r=perftest-reviewers,whimboo,ahal,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30171

--HG--
extra : moz-landing-system : lando
2019-05-14 11:50:00 +00:00
Stephen Donner 2c218a311e Bug 1548689: Hook idle-power-usage tests up to CI. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30456

--HG--
extra : moz-landing-system : lando
2019-05-13 20:33:15 +00:00
Stephen Donner 4a55597f03 Bug 1550828: String fixes and minor cleanup for power.py and Raptor's mach_commands.py. r=bc
Differential Revision: https://phabricator.services.mozilla.com/D30775

--HG--
extra : moz-landing-system : lando
2019-05-11 08:13:29 +00:00