Граф коммитов

477 Коммитов

Автор SHA1 Сообщение Дата
Armen Zambrano G. 53bd62e369 Bug 1559975 - Python3 linting changes for raptor r=Callek,rwood
Differential Revision: https://phabricator.services.mozilla.com/D35252

--HG--
extra : moz-landing-system : lando
2019-06-24 20:50:14 +00:00
Stephen Donner 18d79cb494 Bug 1549631 - Add new target app (browser) backgrounded, idle-power-use test. r=rwood,AlexandruIonescu
This patch adds idle browser (*-idle-bg)tests to Raptor which have the app running on about:blank in the background for 20 minutes. It adds the 'background_test' flag to 'scenario' type Raptor tests to make a test run in the background. Furthermore, a unit test is added to the Raptor control server tests as well as methods to check if the app was properly backgrounded or foregrounded.

Differential Revision: https://phabricator.services.mozilla.com/D32428

--HG--
extra : moz-landing-system : lando
2019-06-28 08:46:35 +00:00
Gregory Mierzwinski 59458ab5f3 Bug 1555796 - Fix regular expressions for Android power usage parsing. r=perftest-reviewers,davehunt
This patch fixes the regular expressions used to parse power usage info from `batterystats` output on Android 7+. With these changes, we no longer intermittently obtain measurements (such as `proportional`) due to pattern matching failures.

Differential Revision: https://phabricator.services.mozilla.com/D35665

--HG--
extra : moz-landing-system : lando
2019-06-27 13:59:35 +00:00
krubin 77a7501e88 Bug 1559247 - Don't post screenshot data when console logging control server message data r=igoldan
Differential Revision: https://phabricator.services.mozilla.com/D35696

--HG--
extra : moz-landing-system : lando
2019-06-25 06:20:49 +00:00
alexandru.ionescu 7e04db4516 Bug 1560861 Fix ini for re-record wikipedia.org r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D35637

--HG--
extra : moz-landing-system : lando
2019-06-26 09:25:44 +00:00
Arnold Iakab 9dea54581e Bug 1559926 Re-record paypal.com desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,AlexandruIonescu,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D35663

--HG--
extra : moz-landing-system : lando
2019-06-25 11:53:03 +00:00
alexandru.ionescu fde78d4e4e Bug 1560489 Fix youtube mobile recording archive r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D35514

--HG--
extra : moz-landing-system : lando
2019-06-26 07:22:21 +00:00
Alexandru Irimovici 362a4dbee9 Bug 1559934 - Re-record yandex.ru desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D35779

--HG--
extra : moz-landing-system : lando
2019-06-26 07:17:10 +00:00
Rob Wood 6ee9f5bea3 Bug 1546661 - Enable cold page loads tests for Reference Browser on Try r=perftest-reviewers,Bebe,sparky
Differential Revision: https://phabricator.services.mozilla.com/D35568

--HG--
extra : moz-landing-system : lando
2019-06-25 08:28:58 +00:00
Arnold Iakab a105e5d2c9 Bug 1559952 Re-record office.live.com desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,AlexandruIonescu,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D35660

--HG--
rename : testing/raptor/raptor/playback/mitm4-linux-firefox-netflix.manifest => testing/raptor/raptor/playback/mitm4-linux-firefox-office.manifest
extra : moz-landing-system : lando
2019-06-25 11:53:44 +00:00
Arnold Iakab 811b6f3395 Bug 1559953 Re-record pinterest.com desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,AlexandruIonescu,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D35666

--HG--
extra : moz-landing-system : lando
2019-06-25 11:48:45 +00:00
Florin Strugariu 4ca6687292 Bug 1559930 Re-record sheets desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D35520

--HG--
extra : moz-landing-system : lando
2019-06-25 10:24:31 +00:00
Florin Strugariu da775a1209 Bug 1559929 Re-record slides desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D35519

--HG--
extra : moz-landing-system : lando
2019-06-25 10:25:24 +00:00
Florin Strugariu 1b0ff14373 Bug 1559928 Re-record docs desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D35518

--HG--
extra : moz-landing-system : lando
2019-06-25 10:26:39 +00:00
Marian Raiciof 1dc815708d Bug 1559943 - Re-record instagram.com desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,AlexandruIonescu,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D35643

--HG--
extra : moz-landing-system : lando
2019-06-25 09:15:08 +00:00
Marian Raiciof 325a1515c1 Bug 1559947 - Re-record linkedin.com desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,AlexandruIonescu,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D35644

--HG--
extra : moz-landing-system : lando
2019-06-25 09:13:54 +00:00
Marian Raiciof bbdecee0c2 Bug 1559932 - Re-record imgur.com desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D35638

--HG--
extra : moz-landing-system : lando
2019-06-24 16:43:26 +00:00
Ionut Goldan a86a9729c8 Bug 1559942 - Re-record twitter.com desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,Bebe,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D35406

--HG--
extra : moz-landing-system : lando
2019-06-24 08:51:34 +00:00
Ionut Goldan 9dee7ab691 Bug 1559933 - Re-record imdb.com desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,Bebe,AlexandruIonescu,alexandru.irimovici
Differential Revision: https://phabricator.services.mozilla.com/D35409

--HG--
extra : moz-landing-system : lando
2019-06-24 10:45:45 +00:00
Alexandru Irimovici 6d181cc6b2 Bug 1559936 - Re-record apple.com desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,AlexandruIonescu,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D35530

--HG--
extra : moz-landing-system : lando
2019-06-24 08:41:16 +00:00
Alexandru Irimovici 440c0d0210 Bug 1559935 - Re-record bing.com desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,Bebe,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D35524

--HG--
extra : moz-landing-system : lando
2019-06-24 08:33:04 +00:00
Arnold Iakab f82e56ab72 Bug 1541385 Undefined behavior for None as timeout value r=perftest-reviewers,igoldan
Differential Revision: https://phabricator.services.mozilla.com/D32317

--HG--
extra : moz-landing-system : lando
2019-06-18 09:21:30 +00:00
Arnold Iakab e4eef887bc Bug 1559937 Re-record reddit.com desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D35407

--HG--
extra : moz-landing-system : lando
2019-06-20 12:52:03 +00:00
Arnold Iakab bcfe5b8569 Bug 1559939 Re-record yahoo.com desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,Bebe,alexandru.irimovici
Differential Revision: https://phabricator.services.mozilla.com/D35405

--HG--
extra : moz-landing-system : lando
2019-06-24 08:31:48 +00:00
Florin Strugariu 45daa4fe3f Bug 1560266 Cleanup raptor tp6-1 manifest file after rerecordings r=AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D35408

--HG--
extra : moz-landing-system : lando
2019-06-21 11:45:02 +00:00
Florin Strugariu 3b8549864f Bug 1559925 Re-record amazon.com desktop tp6 pages using mitmproxy 4 r=AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D35323

--HG--
extra : moz-landing-system : lando
2019-06-21 12:05:38 +00:00
Florin Strugariu 9ffadd41b5 Bug 1559922 Re-record facebook.com desktop tp6 pages using mitmproxy 4 r=AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D35322

--HG--
extra : moz-landing-system : lando
2019-06-21 10:54:12 +00:00
Florin Strugariu f4a7cf6309 Bug 1559924 Re-record youtube.com desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,AlexandruIonescu,alexandru.irimovici
Differential Revision: https://phabricator.services.mozilla.com/D35319

--HG--
extra : moz-landing-system : lando
2019-06-24 08:23:28 +00:00
Florin Strugariu 8c28c081f2 Bug 1559918 Re-record google.com desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D35318

--HG--
extra : moz-landing-system : lando
2019-06-24 08:25:02 +00:00
alexandru.ionescu 2d66061d8f Bug 1559949 Re-record wikipedia.org desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,alexandru.irimovici
Differential Revision: https://phabricator.services.mozilla.com/D35511

--HG--
extra : moz-landing-system : lando
2019-06-24 07:42:25 +00:00
Arnold Iakab 46bc26a8bb Bug 1559927 Re-record tumblr.com desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D35401

--HG--
extra : moz-landing-system : lando
2019-06-20 12:49:30 +00:00
Arnold Iakab 3f4a701e65 Bug 1558621 Reduce Raptor cold page-load tests on android to have one site per suite r=perftest-reviewers,rwood,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D34687

--HG--
extra : moz-landing-system : lando
2019-06-21 07:43:49 +00:00
Rob Wood a5885f4602 Bug 1559798 - Begin polling for the results (runner.js) only after the pageload.js code has been invoked in the test page content r=acreskey,tarek
Differential Revision: https://phabricator.services.mozilla.com/D35261

--HG--
extra : moz-landing-system : lando
2019-06-19 20:56:16 +00:00
alexandru.ionescu 4e5bca5dc2 Bug 1554688 Re-record youtube.com to reflect Polymer update Mobile r=perftest-reviewers,Bebe,igoldan
Differential Revision: https://phabricator.services.mozilla.com/D33620

--HG--
rename : testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6m-youtube.manifest => testing/raptor/raptor/playback/mitm4-motog5-gve-youtube.manifest
extra : moz-landing-system : lando
2019-06-20 11:35:54 +00:00
Mihai Alexandru Michis 304b951d8e Bug 1558764 - Fix linting failure. r=Bebe CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com//D35312

--HG--
extra : amend_source : 4f06f103cfbe846034480882b1f55e42262b0ffa
2019-06-19 12:08:45 +03:00
Florin Strugariu 536ab790bf Bug 1559904 Re-record netflix desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D35231

--HG--
extra : moz-landing-system : lando
2019-06-19 08:15:00 +00:00
Arnold Iakab ce197efbb6 Bug 1558764 Log timestamp from page load recordings r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D35008

--HG--
extra : moz-landing-system : lando
2019-06-19 07:51:20 +00:00
Florin Strugariu 197cc1b71c Bug 1556760 Organize the test ini file in folders r=perftest-reviewers,alexandru.irimovici,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D33968

--HG--
rename : testing/raptor/raptor/tests/raptor-assorted-dom.ini => testing/raptor/raptor/tests/benchmarks/raptor-assorted-dom.ini
rename : testing/raptor/raptor/tests/raptor-motionmark-animometer.ini => testing/raptor/raptor/tests/benchmarks/raptor-motionmark-animometer.ini
rename : testing/raptor/raptor/tests/raptor-motionmark-htmlsuite.ini => testing/raptor/raptor/tests/benchmarks/raptor-motionmark-htmlsuite.ini
rename : testing/raptor/raptor/tests/raptor-speedometer.ini => testing/raptor/raptor/tests/benchmarks/raptor-speedometer.ini
rename : testing/raptor/raptor/tests/raptor-stylebench.ini => testing/raptor/raptor/tests/benchmarks/raptor-stylebench.ini
rename : testing/raptor/raptor/tests/raptor-sunspider.ini => testing/raptor/raptor/tests/benchmarks/raptor-sunspider.ini
rename : testing/raptor/raptor/tests/raptor-unity-webgl.ini => testing/raptor/raptor/tests/benchmarks/raptor-unity-webgl.ini
rename : testing/raptor/raptor/tests/raptor-wasm-godot-baseline.ini => testing/raptor/raptor/tests/benchmarks/raptor-wasm-godot-baseline.ini
rename : testing/raptor/raptor/tests/raptor-wasm-godot-cranelift.ini => testing/raptor/raptor/tests/benchmarks/raptor-wasm-godot-cranelift.ini
rename : testing/raptor/raptor/tests/raptor-wasm-godot-ion.ini => testing/raptor/raptor/tests/benchmarks/raptor-wasm-godot-ion.ini
rename : testing/raptor/raptor/tests/raptor-wasm-godot.ini => testing/raptor/raptor/tests/benchmarks/raptor-wasm-godot.ini
rename : testing/raptor/raptor/tests/raptor-wasm-misc-baseline.ini => testing/raptor/raptor/tests/benchmarks/raptor-wasm-misc-baseline.ini
rename : testing/raptor/raptor/tests/raptor-wasm-misc-cranelift.ini => testing/raptor/raptor/tests/benchmarks/raptor-wasm-misc-cranelift.ini
rename : testing/raptor/raptor/tests/raptor-wasm-misc-ion.ini => testing/raptor/raptor/tests/benchmarks/raptor-wasm-misc-ion.ini
rename : testing/raptor/raptor/tests/raptor-wasm-misc.ini => testing/raptor/raptor/tests/benchmarks/raptor-wasm-misc.ini
rename : testing/raptor/raptor/tests/raptor-webaudio.ini => testing/raptor/raptor/tests/benchmarks/raptor-webaudio.ini
rename : testing/raptor/raptor/tests/raptor-youtube-playback.ini => testing/raptor/raptor/tests/benchmarks/raptor-youtube-playback.ini
rename : testing/raptor/raptor/tests/raptor-scn-power-idle.ini => testing/raptor/raptor/tests/scenario/raptor-scn-power-idle.ini
rename : testing/raptor/raptor/tests/raptor-tp6-1.ini => testing/raptor/raptor/tests/tp6/desktop/raptor-tp6-1.ini
rename : testing/raptor/raptor/tests/raptor-tp6-10.ini => testing/raptor/raptor/tests/tp6/desktop/raptor-tp6-10.ini
rename : testing/raptor/raptor/tests/raptor-tp6-2.ini => testing/raptor/raptor/tests/tp6/desktop/raptor-tp6-2.ini
rename : testing/raptor/raptor/tests/raptor-tp6-3.ini => testing/raptor/raptor/tests/tp6/desktop/raptor-tp6-3.ini
rename : testing/raptor/raptor/tests/raptor-tp6-4.ini => testing/raptor/raptor/tests/tp6/desktop/raptor-tp6-4.ini
rename : testing/raptor/raptor/tests/raptor-tp6-5.ini => testing/raptor/raptor/tests/tp6/desktop/raptor-tp6-5.ini
rename : testing/raptor/raptor/tests/raptor-tp6-6.ini => testing/raptor/raptor/tests/tp6/desktop/raptor-tp6-6.ini
rename : testing/raptor/raptor/tests/raptor-tp6-7.ini => testing/raptor/raptor/tests/tp6/desktop/raptor-tp6-7.ini
rename : testing/raptor/raptor/tests/raptor-tp6-8.ini => testing/raptor/raptor/tests/tp6/desktop/raptor-tp6-8.ini
rename : testing/raptor/raptor/tests/raptor-tp6-9.ini => testing/raptor/raptor/tests/tp6/desktop/raptor-tp6-9.ini
rename : testing/raptor/raptor/tests/raptor-tp6-binast-1.ini => testing/raptor/raptor/tests/tp6/desktop/raptor-tp6-binast-1.ini
rename : testing/raptor/raptor/tests/raptor-tp6-cold-1.ini => testing/raptor/raptor/tests/tp6/desktop/raptor-tp6-cold-1.ini
rename : testing/raptor/raptor/tests/raptor-tp6-cold-2.ini => testing/raptor/raptor/tests/tp6/desktop/raptor-tp6-cold-2.ini
rename : testing/raptor/raptor/tests/raptor-tp6-cold-3.ini => testing/raptor/raptor/tests/tp6/desktop/raptor-tp6-cold-3.ini
rename : testing/raptor/raptor/tests/raptor-tp6-cold-4.ini => testing/raptor/raptor/tests/tp6/desktop/raptor-tp6-cold-4.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-1-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-1-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-1.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-1.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-10-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-10-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-10.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-10.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-2-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-2-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-2.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-2.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-3-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-3-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-3.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-3.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-4-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-4-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-4.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-4.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-5-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-5-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-5.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-5.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-6-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-6-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-6.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-6.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-7-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-7-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-7.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-7.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-8-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-8-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-8.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-8.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-9-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-9-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-9.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-9.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-1-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-1-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-1.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-1.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-10-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-10-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-10.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-10.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-11-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-11-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-11.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-11.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-12-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-12-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-12.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-12.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-13-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-13-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-13.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-13.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-14-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-14-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-14.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-14.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-2-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-2-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-2.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-2.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-3-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-3-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-3.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-3.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-4-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-4-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-4.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-4.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-5-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-5-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-5.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-5.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-6-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-6-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-6.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-6.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-7-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-7-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-7.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-7.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-8-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-8-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-8.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-8.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-9-fennec64.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-9-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-9.ini => testing/raptor/raptor/tests/tp6/mobile/raptor-tp6m-cold-9.ini
extra : moz-landing-system : lando
2019-06-19 07:44:35 +00:00
Florin Strugariu 0cb77e76cb Bug 1559117 Disable web-socket support in mitm-proxy until we can add support for replaying these packages r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D35003

--HG--
extra : moz-landing-system : lando
2019-06-16 09:15:20 +00:00
alexandru.ionescu 372e3a61a4 Bug 1558163 Add dedicated test config for fennec v64 r=davehunt,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D34340

--HG--
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-1.ini => testing/raptor/raptor/tests/raptor-tp6m-cold-1-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-10.ini => testing/raptor/raptor/tests/raptor-tp6m-cold-10-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-11.ini => testing/raptor/raptor/tests/raptor-tp6m-cold-11-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-12.ini => testing/raptor/raptor/tests/raptor-tp6m-cold-12-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-13.ini => testing/raptor/raptor/tests/raptor-tp6m-cold-13-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-14.ini => testing/raptor/raptor/tests/raptor-tp6m-cold-14-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-2.ini => testing/raptor/raptor/tests/raptor-tp6m-cold-2-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-3.ini => testing/raptor/raptor/tests/raptor-tp6m-cold-3-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-4.ini => testing/raptor/raptor/tests/raptor-tp6m-cold-4-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-5.ini => testing/raptor/raptor/tests/raptor-tp6m-cold-5-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-6.ini => testing/raptor/raptor/tests/raptor-tp6m-cold-6-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-7.ini => testing/raptor/raptor/tests/raptor-tp6m-cold-7-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-8.ini => testing/raptor/raptor/tests/raptor-tp6m-cold-8-fennec64.ini
rename : testing/raptor/raptor/tests/raptor-tp6m-cold-9.ini => testing/raptor/raptor/tests/raptor-tp6m-cold-9-fennec64.ini
extra : moz-landing-system : lando
2019-06-14 15:16:56 +00:00
Arnold Iakab 814461e367 Bug 1538722 Improve Raptor failure message when running a test not targeted for the current application/platform r=alexandru.irimovici
Differential Revision: https://phabricator.services.mozilla.com/D32434

--HG--
extra : moz-landing-system : lando
2019-06-07 11:41:13 +00:00
Florin Strugariu 483019e7ff Bug 1511341 Add Nextflix to tp6 r=perftest-reviewers,igoldan,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D34330

--HG--
extra : moz-landing-system : lando
2019-06-11 08:22:06 +00:00
Florin Strugariu 9f7d7efda2 Bug 1511341 Fix Log message when replaing with no-upstream-cert in Raptor r=perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D34329

--HG--
extra : moz-landing-system : lando
2019-06-10 16:59:51 +00:00
Florin Strugariu 36d61d20ac Bug 1558158 alternate-server-replay 4.0.4 has the same command line argument as mitmproxy r=AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D34327

--HG--
extra : moz-landing-system : lando
2019-06-10 16:59:33 +00:00
Florin Strugariu 7f3801e8b2 Bug 1546094 Remove alternate-server-replay-4.0.4.py package filtering r=AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D34326

--HG--
extra : moz-landing-system : lando
2019-06-10 16:59:16 +00:00
Chris Hartjes 4aedd52bab Bug 1544470 - Added in code that can be used to take a snapshot of CPU usage on Android devices r=rwood,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D33662

--HG--
extra : moz-landing-system : lando
2019-06-06 16:57:34 +00:00
Marian Raiciof 11334f29e9 Bug 1522604 - Use Raptor's custom logger class r=davehunt
Used custom logger for testing.raptor.raptor files to mention log level in messages

Differential Revision: https://phabricator.services.mozilla.com/D32985

--HG--
extra : moz-landing-system : lando
2019-06-07 08:33:52 +00:00
Marian Raiciof fceda518ee Bug 1522604 - Add custom logger class to Raptor r=perftest-reviewers,davehunt
The new RaptorLogger class will add prefixes to raptor logging messages.
These changes will help raptor to display the log messages with the right log_level.

Differential Revision: https://phabricator.services.mozilla.com/D32984

--HG--
extra : moz-landing-system : lando
2019-06-07 08:33:39 +00:00
Marian Raiciof b7ec43643f Bug 1556311 - Fix the error "ImportError: no module named ini" while running raptor tests. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D33457

--HG--
extra : moz-landing-system : lando
2019-06-05 14:59:16 +00:00
Tarek Ziadé cdd72e5577 Bug 1556874 - Fix regression when sniffing upstream cert r=acreskey
Fixes a regression where the negotiated ALPN would force h1 when h2
is wanted.

Differential Revision: https://phabricator.services.mozilla.com/D33712

--HG--
extra : moz-landing-system : lando
2019-06-05 11:38:25 +00:00
Alexandru Irimovici 5fa1240465 Bug 1554696 - run media straming playback tests against fenix in CI(try) r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D32798

--HG--
extra : moz-landing-system : lando
2019-06-04 14:16:34 +00:00
Arnold Iakab 67663b0529 Bug 1555370 - Use percent value instead of ratio for %_dropped_frames subtest r=perftest-reviewers,Bebe,whimboo,alexandru.irimovici
Differential Revision: https://phabricator.services.mozilla.com/D33252

--HG--
extra : moz-landing-system : lando
2019-06-04 13:17:28 +00:00
Tarek Ziadé 252a57285a Bug 1517323 - Make HTTP/2 playbacks fully offliner r=acreskey,Bebe
This patch will block mitmproxy from making upstream requests to
negotiate ALPN. We force ALPN locally and intercept requests made
upstream.

Differential Revision: https://phabricator.services.mozilla.com/D31042

--HG--
extra : moz-landing-system : lando
2019-06-03 08:13:24 +00:00
Henrik Skupin 4af7918854 Bug 1509877 - [raptor] Refactor mach script for code readability and PEP 8. r=perftest-reviewers,Bebe
Depends on D32801

Differential Revision: https://phabricator.services.mozilla.com/D32802

--HG--
extra : moz-landing-system : lando
2019-05-31 14:43:39 +00:00
Henrik Skupin cb6ce127a9 Bug 1509877 - [raptor] Allow the use of a custom binary for desktop browsers. r=sparky
Depends on D32800

Differential Revision: https://phabricator.services.mozilla.com/D32801

--HG--
extra : moz-landing-system : lando
2019-05-31 00:04:35 +00:00
Henrik Skupin 7ab8eca5d6 Bug 1509877 - [raptor] Fix detection of Android as platform. r=Bebe
Differential Revision: https://phabricator.services.mozilla.com/D32800

--HG--
extra : moz-landing-system : lando
2019-05-31 14:43:05 +00:00
Gregory Mierzwinski 8ed4beb45e Bug 1555748 - Remove proportional power usage measurement from perfherder data on Android 7 and lower. r=perftest-reviewers,rwood
This patch prevents proportional power usage data from being output when the android version is 7 or lower since it does not exist on these OS versions.

Differential Revision: https://phabricator.services.mozilla.com/D33214

--HG--
extra : moz-landing-system : lando
2019-05-31 18:44:50 +00:00
Noemi Erli e28515ee12 Backed out changeset 9137795c6779 (bug 1544470) for linting failure in raptor.py CLOSED TREE 2019-05-30 22:56:54 +03:00
Chris Hartjes d03d62e5f9 Bug 1544470 - Added in code that can be used to take a snapshot of CPU usage on Android devices; r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D27954

--HG--
extra : moz-landing-system : lando
2019-05-30 19:33:08 +00:00
Arnold Iakab 3a496ddefa Bug 1554681 Re-record youtube.com to reflect Polymer update Desktop r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D32998

--HG--
extra : moz-landing-system : lando
2019-05-30 13:06:00 +00:00
Alexandru Irimovici 7b87be76cf Bug 1449572 - Bug 1449571 - raptor unit test for pageload timeouts r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D32670

--HG--
extra : moz-landing-system : lando
2019-05-29 19:23:13 +00:00
Rob Wood 09454f678d Bug 1554311 - Start page timeout timer only after the test tab has actually been updated r=acreskey
Differential Revision: https://phabricator.services.mozilla.com/D32531

--HG--
extra : moz-landing-system : lando
2019-05-27 17:48:42 +00:00
alexandru.ionescu a712b0f753 Bug 1546119 Raptor warm page-load tests on Firefox android fenix r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D32101

--HG--
extra : moz-landing-system : lando
2019-05-27 17:56:14 +00:00
Henrik Skupin 6689e0a3a3 Bug 1554645 - [raptor] Use dedicated message type for shutting down the browser. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D32683

--HG--
extra : moz-landing-system : lando
2019-05-27 18:48:44 +00:00
Ivan Yung b4030f9fc6 Bug 1545117: added message which includes the local perf-automation github repo clone path r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D31177

--HG--
extra : moz-landing-system : lando
2019-05-15 14:27:57 +00:00
alexandru.ionescu fa583b7a2f Bug 1545055 Run warm page load tests against Fennec v64 in CI r=Bebe,stephendonner
Differential Revision: https://phabricator.services.mozilla.com/D31770

--HG--
extra : moz-landing-system : lando
2019-05-24 11:19:07 +00:00
Henrik Skupin 59b691b66e Bug 1546880 - [raptor] Remove proxy workaround from raptor-youtube-playback tests. r=perftest-reviewers,stephendonner
Differential Revision: https://phabricator.services.mozilla.com/D32378

--HG--
extra : moz-landing-system : lando
2019-05-24 05:36:42 +00:00
alexandru.ionescu 2f37f5f55a Bug 1546323 Run cold page load tests against Fennec v64 in CI r=Bebe
Differential Revision: https://phabricator.services.mozilla.com/D31773

--HG--
extra : moz-landing-system : lando
2019-05-24 07:12:19 +00:00
Stephen Donner 168232fa40 Bug 1553623: Fix typos in Raptor's cmdline.py; r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D32215

--HG--
extra : moz-landing-system : lando
2019-05-22 21:12:28 +00:00
Henrik Skupin a85b69685d Bug 1552484 - [raptor] Add geckoview support to raptor-youtube-playback test suite. r=perftest-reviewers,rwood
Adding those tests with the premise to run all the videos as muted,
at least as long as bug 1547717 hasn't been fixed.

Differential Revision: https://phabricator.services.mozilla.com/D32040

--HG--
extra : moz-landing-system : lando
2019-05-22 14:27:14 +00:00
Andrew Creskey ad2afb1825 Bug 1550075 - Add android user profile to raptor, enable smart disk cache sizing r=rwood
A new user profile, raptor-android, was added. This profile is merged with existing profiles in RaptorAndroid.
browser.cache.disk.smart_size.enabled was enabled in test since it is enabled in shipped apps.
See https://searchfox.org/mozilla-central/rev/11cfa0462a6b5d8c5e2111b8cfddcf78098f0141/mobile/android/app/mobile.js#74

Differential Revision: https://phabricator.services.mozilla.com/D31336

--HG--
extra : moz-landing-system : lando
2019-05-22 13:23:05 +00:00
Brindusan Cristian 5b1da8059b Backed out changeset 09df445cbdd9 (bug 1550075) for f8 linting failure at raptor.py:857:10. CLOSED TREE 2019-05-22 15:47:40 +03:00
Andrew Creskey d3c69a3d77 Bug 1550075 - Add android user profile to raptor, enable smart disk cache sizing r=rwood
A new user profile, raptor-android, was added. This profile is merged with existing profiles in RaptorAndroid.
browser.cache.disk.smart_size.enabled was enabled in test since it is enabled in shipped apps.
See https://searchfox.org/mozilla-central/rev/11cfa0462a6b5d8c5e2111b8cfddcf78098f0141/mobile/android/app/mobile.js#74

Differential Revision: https://phabricator.services.mozilla.com/D31336

--HG--
extra : moz-landing-system : lando
2019-05-22 12:13:47 +00:00
alexandru.ionescu 1a8f3c3864 Bug 1543369 Raptor cold page-load tests on Firefox android fennec r=Bebe
Differential Revision: https://phabricator.services.mozilla.com/D31251

--HG--
extra : moz-landing-system : lando
2019-05-21 12:03:03 +00:00
Cosmin Sabou 17df5e7158 Backed out changeset 5862c607fcc2 (bug 1550075) for eslint failure on raptor-android/user.js. 2019-05-22 01:50:11 +03:00
Andrew Creskey 8cd21a5822 Bug 1550075 - Add android user profile to raptor, enable smart disk cache sizing r=rwood
A new user profile, raptor-android, was added. This profile is merged with existing profiles in RaptorAndroid.
browser.cache.disk.smart_size.enabled was enabled in test since it is enabled in shipped apps.
See https://searchfox.org/mozilla-central/rev/11cfa0462a6b5d8c5e2111b8cfddcf78098f0141/mobile/android/app/mobile.js#74

Differential Revision: https://phabricator.services.mozilla.com/D31336

--HG--
extra : moz-landing-system : lando
2019-05-21 22:13:07 +00:00
Henrik Skupin c69340b591 Bug 1548845 - [raptor] Integrate Youtube video playback performance suite as benchmark test. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30483

--HG--
extra : moz-landing-system : lando
2019-05-17 20:16:12 +00:00
Gregory Mierzwinski d36b68fefc Bug 1552548 - Set screen brightness to 50% on reference phones for power tests. r=perftest-reviewers,stephendonner
This patch sets the screen brightness on the reference Moto G5 and Pixel 2 phones to 50% before starting power tests and resets it to its original value once the test is complete.

Differential Revision: https://phabricator.services.mozilla.com/D31662

--HG--
extra : moz-landing-system : lando
2019-05-18 14:01:05 +00:00
Stephen Donner 6d86a346d7 Bug 1551324: Hook up remaining Fennec and Fenix jobs in CI for scn-power-idle tests. r=perftest-reviewers,rwood,sparky
Differential Revision: https://phabricator.services.mozilla.com/D31025

--HG--
extra : moz-landing-system : lando
2019-05-18 00:10:05 +00:00
Henrik Skupin 25e8969644 Bug 1548845 - [raptor] Don't filter-out tests which are white-listed for "use_live_sites". r=perftest-reviewers,stephendonner,rwood
Depends on D31681

Differential Revision: https://phabricator.services.mozilla.com/D31682

--HG--
extra : moz-landing-system : lando
2019-05-17 20:58:12 +00:00
Henrik Skupin 53ac5b9613 Bug 1548845 - [raptor] Log discarded tests in filter_live_sites. r=perftest-reviewers,rwood
Depends on D30532

Differential Revision: https://phabricator.services.mozilla.com/D31681

--HG--
extra : moz-landing-system : lando
2019-05-17 20:45:13 +00:00
Henrik Skupin bc20797022 Bug 1548845 - [raptor] Fix local import of filter module. r=perftest-reviewers,rwood
To not collide with the built-in "filter" method, the local
filter module should be named as filters.

Differential Revision: https://phabricator.services.mozilla.com/D30532

--HG--
rename : testing/raptor/raptor/filter.py => testing/raptor/raptor/filters.py
extra : moz-landing-system : lando
2019-05-17 20:16:12 +00:00
Henrik Skupin 4e8e65b9a9 Bug 1548845 - [raptor] Allow tests to specify the alertChangeType. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30531

--HG--
extra : moz-landing-system : lando
2019-05-17 20:14:25 +00:00
Henrik Skupin a092be21b1 Bug 1548845 - [raptor] Use a multiplier for page timeout when using live sites. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30530

--HG--
extra : moz-landing-system : lando
2019-05-17 20:14:23 +00:00
Rob Wood 8fdc5e82c4 Bug 1551972 - Fix Fenix cold page load by clearing app data before subsequent subtests; #perftest-reviewers r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D31632

--HG--
extra : moz-landing-system : lando
2019-05-17 16:55:05 +00:00
Mihai Alexandru Michis 724354e338 Backed out 5 changesets (bug 1548845) for failing new youtube playback raptor tests. CLOSED TREE
Backed out changeset 934d2f88195d (bug 1548845)
Backed out changeset 609f489bdc8c (bug 1548845)
Backed out changeset a2544ca8c593 (bug 1548845)
Backed out changeset 152615db9db6 (bug 1548845)
Backed out changeset 6b3a8394727f (bug 1548845)

--HG--
rename : testing/raptor/raptor/filters.py => testing/raptor/raptor/filter.py
2019-05-17 16:17:06 +03:00
Henrik Skupin 85b0987a4f Bug 1548845 - [raptor] Integrate Youtube video playback performance suite as benchmark test. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30483

--HG--
extra : moz-landing-system : lando
2019-05-17 11:12:53 +00:00
Henrik Skupin 992c3cdb7d Bug 1548845 - [raptor] Fix local import of filter module. r=perftest-reviewers,rwood
To not collide with the built-in "filter" method, the local
filter module should be named as filters.

Differential Revision: https://phabricator.services.mozilla.com/D30532

--HG--
rename : testing/raptor/raptor/filter.py => testing/raptor/raptor/filters.py
extra : moz-landing-system : lando
2019-05-17 11:12:40 +00:00
Henrik Skupin 11d84bf86a Bug 1548845 - [raptor] Allow tests to specify the alertChangeType. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30531

--HG--
extra : moz-landing-system : lando
2019-05-17 11:12:20 +00:00
Henrik Skupin 9eeae6d8c8 Bug 1548845 - [raptor] Use a multiplier for page timeout when using live sites. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30530

--HG--
extra : moz-landing-system : lando
2019-05-17 11:12:02 +00:00
Edwin Gao d05d708389 Bug 1552000 - move root-required tuning commands to its appropriate location for Raptor Android r=acreskey
Changes:

- move the I/O scheduler modification subroutine under the block that checks for `root` availability of device.

This change should not be visible on CI systems; all devices there are already rooted. Where this change makes an impact is for developers running Raptor Android tests on non-rooted devices.

Differential Revision: https://phabricator.services.mozilla.com/D31339

--HG--
extra : moz-landing-system : lando
2019-05-16 11:57:31 +00:00
shindli d1ef75d446 Backed out changeset 90a51dbd6ee1 (bug 1528236) for causing permafailures in raptor tests CLOSED TREE 2019-05-15 00:48:21 +03:00
Henrik Skupin dceb981485 Bug 1528236 - [raptor] Use opt-out mechanism for setting test specific preferences. r=perftest-reviewers,stephendonner
Due to missing class abstractions for Gecko- and non-Gecko based
browsers it's currently sub-optimal to define when preferences
as defined by tests will be set.

Given that by default we run Gecko-based applications other
browsers should opt-out from setting test preferences.

Differential Revision: https://phabricator.services.mozilla.com/D30923

--HG--
extra : moz-landing-system : lando
2019-05-14 19:32:27 +00:00
Henrik Skupin 22364e41eb Bug 1528236 - [raptor] Fix root permission failures for device tuning. r=perftest-reviewers,stephendonner
Differential Revision: https://phabricator.services.mozilla.com/D30922

--HG--
extra : moz-landing-system : lando
2019-05-14 19:29:53 +00:00
Henrik Skupin 1fb0816fdd Bug 1528236 - [raptor] Environment variables should not be set via extra args. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29333

--HG--
extra : moz-landing-system : lando
2019-05-14 19:32:15 +00:00
Henrik Skupin 33461df3ea Bug 1528236 - [raptor] Update profile building code to align with mochitests. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29332

--HG--
extra : moz-landing-system : lando
2019-05-14 19:32:13 +00:00
Henrik Skupin d93887ea36 Bug 1528236 - [raptor] Use constructor for initialization of raptor instances. r=perftest-reviewers,rwood
The patch tries to reduce the amount of initialization code
to call when creating a new Raptor class.

Initializing the ADBDevice already in the constructor of the
RaptorAndroid class is currently not possible because it would
mean that a device is immediately created but the "adb" binary
is not available for python test jobs. This has to be fixed later.

Differential Revision: https://phabricator.services.mozilla.com/D29331

--HG--
extra : moz-landing-system : lando
2019-05-14 19:32:11 +00:00
Henrik Skupin c1ba84a470 Bug 1528236 - [raptor] Allow Raptor to run the tests all at once. r=perftest-reviewers,stephendonner,rwood
Differential Revision: https://phabricator.services.mozilla.com/D31047

--HG--
extra : moz-landing-system : lando
2019-05-14 19:32:01 +00:00
Henrik Skupin d529cab0f1 Bug 1528236 - [raptor] Remove test root folder during clean-up. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29330

--HG--
extra : moz-landing-system : lando
2019-05-14 19:31:57 +00:00
Henrik Skupin 908e40dddf Bug 1528236 - [raptor] Refactor handling of remote profiles. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29329

--HG--
extra : moz-landing-system : lando
2019-05-14 19:30:11 +00:00
alexandru.ionescu 40ff099e27 Bug 1549669 - [raptor] Handle "--disable-e10s" argument to avoid causing fennec tests to fail r=perftest-reviewers,whimboo,ahal,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30171

--HG--
extra : moz-landing-system : lando
2019-05-14 11:50:00 +00:00
Stephen Donner 2c218a311e Bug 1548689: Hook idle-power-usage tests up to CI. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30456

--HG--
extra : moz-landing-system : lando
2019-05-13 20:33:15 +00:00
Stephen Donner 4a55597f03 Bug 1550828: String fixes and minor cleanup for power.py and Raptor's mach_commands.py. r=bc
Differential Revision: https://phabricator.services.mozilla.com/D30775

--HG--
extra : moz-landing-system : lando
2019-05-11 08:13:29 +00:00
Florin Strugariu 3dc303757f Bug 1549948 Fenix jobs are failing with "activity class does not exist" r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D30359

--HG--
extra : moz-landing-system : lando
2019-05-13 07:30:08 +00:00
Edwin Gao 1b56450c60 Bug 1549843 - implement jitter reduction for Motorola G5 r=jmaher,rwood
Changes:

- implement cpu, gpu, memory bus and other kernel tweaks for Motorola G5 to complement D30116

Differential Revision: https://phabricator.services.mozilla.com/D30715

--HG--
extra : moz-landing-system : lando
2019-05-10 21:15:20 +00:00
Andreea Pavel e14f62f15c Merge mozilla-central to autoland on a CLOSED TREE 2019-05-10 13:01:38 +03:00
Florin Strugariu 9d23aa6093 Bug 1549949 Errors on launching activities are causing timeouts r=perftest-reviewers,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D30343

--HG--
extra : moz-landing-system : lando
2019-05-10 09:32:00 +00:00
Andreea Pavel f5f94453ae Backed out changeset ba9d948d404c (bug 1544470) for breaking raptor-chromium a=backout 2019-05-10 11:35:42 +03:00
Chris Hartjes 80fbae9239 Bug 1544470 - Added in code that can be used to take a snapshot of CPU usage on Android devices; r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D27954

--HG--
extra : moz-landing-system : lando
2019-05-09 20:39:43 +00:00
Edwin Gao 1298ea44c8 Bug 1547135 - reduce tp6m test result jitter for Android (Pixel 2) r=jmaher,acreskey,rwood
All changes are reversible upon reboot, with exception of the animation setting which is restored to default settings once Raptor concludes testing.

All values are for Pixel 2. Motorola G5 patch will be available separately.

Changes:
- set cpu/gpu to `performance` mode, and override minimum frequency with the maximum available frequency
- tweak msm-bus related kernel settings
- set display to be permanently on when connected over USB
- disable animation for duration of test
- turn off thermal throttling

Differential Revision: https://phabricator.services.mozilla.com/D30116

--HG--
extra : moz-landing-system : lando
2019-05-09 16:35:27 +00:00
Florin Strugariu 70d07476cb Bug 1541041 Page timeouts are ignored during cold page-load test suites r=rwood,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D26309

--HG--
extra : moz-landing-system : lando
2019-05-08 18:29:56 +00:00
Ionut Goldan ab23804ea9 Bug 1548577 - Add missing chromium counterparts r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D30188

--HG--
extra : moz-landing-system : lando
2019-05-08 19:39:10 +00:00
Stephen Donner d229732882 Bug 1548987: pypi.python.org should now just be pypi.org in mach_commands.py. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D29985

--HG--
extra : moz-landing-system : lando
2019-05-08 17:50:21 +00:00
Stephen Donner e52c3cef40 Bug 1546741. Land initial idle-power-usage-measurement test for Android. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D29654

--HG--
extra : moz-landing-system : lando
2019-05-08 19:21:12 +00:00
Rob Wood 046bef30c3 Bug 1545186 - Raptor test definitions and taskcluster configs for cold page-load tests on GeckoView Example App; #perftest r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D29207

--HG--
extra : moz-landing-system : lando
2019-05-03 15:53:27 +00:00
Ivan Yung 9914e7d5ec Bug 1519884: Improve help text for --test argument r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D29541

--HG--
extra : moz-landing-system : lando
2019-05-01 19:26:41 +00:00
Rob Wood 0678c2e034 Bug 1522972 - Raptor cold-load tests on Firefox and Chromium desktop; #perftest r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D29032

--HG--
extra : moz-landing-system : lando
2019-05-01 14:52:59 +00:00
Henrik Skupin fc6a577886 Bug 1547069 - [raptor] Always take a screenshot on page load timeouts. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29178

--HG--
extra : moz-landing-system : lando
2019-04-30 07:59:28 +00:00
Henrik Skupin 3b68194ffa Bug 1547069 - [raptor] Refactoring screen capturing code in web extension. r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29177

--HG--
extra : moz-landing-system : lando
2019-04-30 07:59:11 +00:00
Henrik Skupin e1bb9a3e44 Bug 1547069 - [raptor] Reduce CPU overhead when waiting for results. r=perftest-reviewers,rwood
The method checkForResult is called each and every 5 milliseconds while the Raptor
tests are running. This actually consumes a lot of CPU which can decrease the
performance of the website under test.

It's totally enough to check for results 4 times in a minute.

Differential Revision: https://phabricator.services.mozilla.com/D29176

--HG--
extra : moz-landing-system : lando
2019-04-30 07:58:56 +00:00
Henrik Skupin f45dee943e Bug 1547069 - [raptor] Generalize code in waitForResult(). r=perftest-reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D29175

--HG--
extra : moz-landing-system : lando
2019-04-30 07:58:35 +00:00
Henrik Skupin fdfa7dd694 Bug 1544686 - [raptor] Allow CLI arguments to override Gecko profiler settings from test manifest. r=perftest reviewers,rwood
Differential Revision: https://phabricator.services.mozilla.com/D28047

--HG--
extra : moz-landing-system : lando
2019-04-29 13:35:51 +00:00
Henrik Skupin 27e49c37df Bug 1544686 - [raptor] Make Gecko profiler threads customizable in the harness. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D28046

--HG--
extra : moz-landing-system : lando
2019-04-23 15:37:30 +00:00
Henrik Skupin f957b3ea28 Bug 1544686 - [raptor] Fix Gecko profiler settings. r=rwood
When the Gecko profiler is enabled the interval and entries as specified
in manifest files aren't correctly set. Instead the default values from
the extension are always used.

Also with WebRender enabled the threads are "WR", and "Renderer", but
not "WR,Renderer".

Differential Revision: https://phabricator.services.mozilla.com/D28045

--HG--
extra : moz-landing-system : lando
2019-04-23 15:37:29 +00:00
Florin Strugariu d3d1d11735 Bug 1544356 4 - 281% raptor-tp6 regression r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D28598

--HG--
extra : moz-landing-system : lando
2019-04-26 12:49:09 +00:00
Cosmin Sabou 8f9aff6a55 Bug 1513467 - Disable raptor-tp6-amazon-firefox due to frequent failures. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D29090

--HG--
extra : moz-landing-system : lando
2019-04-27 02:06:28 +00:00
Henrik Skupin b77e627ac4 Bug 1546611 - [raptor] Fix None checks when validating test manifests. r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D28642

--HG--
extra : moz-landing-system : lando
2019-04-26 12:48:02 +00:00
Henrik Skupin bb1110b6b8 Bug 1547074 - [raptor] Rename measure.js and benchmark-relay.js. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D28896

--HG--
rename : testing/raptor/webext/raptor/benchmark-relay.js => testing/raptor/webext/raptor/benchmark.js
rename : testing/raptor/webext/raptor/measure.js => testing/raptor/webext/raptor/pageload.js
extra : moz-landing-system : lando
2019-04-26 05:13:42 +00:00
Rob Wood ac0b8d3376 Bug 1546704 - Fix subtest names for cold page-load Fenix suites; r=Bebe
Differential Revision: https://phabricator.services.mozilla.com/D28708

--HG--
extra : moz-landing-system : lando
2019-04-25 11:13:34 +00:00
Henrik Skupin e86db915f3 Bug 1506928 - [raptor] Use signal handler for safe shutdown. r=rwood,tarek
Differential Revision: https://phabricator.services.mozilla.com/D25752

--HG--
extra : moz-landing-system : lando
2019-04-24 19:06:06 +00:00
Henrik Skupin 317dd0b163 Bug 1506928 - [raptor] "get()" defaults to None by default if key isn't found. r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D27640

--HG--
extra : moz-landing-system : lando
2019-04-24 09:31:52 +00:00
Henrik Skupin dbdb18ef72 Bug 1506928 - [raptor] Fix inheritance of methods in raptor classes. r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D27639

--HG--
extra : moz-landing-system : lando
2019-04-24 09:31:37 +00:00
Henrik Skupin d8fa03fe11 Bug 1506928 - [raptor] Refactor arguments for constructors of Raptor classes. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25751

--HG--
extra : moz-landing-system : lando
2019-04-24 19:06:13 +00:00
Henrik Skupin e748412851 Bug 1506928 - [raptor] Handle "MOZ_UPLOAD_DIR" as optional in Output class. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D25750

--HG--
extra : moz-landing-system : lando
2019-04-24 19:06:16 +00:00
Rob Wood f0ae2f4c0a Bug 1546178 - Fix live-sites support when running Raptor cold page-load on android; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D28399

--HG--
extra : moz-landing-system : lando
2019-04-23 18:09:43 +00:00
Florin Strugariu f74efede94 Bug 1518793 Add Microsoft Office to tp6 r=AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D27663

--HG--
extra : moz-landing-system : lando
2019-04-22 15:39:00 +00:00
Florin Strugariu bb78bfab8c Bug 1545722 remove raptor-tp6-8-404 jobs r=AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D28180

--HG--
extra : moz-landing-system : lando
2019-04-19 08:51:28 +00:00
Florin Strugariu 2aab02dcd9 Bug 1533283 Intermittent timeouts running raptor-tp6m-google-restaurants-geckoview r=AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D28182

--HG--
extra : moz-landing-system : lando
2019-04-22 09:17:11 +00:00
Rob Wood 1105b8f744 Bug 1545175 - Raptor test definitions and taskcluster configs for cold page-load tests on Fenix; r=Bebe,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D27964

--HG--
extra : moz-landing-system : lando
2019-04-18 19:34:10 +00:00
Andrew Halberstadt af84858720 Bug 1532747 - Create try-only raptor tp6m-1 fenix task, r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D27948

--HG--
extra : moz-landing-system : lando
2019-04-17 19:49:52 +00:00
Florin Strugariu ec6fa081bc Bug 1544702 Clear app data between tests when running mobile warm raptor tests r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D27652

--HG--
extra : moz-landing-system : lando
2019-04-18 10:34:15 +00:00
Henrik Skupin dafcfb1456 Bug 1544707 - [raptor] Use format strings instead of concatenating log messages. r=rwood
Depends on D27812

Differential Revision: https://phabricator.services.mozilla.com/D27813

--HG--
extra : moz-landing-system : lando
2019-04-18 06:42:00 +00:00
Henrik Skupin 647820f87f Bug 1544707 - [raptor] Move most of if/elif blocks for testType to switch statements. r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D27812

--HG--
extra : moz-landing-system : lando
2019-04-18 06:41:42 +00:00
Rob Wood 57bf658be0 Bug 1544516 - Add ability to specify intent when launching android app; r=davehunt
Differential Revision: https://phabricator.services.mozilla.com/D27570

--HG--
extra : moz-landing-system : lando
2019-04-18 12:46:13 +00:00
shindli 2554c77019 Backed out changeset 20bbaead9017 (bug 1519884) for causing mozlint failure in /builds/worker/checkouts/gecko/testing/raptor/raptor/cmdline.py CLOSED TREE 2019-04-17 19:44:49 +03:00
Ivan Yung 438d9c71b3 Bug 1519884: Improve help text for --test argument r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D27608

--HG--
extra : moz-landing-system : lando
2019-04-17 14:17:35 +00:00
Florin Strugariu 987bd630c6 Bug 1543996 Add test configurations for reference browser r=davehunt,rwood
Differential Revision: https://phabricator.services.mozilla.com/D27284

--HG--
extra : moz-landing-system : lando
2019-04-17 13:34:23 +00:00
Bob Clary 752022eeda Bug 1533848 - Implement Android memory test using control server waits, r=rwood.
Depends on D26973

Differential Revision: https://phabricator.services.mozilla.com/D26974

--HG--
extra : moz-landing-system : lando
2019-04-16 18:55:34 +00:00
Bob Clary 5968316eb9 Bug 1533848 - Suppress HTTP 200 request log output, r=rwood.
Depends on D26972

Differential Revision: https://phabricator.services.mozilla.com/D26973

--HG--
extra : moz-landing-system : lando
2019-04-16 18:26:44 +00:00
Bob Clary 73d6f12ca4 Bug 1533848 - Make the control server multithreaded, r=rwood.
Differential Revision: https://phabricator.services.mozilla.com/D26972

--HG--
extra : moz-landing-system : lando
2019-04-16 19:26:26 +00:00