e282f9c968
Bug 1541215 - [raptor] Check for failures in spawned thread for test_start_browser. r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D25855
--HG--
extra : moz-landing-system : lando
2019-04-04 06:12:23 +00:00
2bb8060847
Bug 1541215 - [raptor] Fall back to 1 browser_cycle / page_cycle if test doesn't specify a value. r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D25854
--HG--
extra : moz-landing-system : lando
2019-04-04 06:12:38 +00:00
f0624a23a4
Bug 1540629 remove screenshots from tp6-8-404 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D25563
--HG--
extra : moz-landing-system : lando
2019-04-01 15:00:50 +00:00
f9d59415ac
Bug 1534778. Abstract and enable power tests for non-GeckoView browsers. r=rwood,bc
...
Differential Revision: https://phabricator.services.mozilla.com/D24971
--HG--
extra : moz-landing-system : lando
2019-03-29 18:47:35 +00:00
1902546a62
Bug 1534628 add benchmark measurement to raptor error handeling r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D23304
--HG--
extra : moz-landing-system : lando
2019-03-29 14:36:56 +00:00
e2de20e8a8
Bug 1536095 - Add aframe.io Animation page to tp6-m r=davehunt,rwood
...
Bug 1536095 - Add aframe.io Animation page to tp6-m
Differential Revision: https://phabricator.services.mozilla.com/D23862
--HG--
extra : moz-landing-system : lando
2019-03-29 14:41:31 +00:00
548250ddec
Bug 1536758 Switch to using event listener instead of overloading window.onload in runner/measure.js r=acreskey
...
Differential Revision: https://phabricator.services.mozilla.com/D24163
--HG--
extra : moz-landing-system : lando
2019-03-29 13:14:33 +00:00
2efaefdfc3
Bug 1539438 - Expand tp6m-cold-1; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D25060
--HG--
extra : moz-landing-system : lando
2019-03-29 13:28:06 +00:00
5ef71add7a
Bug 1457274 Upgrade mitmproxy in production r=rwood,tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D21374
--HG--
rename : testing/raptor/raptor/playback/alternate-server-replay.py => testing/raptor/raptor/playback/alternate-server-replay-2.0.2.py
extra : moz-landing-system : lando
2019-03-29 09:54:53 +00:00
a720305501
Bug 1536874 - Temporarily remove measuring TTFI and Hero elements in order to stabilize pageload tests; r=Bebe
...
Differential Revision: https://phabricator.services.mozilla.com/D25112
--HG--
extra : moz-landing-system : lando
2019-03-28 09:44:47 +00:00
b309039307
Bug 1538786 - Fix 'KeyError: suites' when a tp6 page times out; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D24881
--HG--
extra : moz-landing-system : lando
2019-03-27 09:10:39 +00:00
8af903f814
Backed out changeset 030cb27161ee (bug 1538786) for raptor failures in testing/raptor/test/test_manifest.py::test_get_raptor_test_list_firefox CLOSED TREE
2019-03-26 04:52:51 +02:00
b6d015016c
Bug 1538786 - Fix 'KeyError suites' when a tp6 page times out; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D24746
--HG--
extra : moz-landing-system : lando
2019-03-25 19:30:38 +00:00
17dec601e9
Bug 1533423 - Raptor cold page-load support for Firefox android geckoview; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D24464
--HG--
extra : moz-landing-system : lando
2019-03-22 15:27:27 +00:00
6eea3b81dc
Bug 1536112 - testing/raptor misses moz.build file. r=ahal
...
Differential Revision: https://phabricator.services.mozilla.com/D23936
--HG--
extra : moz-landing-system : lando
2019-03-19 03:45:24 +00:00
7a1c539e39
Bug 1521967 - Part 1: Use MOZ_HOST_BIN to find certutil in `mach raptor-test` for Android. r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D17396
--HG--
extra : moz-landing-system : lando
2019-03-18 16:50:57 +00:00
05db28a64b
Bug 1534956 - Add Cristiano's facebook page to tp6-m r=Bebe
...
Differential Revision: https://phabricator.services.mozilla.com/D23317
--HG--
extra : moz-landing-system : lando
2019-03-15 11:46:22 +00:00
2f3c136a11
Bug 1534788 - add the playback_args option r=Bebe,rwood
...
This patch also removes custom_script and stops
executing start() in the constructor.
Differential Revision: https://phabricator.services.mozilla.com/D23288
--HG--
extra : moz-landing-system : lando
2019-03-13 14:50:03 +00:00
45cd40fa58
Bug 1527849 Add google search to tp6-m r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D19907
--HG--
extra : moz-landing-system : lando
2019-03-13 10:31:34 +00:00
29cb950a1e
Bug 1490048 - add cranelift to raptor wasm-misc and wasm-godot tests. r=bbouvier,rwood
...
add cranelift to raptor wasm-misc and wasm-godot tests.
Differential Revision: https://phabricator.services.mozilla.com/D23144
--HG--
extra : moz-landing-system : lando
2019-03-12 14:42:45 +00:00
5486eb421d
Bug 1533517 - [mozdevice] Remove FirefoxOS candidate test root paths. r=bc
...
Differential Revision: https://phabricator.services.mozilla.com/D22952
--HG--
extra : moz-landing-system : lando
2019-03-12 13:55:51 +00:00
63eb0a0132
Bug 1532671 output what measurements are still pending though when there is a page timeout in raptor r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D22107
--HG--
extra : moz-landing-system : lando
2019-03-12 12:16:09 +00:00
899b667ee0
Bug 1529207 - Add new Raptor tests in tp6m-4 r=davehunt,rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D20852
--HG--
extra : moz-landing-system : lando
2019-03-12 12:01:27 +00:00
78eb1bc26f
Bug 1529212 Add new Raptor tests in tp6m-7 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D21000
--HG--
extra : moz-landing-system : lando
2019-03-11 14:30:12 +00:00
941c77dc3a
Bug 1529211 Add new Raptor tests in tp6m-6 r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D20820
--HG--
extra : moz-landing-system : lando
2019-03-07 16:37:30 +00:00
9ed1006ca9
Bug 1528992 - extract raptor mitmproxy integration - r=rwood,Bebe,gbrown
...
This patch moves testing/raptor/raptor/playback into its own testing package in testing/mozbase/mozproxy
so we can use the proxy in other places than Raptor.
Differential Revision: https://phabricator.services.mozilla.com/D21200
--HG--
rename : testing/raptor/raptor/playback/__init__.py => testing/mozbase/mozproxy/mozproxy/__init__.py
rename : testing/raptor/raptor/playback/base.py => testing/mozbase/mozproxy/mozproxy/backends/base.py
rename : testing/raptor/raptor/playback/mitmproxy.py => testing/mozbase/mozproxy/mozproxy/backends/mitm.py
rename : testing/raptor/raptor/playback/mitmproxy-rel-bin-linux64.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-linux64.manifest
rename : testing/raptor/raptor/playback/mitmproxy-rel-bin-osx.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-osx.manifest
rename : testing/raptor/raptor/playback/mitmproxy-rel-bin-win.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-win.manifest
rename : testing/raptor/raptor/playback/mitmproxy_requirements.txt => testing/mozbase/mozproxy/mozproxy/backends/mitmproxy_requirements.txt
extra : moz-landing-system : lando
2019-03-06 17:13:21 +00:00
1b4fb7feae
Bug 1532542 raptor-tp6m-youtube-geckoview output problem r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D22061
--HG--
extra : moz-landing-system : lando
2019-03-05 11:04:30 +00:00
18ad654c50
Bug 1530353 - Temporarily stop measuring hero element in tp6-1 to prevent intermittent failures; r=acreskey,davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D21802
--HG--
extra : moz-landing-system : lando
2019-03-04 21:43:21 +00:00
8253608b85
Bug 1530546: change hostutils version in raptor test r=gbrown
...
Differential Revision: https://phabricator.services.mozilla.com/D22009
--HG--
extra : moz-landing-system : lando
2019-03-04 21:08:33 +00:00
28ef99fbcd
Bug 1531169 - Add the ability to run Raptor page-load tests against live sites; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D21466
--HG--
extra : moz-landing-system : lando
2019-03-04 20:40:51 +00:00
46accc2092
Bug 1531441 - Revert disabling of raptor-unity-webgl-geckoview; r=bc
...
Differential Revision: https://phabricator.services.mozilla.com/D21751
--HG--
extra : moz-landing-system : lando
2019-03-01 21:56:40 +00:00
361d5151c4
Bug 1529210 Add new Raptor tests in tp6m-5 r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D20815
--HG--
extra : moz-landing-system : lando
2019-03-01 14:46:36 +00:00
3042085516
Bug 1531079 - Stop capturing Firefox JS errors and warnings in the Raptor logs; r=stephendonner
...
Differential Revision: https://phabricator.services.mozilla.com/D21399
--HG--
extra : moz-landing-system : lando
2019-02-27 19:38:46 +00:00
7a132cc405
Bug 1523877 Add Instagram and bing to tp6-m r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D18072
--HG--
extra : moz-landing-system : lando
2019-02-28 08:46:33 +00:00
085345ac87
Bug 1524495 - Temporarily disable raptor-unity-webgl-geckoview due to frequent failures. r=jmaher
...
Reviewers: jmaher, rwood
Reviewed By: jmaher
Subscribers: reviewbot, jmaher
Bug #: 1524495
Differential Revision: https://phabricator.services.mozilla.com/D20939
--HG--
extra : rebase_source : 0dfc90e334d0d51b135614d5b48d7d4eb24866dd
extra : histedit_source : 42e6fdea6fd0a8fe5eaac00f3acf8d72d082e58f
2019-02-26 17:20:58 +02:00
c2918302b0
Backed out changeset e5fc352e6d65 (bug 1524495) for Raptor performance tests failures.
2019-02-26 17:19:43 +02:00
b63f29553f
Bug 1524495 - Temporarily disable raptor-unity-webgl-geckoview due to frequent failures r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D20939
--HG--
extra : moz-landing-system : lando
2019-02-26 12:00:41 +00:00
e489ab4f77
Backed out changeset 9b617c97285a (bug 1524495) for Py2 failure
...
--HG--
extra : rebase_source : 11dae674cfe6dfe1b9ac0c70ac463b64d148c48b
2019-02-26 11:36:11 +02:00
243105ce4c
Bug 1524495 - Temporarily disable raptor-unity-webgl-geckoview due to frequent failures r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D20939
--HG--
extra : moz-landing-system : lando
2019-02-25 13:32:22 +00:00
6adb5274af
Bug 1506936 - Temporarily disable raptor-tp6-facebook-firefox due to permafail. r=jmaher,davehunt
...
--HG--
extra : amend_source : 7c550f19ee58925ef15fd14b44d680078bbe5d1b
2019-02-23 23:15:44 +02:00
3aeb6355e0
Backed out changeset 05dc22d0131b (bug 1506936) for causing raptor failures on test_manifest.py.
2019-02-23 22:53:29 +02:00
59718a6d7c
Bug 1506936 - Temporarily disable raptor-tp6-facebook-firefox due to permafail; r=jmaher,davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D20911
--HG--
extra : moz-landing-system : lando
2019-02-23 20:00:21 +00:00
1f2bb6f01b
Bug 1529079 - Fix Raptor fennec shutdown failure; r=bc
...
Differential Revision: https://phabricator.services.mozilla.com/D20829
--HG--
extra : moz-landing-system : lando
2019-02-22 21:40:05 +00:00
2e13f2584d
Bug 1520523 - Update Raptor Chromium rev; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D20814
--HG--
extra : moz-landing-system : lando
2019-02-22 19:31:52 +00:00
8367e1b8cd
Bug 1527280 - Add deterministic js and injection script to raptor mitmproxy r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D19485
--HG--
extra : moz-landing-system : lando
2019-02-22 19:33:13 +00:00
39cd1d4845
Bug 1525358 - Rename perf.html to profiler.firefox.com; r=julienw
...
Differential Revision: https://phabricator.services.mozilla.com/D18728
--HG--
extra : moz-landing-system : lando
2019-02-21 23:16:40 +00:00
90f0dafc2a
Backed out changeset ad3aad4f529e (bug 1527280) for ESlint and flake failures at deterministic.js. CLOSED TREE
2019-02-21 19:01:32 +02:00
7d3ec27a10
Bug 1527280 - Add deterministic js and injection script to raptor mitmproxy r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D19485
--HG--
extra : moz-landing-system : lando
2019-02-21 16:31:39 +00:00
b7e28eddd2
Bug 1507110 - Allow hijacking localhost only if network.proxy.allow_hijacking_localhost is set r=Gijs,mayhemer,mkaply,jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D19325
--HG--
extra : moz-landing-system : lando
2019-02-19 21:53:22 +00:00
df7c74194f
Bug 1528055 - Raptor's extension measure.js onload overrides onload in mitmproxy page recordings; r=acreskey
...
Differential Revision: https://phabricator.services.mozilla.com/D19961
--HG--
extra : moz-landing-system : lando
2019-02-20 21:06:15 +00:00
47c7bf42ec
Bug 1522100 - Add Raptor support for running tests locally on the android-components reference browser; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D20414
--HG--
extra : moz-landing-system : lando
2019-02-21 14:14:05 +00:00
9096d62bdf
Bug 1523973 Review and update the raptor-tp6m-1 recordings r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D20309
--HG--
extra : moz-landing-system : lando
2019-02-19 12:22:32 +00:00
8584f3a17e
Bug 1508379 Add BinAST version of Instagram to tp6 r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D18824
--HG--
extra : moz-landing-system : lando
2019-02-15 15:41:53 +00:00
e7157bdeaa
Bug 1522972 - Make existing main Raptor code more modular; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D18689
--HG--
extra : moz-landing-system : lando
2019-02-15 14:55:16 +00:00
2db0262d3b
Bug 1515023 Abort page load test when mitmproxy recording can not be found r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D19649
--HG--
extra : moz-landing-system : lando
2019-02-15 10:48:25 +00:00
b4402089b6
Bug 1520447 For raptor tp6 on windows use mitmproxy executable instead of creating a separate python environment r=rwood,davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D16802
--HG--
extra : moz-landing-system : lando
2019-02-13 19:55:30 +00:00
75d8d540ab
Backed out changeset a5ad662d5bbb (bug 1520447) for android build bustages. CLOSED TREE
2019-02-13 17:04:19 +02:00
604b72af80
Bug 1520447 For raptor tp6 on windows use mitmproxy executable instead of creating a separate python environment r=rwood,davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D16802
--HG--
extra : moz-landing-system : lando
2019-02-12 14:33:49 +00:00
e9c99dfaf4
Bug 1520592 - Enable screen captures on pageload timeouts; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D18878
--HG--
extra : moz-landing-system : lando
2019-02-08 21:33:35 +00:00
92ed8bb564
Bug 1518776 Add Tumblr to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D16054
--HG--
extra : moz-landing-system : lando
2019-02-06 17:10:06 +00:00
f53b36fd57
Bug 1520417 - Do not combine test name with measurement r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D18323
--HG--
extra : moz-landing-system : lando
2019-02-06 13:57:28 +00:00
eb7e08c167
Bug 1525280 Raptor should clear app data before running tests on gecko view r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D18686
--HG--
extra : moz-landing-system : lando
2019-02-06 12:01:03 +00:00
8bc7850637
Bug 1483228 - [mozboot] Simplify get_state_dir()'s return value r=nalexander
...
mozboot.util.get_state_dir() returns a tuple of (<path>, <bool). The bool
denotes whether or not the state dir came from an environment variable.
But this value is only used in a single place, and is very easy to test for
anyway. It's not worth the added complexity it imposes on all other consumers
of this function. Let's just make this function return the path.
Differential Revision: https://phabricator.services.mozilla.com/D15723
--HG--
extra : moz-landing-system : lando
2019-02-04 20:52:31 +00:00
a50cb45a62
Bug 1517178 - [raptor] disable adb verbose output during logcat collection, r=rwood.
2019-01-31 20:35:56 -08:00
5ccc06113c
Bug 1520130 - [raptor] Improve Raptor no raptor test results were found message, r=rwood.
2019-01-31 20:35:56 -08:00
25349d2601
Bug 1518283 - prohibit blank lines at the beginning and end of blocks (eslint padded-blocks) r=mossop,Standard8
...
Differential Revision: https://phabricator.services.mozilla.com/D17526
--HG--
extra : moz-landing-system : lando
2019-01-30 17:26:25 +00:00
bff88648b3
Bug 1516015 - Fix proxy configuration for Raptor in Google Chrome; r=rwood
...
When investigating the timeouts for wikia.com on Google Chrome I discovered differences in the way proxy configuration is interpreted. It meant that insecure sites such as wikia were not using the proxy when launched via mach, and now that wikia.com redirects to a secure site we get redirected to a site that is not in the recordings. I have resolved this by fixing the command line argument for the proxy to include all protocols. It was also necesary to allow communication with the control server by adding localhost to the pass-through hosts.
I also removed the trailing disable-sync command line argument that was introduced recently in error.
Differential Revision: https://phabricator.services.mozilla.com/D17869
--HG--
extra : moz-landing-system : lando
2019-01-28 22:12:00 +00:00
2863bd9494
Bug 1504227 - Add raptor test option to specify what measurement(s) to alert on; r=davehunt
...
Depends on D17288
Differential Revision: https://phabricator.services.mozilla.com/D17289
--HG--
extra : moz-landing-system : lando
2019-01-25 18:01:45 +00:00
d7bb330c5f
Bug 1504227 - Add raptor test option to specify what measurement(s) to alert on; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D17288
--HG--
extra : moz-landing-system : lando
2019-01-24 19:06:49 +00:00
aa7f384d91
Bug 1517738 - Have Raptor use the correct binary name when running on android in production; r=gbrown
...
Differential Revision: https://phabricator.services.mozilla.com/D17251
--HG--
extra : moz-landing-system : lando
2019-01-22 19:56:58 +00:00
0debaf69dc
Bug 1520523 - Update Chromium version running with Raptor in production; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D16724
--HG--
extra : moz-landing-system : lando
2019-01-22 15:01:31 +00:00
791aa236d2
Bug 1521459 Add the certutil path to 'LD_LIBRARY_PATH' variable when running a local android tp6 run r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D16970
--HG--
extra : moz-landing-system : lando
2019-01-21 14:58:30 +00:00
ebffce4499
Bug 1521099 - Add FCP measurement to pageload on geckoview (tp6m-1); r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D17001
--HG--
extra : moz-landing-system : lando
2019-01-18 18:26:09 +00:00
3226dda355
Bug 1518479 - Add Firefox FirstContentfulPaint measurement to raptor tests (on behalf of :jesup); r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D16599
--HG--
extra : moz-landing-system : lando
2019-01-17 20:00:07 +00:00
fc98f89dd9
Bug 1506912 - Raptor tp6m-1 pageload test on android geckoview; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D15143
--HG--
extra : moz-landing-system : lando
2019-01-17 03:01:40 +00:00
cd72b29090
Bug 1513365 Add Google Mail to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D15939
--HG--
extra : moz-landing-system : lando
2019-01-15 08:33:31 +00:00
4aeedf5b2e
Bug 1517800 Add Pinterest to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D16048
--HG--
extra : moz-landing-system : lando
2019-01-14 19:42:12 +00:00
24d3ea5ce2
Bug 1518519 Add Paypal to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D16031
--HG--
extra : moz-landing-system : lando
2019-01-11 19:07:10 +00:00
61b758639c
Bug 1517738 - [raptor] Use the correct app name when running on fennec on beta; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D16209
--HG--
extra : moz-landing-system : lando
2019-01-11 19:25:22 +00:00
daa7fbeb2e
Bug 1513369 Add Yahoo Mail to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D14546
--HG--
extra : moz-landing-system : lando
2019-01-08 08:44:37 +00:00
0654d55e71
Bug 1513367 Add Yahoo to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D14425
--HG--
extra : moz-landing-system : lando
2019-01-07 16:25:54 +00:00
627ce82d7d
Bug 1510404 Add Wikipedia to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D14134
--HG--
extra : moz-landing-system : lando
2019-01-07 16:11:25 +00:00
ba667e28c0
Bug 1517270 - Add pageload measurement types to --print-tests output; r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D15642
--HG--
extra : moz-landing-system : lando
2019-01-04 17:04:27 +00:00
e957682403
Bug 1517052 - [raptor] Do not report power usage when raptor fails to report results; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D15744
--HG--
extra : moz-landing-system : lando
2019-01-04 20:09:31 +00:00
89ba457187
Bug 1512615 Support screenshots for tests r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D13972
--HG--
extra : moz-landing-system : lando
2019-01-04 13:02:44 +00:00
d64a93fbd2
Bug 1511356 - Run speedometer on fennec via Raptor; r=jmaher,jlund
...
Differential Revision: https://phabricator.services.mozilla.com/D13946
--HG--
extra : moz-landing-system : lando
2019-01-02 20:43:21 +00:00
622b218aa2
Bug 1512983 - Add crash reporting for android raptor; r=rwood
...
Also fix the symbols path, so that desktop crash reports are symbolicated.
2018-12-31 09:18:00 -07:00
0daee297ae
Bug 1491097 - Add utils unit test; r=ahal
...
Differential Revision: https://phabricator.services.mozilla.com/D13153
--HG--
extra : moz-landing-system : lando
2018-11-28 18:44:02 +00:00
a5e0666632
Bug 1491097 - Add manifest unit test; r=ahal
...
Differential Revision: https://phabricator.services.mozilla.com/D13139
--HG--
extra : moz-landing-system : lando
2018-12-28 20:01:10 +00:00
ddd69f99e8
Bug 1504013 - Add the ability to measure loadtime in raptor, and use loadtime as the overall test result for tp6 suites; r=jmaher,acreskey
...
Differential Revision: https://phabricator.services.mozilla.com/D14306
--HG--
extra : moz-landing-system : lando
2018-12-27 21:35:13 +00:00
9526040894
Bug 1512038 - Handle different batterystats output for Raptor power tests on Android 7, r=rwood.
2018-12-21 06:12:19 -08:00
bea8a390ce
Bug 1512038 - Enable raptor-speedometer-geckoview-power for android-hw-{p2,g5} on try, r=rwood.
...
Rap-P treeherder group for Raptor power tests.
Emit separate PERFHERDER_DATA for power in addition to the performance measurements.
Use magic --host HOST_IP value to have framework load host ip from environment
variable HOST_IP.
2018-12-21 06:12:18 -08:00
bfc96ac22a
Bug 1473997 - Add support to Raptor to receive/format/output power data; r=jmaher
...
Depends on D14997
Differential Revision: https://phabricator.services.mozilla.com/D14998
--HG--
extra : moz-landing-system : lando
2018-12-19 21:13:55 +00:00
c2349ad0f8
Bug 1473997 - find a way to measure the battery usage of geckoview (:bc's initial patch); r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D14997
--HG--
extra : moz-landing-system : lando
2018-12-19 20:52:28 +00:00
70f9100da6
Bug 1511029 Mitmproxy alternate-server-replay returns last found request ignoring match algorithm r=acreskey
...
Mitmproxy alternate-server-replay returns last found request ignoring match algorithm
Differential Revision: https://phabricator.services.mozilla.com/D13408
--HG--
extra : moz-landing-system : lando
2018-12-19 14:19:30 +00:00
f658ebcbab
Merge mozilla-inbound to mozilla-central a=merge
2018-12-20 07:04:06 +02:00
e5e351a5a2
Bug 1515189 - Consolidate ADBDevice and ADBAndroid classes; r=bc
2018-12-19 14:04:02 -07:00
1435da9871
Bug 1513837 Add ebay to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D14543
--HG--
extra : moz-landing-system : lando
2018-12-18 17:45:07 +00:00
4508b0fd5b
Bug 1513373 Add Twitter to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D14542
--HG--
extra : moz-landing-system : lando
2018-12-18 17:02:55 +00:00
96ae71fa3f
Bug 1514752 Define hero user timing before performance entry is created r=rwood
...
1-line fix to hero element timing: the performance entry would show up as 'undefined' in profiles because the variable was defined later.
Differential Revision: https://phabricator.services.mozilla.com/D14746
--HG--
extra : moz-landing-system : lando
2018-12-17 22:40:43 +00:00
a63f5d5395
Bug 1506912 - Raptor support for tp6 pageload on android geckoview; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D14186
--HG--
extra : moz-landing-system : lando
2018-12-14 07:19:59 +00:00
06b85a3fce
Bug 1508375 Add Instagram to tp6 r=rwood,davehunt rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D12520
--HG--
rename : testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6-6.manifest => testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6-7.manifest
extra : moz-landing-system : lando
2018-12-12 21:23:34 +00:00
28ea3cc015
Bug 1509904 - always use backslashes on Windows, r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D12935
--HG--
extra : moz-landing-system : lando
2018-11-26 21:43:37 +00:00
8a44f27935
Bug 1509381 - Fix debug-mode page-cycles value when page-cycles < 2; r=Bebe
...
Differential Revision: https://phabricator.services.mozilla.com/D12704
--HG--
extra : moz-landing-system : lando
2018-11-23 11:26:18 +00:00
1e43108db5
Bug 1509009 - Fix proxy policy for raptor http pageload; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D12698
--HG--
extra : moz-landing-system : lando
2018-11-22 20:38:17 +00:00
6822f625cb
Bug 1508692 - Use Firefox policies instead of autoconfig for pageload tp6; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D12453
--HG--
extra : moz-landing-system : lando
2018-11-20 22:18:44 +00:00
208d16134b
Merge mozilla-inbound to mozilla-central a=merge
2018-11-20 07:03:17 +02:00
8ef2b84cb6
Bug 1503990 add additional pages to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D11058
--HG--
extra : moz-landing-system : lando
2018-11-20 01:21:38 +00:00
a269e5f630
Bug 1470450 - Add a debug mode to raptor; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D11937
--HG--
extra : moz-landing-system : lando
2018-11-16 19:30:55 +00:00
78cd9dab3f
Bug 1502036 - Subtest results for raptor speedometer have incorrect lower_is_better setting; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D12142
--HG--
extra : moz-landing-system : lando
2018-11-16 17:25:32 +00:00
c0b26c4076
Merge inbound to mozilla-central a=merge
2018-11-15 11:54:15 +02:00
d40e331dae
Bug 1499539 - Add a raptor command that will just list all available raptor tests; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D11379
--HG--
extra : moz-landing-system : lando
2018-11-14 22:12:03 +00:00
dcc74f176f
Bug 1499253 - fix setting chrome proxy arguments when using playback, r=rwood.
2018-11-13 19:02:40 -08:00
ce780910f7
Bug 1506917 - Don't attempt to check for updates from Firefox's nsBrowserGlue.js when running tests. r=ted
...
This adds the app.update.checkInstallTime pref with a value of false in all tests that have the app.update.disabledForTesting pref except for geckodriver which is covered by bug 1508283.
2018-11-19 07:33:33 -08:00
9c728df81e
Bug 1506404 - [raptor] Convert dos line endings to unix, r=rwood.
2018-11-14 17:48:49 -08:00
91a1fd6dbd
Bug 1499352 - [raptor] Allow the use of wifi and adb over tcp to serve pages, r=rwood.
2018-11-10 03:10:08 -08:00
87801ab786
Bug 1505428 raptor --page-cycles only works at 'subtest' level r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D11455
--HG--
extra : moz-landing-system : lando
2018-11-09 13:48:19 +00:00
34ed2a4281
Bug 1505526 - Rename existing raptor tp6 to tp6-1 and raptor gdocs to tp6-2; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D11234
--HG--
rename : testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6.manifest => testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6-1.manifest
rename : testing/raptor/raptor/playback/mitmproxy-recordings-raptor-gdocs.manifest => testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6-2.manifest
rename : testing/raptor/raptor/tests/raptor-tp6.ini => testing/raptor/raptor/tests/raptor-tp6-1.ini
rename : testing/raptor/raptor/tests/raptor-gdocs.ini => testing/raptor/raptor/tests/raptor-tp6-2.ini
extra : moz-landing-system : lando
2018-11-07 21:33:21 +00:00
3ff1ca5cb2
Bug 1505479 - Add raptor webext browser toolbar icon; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D11193
--HG--
extra : moz-landing-system : lando
2018-11-07 17:46:24 +00:00
bbc7462eda
Bug 1503398 - Increase page-cycle limit to 3 while gecko-profiling is on; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D10756
--HG--
extra : moz-landing-system : lando
2018-11-02 19:58:00 +00:00
194c521f36
Merge mozilla-central to mozilla-inbound. a=merge CLOSED TREE
2018-11-02 18:59:30 +02:00
6133912e19
Bug 1503999 - Enable e10s on the geckoview example app when running raptor; r=bc
...
Differential Revision: https://phabricator.services.mozilla.com/D10715
--HG--
extra : moz-landing-system : lando
2018-11-02 14:01:03 +00:00
5b64e46782
Bug 1491114 - Add ability to specify page_cycles and page_timeout on the command line; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D10599
--HG--
extra : moz-landing-system : lando
2018-11-01 19:54:37 +00:00
e8ccc57b1e
Bug 1501040 - Raptor fix so unsigned webext will load on mozilla-beta; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D10453
--HG--
extra : moz-landing-system : lando
2018-11-01 08:43:49 +00:00
f5b7112fd5
Bug 1502873 - More tweaks for raptor gecko profiling support; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D10267
--HG--
extra : moz-landing-system : lando
2018-10-31 21:24:58 +00:00
0f2e4886fa
Bug 1492913 - When gecko profiling is enabled locally, have resulting gecko profiles open automatically in perf-html.io; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D10300
--HG--
extra : moz-landing-system : lando
2018-10-30 23:23:39 +00:00
1dfcab1a30
Bug 1502922 - Add --gecko-profile flag support to mach try fuzzy for raptor and talos jobs; r=ahal
...
Differential Revision: https://phabricator.services.mozilla.com/D10114
--HG--
rename : taskcluster/taskgraph/templates/talos-profile.yml => taskcluster/taskgraph/templates/gecko-profile.yml
extra : moz-landing-system : lando
2018-10-30 15:15:32 +00:00
2c1a3776aa
Bug 1502483 raptor-test should test for presence of Git and emit an error message if it's not found r=rwood rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D10054
--HG--
extra : moz-landing-system : lando
2018-10-29 16:43:22 +00:00
d1b2d84bf4
Bug 1473079 - Add gecko profiling support to raptor (part 3: enable gecko profiling); r=jmaher
...
Depends on D6309
Differential Revision: https://phabricator.services.mozilla.com/D6918
--HG--
extra : moz-landing-system : lando
2018-10-29 13:35:21 +00:00
e154044f63
Bug 1473079 - Add gecko profiling support to raptor (part 2: limit page cycles); r=jmaher
...
Depends on D6286
Differential Revision: https://phabricator.services.mozilla.com/D6309
--HG--
extra : moz-landing-system : lando
2018-10-29 13:33:13 +00:00
6f148acd8e
Bug 1473079 - Add gecko profiling support to raptor (part 1: cmd line args); r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D6286
--HG--
extra : moz-landing-system : lando
2018-10-29 13:32:25 +00:00
a62c29cd3e
Bug 1502190 - bump mozdevice requirements for raptor, marionette, mozrunner, r=gbrown.
2018-10-26 09:51:37 -07:00
c5742407d9
Bug 1495903 - When running raptor on chromium, remove the webext from the cmd line after each test is finished; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D9709
--HG--
extra : moz-landing-system : lando
2018-10-24 20:18:41 +00:00
562d40574c
Bug 1501809 - Fix Raptor tp6 'main application timed out'; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D9714
--HG--
extra : moz-landing-system : lando
2018-10-24 22:30:50 +00:00
e6070d471c
Bug 1501788 - godot tweaks r=jmaher jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D9754
--HG--
extra : moz-landing-system : lando
2018-10-25 11:34:21 +00:00
c7398f447c
Bug 1493648 - Can we run the Godot Engine wasm benchmark in automation? r=jmaher
...
Reviewers: jmaher
Tags: #secure-revision
Bug #: 1493648
Differential Revision: https://phabricator.services.mozilla.com/D8957
2018-10-17 10:40:57 +03:00
4409ba6681
Bug 1501224 - Update version requirement on mozprofile for raptor; r=davehunt
...
Depends on D9515
Differential Revision: https://phabricator.services.mozilla.com/D9516
--HG--
extra : moz-landing-system : lando
2018-10-23 16:40:31 +00:00
48a9b391fa
Bug 1500236 - Have Raptor use '127.0.0.1' instead of 'localhost' to fix timeouts on OSX; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D9147
--HG--
extra : moz-landing-system : lando
2018-10-18 20:30:13 +00:00
56904c821f
Bug 1487374 benchmark_score for Sunspider Chrome is unnecessary r=jmaher jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D8838
--HG--
extra : moz-landing-system : lando
2018-10-16 12:48:19 +00:00
21874f0702
Bug 1496544 - Don't timeout the pageload / fail raptor test when TTFI is not available; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D8590
--HG--
extra : moz-landing-system : lando
2018-10-15 17:06:58 +00:00
8bee4877e5
Bug 1496226 - Be sure raptor's capturing of first-contentful-paint in google chrome is the correct entry; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D8731
--HG--
extra : moz-landing-system : lando
2018-10-15 15:43:13 +00:00
1e918164f2
Bug 1299118: Measure TTI (or TTFI at the moment) in Raptor TP6 r=rwood
2018-10-11 13:23:38 -04:00
0f211616dc
Backed out 3 changesets (bug 1299118) for ES lint failures
...
Backed out changeset 14451eb9a2b8 (bug 1299118)
Backed out changeset e5adc30bdf7f (bug 1299118)
Backed out changeset 8f7bb583fbb5 (bug 1299118)
2018-10-11 20:47:58 +03:00
94b05e1202
Bug 1299118: Measure TTI (or TTFI at the moment) in Raptor TP6 r=rwood
2018-10-11 13:23:38 -04:00
e1c323b919
Bug 1460742 - Add raptor 'tp6' for google chrome; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D7524
--HG--
extra : moz-landing-system : lando
2018-10-02 22:15:15 +00:00
24a553e036
Bug 1466648 - add unity3d benchmark to raptor/android; r=bc,jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D7114
--HG--
extra : moz-landing-system : lando
2018-10-01 19:01:57 +00:00
130b3341e6
Bug 1458242 - add DOMContentFlushed to tp6 as a measurement. r=rwood
...
add DOMContentFlushed to tp6, collect it and return the geometric mean of all measurements.
Differential Revision: https://phabricator.services.mozilla.com/D5797
--HG--
extra : moz-landing-system : lando
2018-09-14 13:51:05 +00:00
c4f0d02624
Bug 1478775 - Mark raptor test failed if any one test page times out r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D5463
--HG--
extra : moz-landing-system : lando
2018-09-13 19:17:10 +00:00
36100c0619
Bug 1471888 - Update mozprofile version used by raptor; r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D5594
--HG--
extra : moz-landing-system : lando
2018-09-11 21:09:23 +00:00
edc30e1b35
Bug 1488327 - Use new ADBDevice.reverse in Raptor r=rwood
...
Changed two occurrences of _cmd['reverse', port, port] to use the create_socket_connection method from 1484238.
Added code at end of clean_up() to remove opened socket connections.
Checked via manual execution of raptor-speedometer that opened reverse socket connections are removed at conclusion of test.
Differential Revision: https://phabricator.services.mozilla.com/D5286
--HG--
extra : moz-landing-system : lando
2018-09-07 20:11:55 +00:00
d421d8b58f
Bug 1478794 - Raptor should turn off the browser proxy after pageload tests are finished r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D5202
--HG--
extra : moz-landing-system : lando
2018-09-07 08:29:07 +00:00
67f06625a7
Bug 1461422 - Remove raptor/setup.py r=egao
...
Differential Revision: https://phabricator.services.mozilla.com/D5076
--HG--
extra : moz-landing-system : lando
2018-09-05 20:19:43 +00:00
b5430ee4da
Merge mozilla-central to autoland. a=merge CLOSED TREE
2018-09-05 15:42:52 +03:00
03af62563c
Bug 1488422 - Use boolean literal instead of string r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D5012
--HG--
extra : moz-landing-system : lando
2018-09-05 09:45:50 +00:00
1155dedeb1
Bug 1487244 - Remove mach's --debug-command argument before starting Raptor, r=gbrown.
2018-08-30 19:04:46 -07:00
7aed758f49
Bug 1487229 - Raptor should make sure app isn't already running before starting app, r=jmaher.
2018-08-30 19:04:46 -07:00
df0e8c3957
Bug 1486908 - ./mach raptor-test should prompt to install geckoview_example if needed, r=gbrown.
2018-08-30 19:04:46 -07:00
488c0b8b66
Bug 1486908 - Raptor should terminate with an exception if the app isn't installed during run_test, r=jmaher.
...
Otherwise the resourcemonitor will hang and it will wait 1800 seconds to timeout.
2018-08-30 19:04:46 -07:00
a09d9d7eaf
Bug 1486892 - Do not check for binary path when calling raptor via mach, r=jmaher.
2018-08-30 19:04:45 -07:00
111bbc5fbe
Bug 1488544 - Do not check for android device when running desktop raptor-test; r=rwood
2018-09-04 15:16:18 -06:00
49ed6e30bf
Bug 1486789 - support subtest units independent of benchmark units, set values for speedometer. r=ahal
...
allow support in .ini files for subtest units and lower_is_better values; implement this for speedometer.
Differential Revision: https://phabricator.services.mozilla.com/D4465
--HG--
extra : moz-landing-system : lando
2018-08-29 21:01:02 +00:00
924aa36a1b
Bug 1486788 - make sunspider lower_is_better and indicate it is a 'ms' benchmark. r=ahal
...
Adjust sunspider raptor test to make lower_is_better=true and treat it as 'ms' and not a 'score'
Differential Revision: https://phabricator.services.mozilla.com/D4454
--HG--
extra : moz-landing-system : lando
2018-08-28 16:30:58 +00:00
265d508303
Bug 1482151 - run wasm-misc in baseline and ion optional modes. r=ahal
...
move wasm-misc and unity3d benchmarks to tier2; run wasm-misc in different preferences
Differential Revision: https://phabricator.services.mozilla.com/D3903
--HG--
extra : moz-landing-system : lando
2018-08-21 18:21:40 +00:00
c0d0bc65ae
Bug 1481708 - run wasm-misc on desktop browsers. r=rwood
...
support wasm-misc as a benchmark in raptor
Differential Revision: https://phabricator.services.mozilla.com/D3616
--HG--
extra : moz-landing-system : lando
2018-08-17 19:22:29 +00:00
eeb6464d68
Bug 1480841 - Raptor support for running speedometer on geckoview r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D3446
--HG--
extra : moz-landing-system : lando
2018-08-17 18:06:22 +00:00
53873d772b
Bug 1482149 - raptor needs the ability to set preferences from configs. r=rwood
...
support adding prefs in raptor .ini files
Differential Revision: https://phabricator.services.mozilla.com/D3347
--HG--
extra : moz-landing-system : lando
2018-08-15 12:43:15 +00:00
3d3d8fe5f7
Bug 1482057 - [raptor] Fix benchmark setup on Windows, r=jmaher
...
This fixes a bug where the benchmarks weren't being copied properly on Windows.
While it is slightly slower to add every file to the manifest (~0.2 seconds), it
still outperforms shutil.copytree and is more robust (will use links on Linux/Mac
while using copy on Windows).
Differential Revision: https://phabricator.services.mozilla.com/D3234
--HG--
extra : moz-landing-system : lando
2018-08-14 18:06:20 +00:00
c9ecdec925
Bug 1473365 - migrate AWFY assortedDOM tests to a raptor benchmark r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D3046
--HG--
extra : moz-landing-system : lando
2018-08-13 21:30:33 +00:00
7dde9cf26e
Bug 1472800 - [ci] Add the raptor unity-webgl benchmark to taskcluster r=rwood
...
Enables the benchmark in CI, uses a fetch task to download the benchmark.
Depends on D2307.
Differential Revision: https://phabricator.services.mozilla.com/D2469
--HG--
extra : moz-landing-system : lando
2018-08-07 18:22:40 +00:00
5df71be96e
Bug 1472800 - [raptor] Add the unity-webgl benchmark r=rwood
...
This will run the benchmark in taskcluster as well as allow us to run it locally with:
./mach raptor-test -t raptor-unity-webgl
Depends on D2306.
Differential Revision: https://phabricator.services.mozilla.com/D2307
--HG--
extra : moz-landing-system : lando
2018-08-07 18:22:02 +00:00
a357cacbdb
Bug 1472800 - [raptor] Bootstrap webkit-benchmarks to the user's state dir r=rwood
...
Currently the benchmarks raptor runs are checked into the tree at:
third_party/webkit/PerformanceTests
However, some benchmarks are too big to vendor (200+MB). This patch will
clone a repo containing the benchmarks that *aren't* checked into the tree,
into the user's ~/.mozbuild directory. If the repo already exists, an update
will be run.
Differential Revision: https://phabricator.services.mozilla.com/D2306
--HG--
extra : moz-landing-system : lando
2018-08-07 18:21:08 +00:00
0f460b1379
Bug 1481037 - Update StyleBench. r=jmaher
...
Pick upstream changes.
Differential Revision: https://phabricator.services.mozilla.com/D2757
--HG--
extra : moz-landing-system : lando
2018-08-07 15:31:47 +00:00
ea00ef94a9
Bug 1504117 - [mozdevice] Bump mozdevice requirements to 1.1.6 for raptor, marionette, mozrunner, r=gbrown.
2018-11-02 08:04:02 -07:00
c70099b77d
Bug 1478057 - Report the mean of all measurements per pageload, not separate values per measurement type; r=igoldan
...
MozReview-Commit-ID: H0lYbZPFzMY
--HG--
extra : rebase_source : bcb5b801eeec0a585f49f9e4e638beecdd1ee7e2
2018-07-27 11:10:30 -04:00
b5fdd1ee41
Bug 1478443 - Fix Raptor webaudio benchmark (add webaudio back to the raptor webext manifest); r=ahal
...
MozReview-Commit-ID: FkrvLVKtKBh
--HG--
extra : rebase_source : 1de846f0f78d5fafea8e169d7b37f0d6a5a276ee
2018-07-25 14:09:21 -04:00
1d37fa795b
Bug 1436827 - add new raptor 'gdocs' pageload test suite (for google docs/slides/sheets); r=igoldan
...
MozReview-Commit-ID: EfhBJPgpyRc
--HG--
extra : rebase_source : 73e37a56af23f1a287e84fba4de4bf35016acba9
2018-07-20 11:50:48 -04:00
f1e3db10e4
Bug 1472803 - Rebase on latest m-i, resolve conflicts, address PR requests r=rwood
...
MozReview-Commit-ID: CnXZ6ucXbe1
--HG--
extra : rebase_source : 5fda301911496faaf6308b090cf09eeb79f7b8e7
2018-07-23 14:21:24 +03:00
0a75f53524
Bug 1472803 - Add dedicated parse method r=rwood
...
MozReview-Commit-ID: FEqq34xW02S
--HG--
extra : rebase_source : eda946c6f143d0709f28ff2373ebea2c123b059c
2018-07-19 14:17:31 +03:00
0eb2e670a3
Bug 1472803 - Add TaskCluster configs for Raptor's SunSpider; tweak new raptor ini r=jmaher,rwood
...
MozReview-Commit-ID: AKFMkb20vyS
--HG--
extra : rebase_source : a3ae3dea637c7b3bfe6e3bb75889cb74faf5a1e0
2018-07-19 12:11:42 +03:00
bdf791d659
Bug 1472803 - Run SunSpider in browser mode r=jmaher
...
MozReview-Commit-ID: GgWLVx5RveF
--HG--
extra : rebase_source : 3c00a1b0feb6831e3355e70022ae57e2d10be09b
2018-07-13 16:38:19 +03:00
15993592c1
Bug 1454053 - re-record tp6 pages for raptor; r=igoldan
...
MozReview-Commit-ID: Esy7cWeADdy
--HG--
rename : testing/raptor/raptor/playback/mitmproxy-playback-set.manifest => testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6.manifest
extra : rebase_source : 99437134717bb9df35a7b70c493c3166319aad44
2018-07-24 09:33:10 -04:00
04f65a0f76
Bug 1473334 - run the webaudio benchmark in raptor instead of AWFY. r=rwood
...
port the webaudio benchmark from arewefastyet.com to in-tree raptor.
Differential Revision: https://phabricator.services.mozilla.com/D2224
--HG--
extra : moz-landing-system : lando
2018-07-19 19:03:43 +00:00
da107c225e
Bug 1420514 - Replace app.update.enabled with app.update.disabledForTesting in the test harness r=ato,chutten,jmaher,lina
...
MozReview-Commit-ID: GCGKQ5QCC7o
--HG--
extra : rebase_source : ba135c7d285987fd030fef4e18a5aa701a43cdba
extra : intermediate-source : e6c89a0ff0c7a7e7cd1c028e49660bab0416a531
extra : source : 646080a591c0d2365d6e8f4a493607fa3fff86c9
2018-05-22 09:14:19 -07:00
1e8d2e6f7d
Backed out 7 changesets (bug 1420514) for breaking bc on different files on a CLOSED TREE
...
Backed out changeset 5a46a221b6e8 (bug 1420514)
Backed out changeset 48ed6dfe8772 (bug 1420514)
Backed out changeset 01bf643c77e5 (bug 1420514)
Backed out changeset 5791b17ccb82 (bug 1420514)
Backed out changeset 416e398d942f (bug 1420514)
Backed out changeset de4a4592dbd9 (bug 1420514)
Backed out changeset d3399edf0197 (bug 1420514)
2018-07-12 21:22:32 +03:00
35d8c30dbb
Bug 1420514 - Replace app.update.enabled with app.update.disabledForTesting in the test harness r=ato,chutten,jmaher,lina
...
MozReview-Commit-ID: GCGKQ5QCC7o
--HG--
extra : rebase_source : e38cf587711192c3020cd9ac6a39cdbd97d2600b
extra : source : 646080a591c0d2365d6e8f4a493607fa3fff86c9
2018-05-22 09:14:19 -07:00
27356a6aa3
Bug 1473907 - adjust raptor default timeout while waiting for browser closure from 75 seconds to 15 seconds. r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D2002
--HG--
extra : moz-landing-system : lando
2018-07-06 15:22:11 +00:00
bab63d85df
Bug 1471908 - 'OSError' when raptor shutsdown the browser on win32/64. r=rwood
...
raptor has two calls to proc.wait() and this isn't needed. We can monitor the browser_proc and timeout if we go too long. Also this fixes the timeout that we use since it was never used to timeout the browser process.
Differential Revision: https://phabricator.services.mozilla.com/D1972
--HG--
extra : moz-landing-system : lando
2018-07-05 18:11:57 +00:00
49994d39f4
Bug 1467824 - Port raptor-speedometer google chrome to linux64; r=jmaher
...
MozReview-Commit-ID: Ak2dq9zI9Nw
--HG--
extra : rebase_source : dd1df4e91c32072e4bf8e95e274b0777ef7ca604
2018-07-04 16:20:37 -04:00
04c2aebe5f
Bug 1468865 - Port raptor firefox tp6 to win; r=jmaher
...
MozReview-Commit-ID: 78VGzPkhkww
--HG--
extra : rebase_source : bffe3cfdd3384ebbff41c01347dde03f656935a7
2018-06-26 17:56:20 -04:00
9435736ade
Bug 1471620 - Skip python-tests locally that don't run with python 3 in CI r=davehunt
...
This will make sure that when running |mach python-test --python 3| locally,
we only run the tests that also run in CI with python 3 (and therefore pass
presumably).
MozReview-Commit-ID: 3OBr9yLSlSq
--HG--
extra : rebase_source : 456340d0ecdddf1078f2b5b4ebb1eddf3813b26a
2018-06-27 11:10:02 -04:00
7b326fba08
Bug 1469280 - Fix raptor speedometer score calculation. r=rwood
...
ensure that raptor summarizes data properly from all benchmarks
Differential Revision: https://phabricator.services.mozilla.com/D1815
2018-06-26 10:53:05 +00:00
9c7f5155eb
Bug 1466853 - Port stylebench and motionmark benchmarks test from talos to raptor. r=rwood
...
stylebench and motionmark run in talos, we want these running in raptor
Differential Revision: https://phabricator.services.mozilla.com/D1814
2018-06-25 20:28:58 +00:00
c69268f5dd
Bug 1468535 - Port raptor-speedometer firefox to linux64; r=jmaher
...
MozReview-Commit-ID: 2guFxLN3yLq
--HG--
extra : rebase_source : ffddd40608baaccb4a44eb142e43ad991cc5ab73
2018-06-22 11:24:38 -04:00
9862c7afdc
Backed out changeset 96496ebab2d9 (bug 1466853) for StyleBench failures on a CLOSED TREE
2018-06-22 02:51:38 +03:00
2495332bb2
Bug 1466853 - Port stylebench and motionmark benchmarks test from talos to raptor. r=rwood
...
Currently stylebench and motionmark run on talos, these are ideal benchmarks to run on raptor
Differential Revision: https://phabricator.services.mozilla.com/D1752
2018-06-21 21:00:41 +00:00
977ed7b22b
Backed out changeset 683a682e52b2 (bug 1466853) for flake fail on checkouts/gecko/testing/raptor/raptor/benchmark.py on a CLOSED TREE
2018-06-21 23:57:30 +03:00
63ddbd28ee
Bug 1466853 - Port stylebench and motionmark benchmarks test from talos to raptor. r=rwood
...
Currently stylebench and motionmark run on talos, these are ideal benchmarks to run on raptor
Differential Revision: https://phabricator.services.mozilla.com/D1752
2018-06-21 20:34:51 +00:00
685ce41033
Bug 1467827 - Port raptor firefox tp6 to linux; r=jmaher
...
MozReview-Commit-ID: AQuWSuw7cFw
--HG--
extra : rebase_source : 7c74a2a31c0fdac89b9fd0950e5a53cd64e2d7f5
2018-06-13 14:04:46 -07:00
978d9b823c
Bug 1460743 - Add 'speedometer' benchmark to raptor for google chrome; r=jmaher
...
Includes a temporary downloading/installing Chrome 'hack' just so we can get going on try, until 'official' chrome builds are available in CI. Also some small raptor fixes/changes to support speedometer on chrome.
MozReview-Commit-ID: 8ZBlOg0BOE4
--HG--
extra : rebase_source : 8271a7b9efd6b1d30e363eb47876d82f243d5ca7
2018-06-04 15:42:44 -04:00
ee248fc775
Bug 1460741 - Add 'speedometer' benchmark to raptor for firefox; r=jmaher
...
MozReview-Commit-ID: 6eTJhUJv3y9
--HG--
extra : rebase_source : 5649ab3a3f228e9fc6966bad254b9ff4d8b2f1bd
2018-05-15 14:50:48 -04:00
02be8e9f99
Bug 1461676 - Expand raptor firefox tp6 to include the other pages; r=jmaher
...
MozReview-Commit-ID: Kzn9sRz8rip
--HG--
extra : rebase_source : e858f3a4e2b4b82ab72d90d47de32834a610b69d
2018-05-31 16:09:09 -04:00
736da4ed3d
Bug 1462783 - Artifact raptor test results in treeherder; r=ahal
...
MozReview-Commit-ID: FYXU2nVhn3n
--HG--
extra : rebase_source : 9ae83608d6bd7f94736ade618312099d02d8bce5
2018-05-24 10:50:39 -04:00
7844966513
Bug 1450069 - Have the raptor control server shutdown the browser; r=ahal
...
Having the control server shutdown the browser via the browser pid is a better (and cross-browser) solution.
MozReview-Commit-ID: 19Gwg5TwIIy
--HG--
extra : rebase_source : d1321889d784e526d2f5ec8a593000d97b7f0927
2018-05-23 18:45:51 -04:00
4f36739d0a
Bug 1462776 - Add subtest support to raptor; r=ahal
...
Some minor changes to allow running subtests in Raptor. With this patch (and the other commit in this series) you can run raptor tests that have mutliple subtests. For example, you can specify a raptor test INI and every test inside that INI will be run and ultimately reported as subtests. This will allow, for example, the raptor tp6 test to have multiple testpages. Also just one of the subtests itself can be specified to be run instead of the entire INI.
MozReview-Commit-ID: Fto7wNOzRft
--HG--
extra : rebase_source : 37d02fb43354fa0a799c7af9ea41c16670f2244c
2018-05-23 15:14:41 -04:00
c2edc6eaf3
Bug 1462776 - Run single raptor test or multiple subtests based on test name cmd line arg; r=ahal
...
MozReview-Commit-ID: 3hVDkEgqCD
--HG--
extra : rebase_source : 1a5108ee6e94323b98b8ad484585dad69a473f7c
2018-05-18 15:33:26 -04:00
4fdc780fad
Bug 1461414 - Add a post-browser startup delay and a pagecycles delay; r=jmaher
...
MozReview-Commit-ID: DWawXf6qWsF
--HG--
extra : rebase_source : a4918025bd75ab42cf8bc625cb75d8226ccee5af
2018-05-16 14:52:55 -04:00
f49fd4e88b
Bug 1449195 - Process raptor test results and format for output; r=jmaher
...
MozReview-Commit-ID: JJ6shYJ2cG5
--HG--
extra : rebase_source : 249fe22f6bd5ddd648ac5b906038e97e6a420c6d
2018-05-03 12:00:57 -04:00
970f7e41b1
Bug 1458571 - Use base testing/profiles in raptor, r=rwood
...
This gets raptor to use the newly created "perf" profile that talos
also uses. There is a single pref that raptor sets that we can't set
in talos. To that end, this also creates a "raptor" specific profile.
This means to set a pref in talos and raptor, edit:
testing/profiles/perf/user.js
To set a pref in raptor only, edit:
testing/profiles/raptor/user.js
The performance of extensions can now be tested by dropping the
extension into:
testing/profiles/perf/extensions
MozReview-Commit-ID: LEJeytmmiFF
--HG--
extra : rebase_source : 0d2a6b18868f8cc6ff198ef868ad0324b57b1dc2
2018-05-04 11:19:49 -04:00
b75b06de95
Bug 1459251 - Running |mach raptor-test| with no test specified results in a traceback; r=ahal
...
MozReview-Commit-ID: 9yggrydEoJv
--HG--
extra : rebase_source : 2c4367350b1b3ee496e620c4190e4fd32963a951
2018-05-04 13:46:03 -04:00
6930542f6f
Bug 1455872 - Raptor fixes for production; r=ahal
...
MozReview-Commit-ID: KVqypuqHjF9
--HG--
extra : rebase_source : 16a8a7ff6097e050b820c5d341ccee5d676df5bd
2018-05-01 14:02:39 -04:00
8b76a9ff3c
Bug 1455107 - Integrate raptor into mach; r=gbrown
...
MozReview-Commit-ID: 84vIqU2NWkE
--HG--
extra : rebase_source : ac5454192271d19b4da448e6be2f97dbb3420828
2018-04-23 16:43:30 -04:00
a71d99bc3e
Bug 1449199 - Mitmproxy integration with raptor for OSX; r=jmaher
...
MozReview-Commit-ID: 1Nnny3OynQw
--HG--
rename : testing/raptor/raptor/tests/raptor-firefox-tp7.ini => testing/raptor/raptor/tests/raptor-firefox-tp6.ini
extra : rebase_source : 75f109508bcfd015d82c5995a7c8ff1644a50029
2018-04-24 09:25:47 -04:00
4af496d7f2
Bug 1454466 - Move raptor in-tree; r=ahal
...
MozReview-Commit-ID: AkqbROfvmbu
--HG--
extra : rebase_source : bf30030a333852d6d81c4278e91b1ac9fef237fe
2018-04-16 17:15:38 -04:00
Henrik Skupin
Florin Strugariu
Stephen Donner
alexandru.ionescu
Marian Raiciof
Rob Wood
shindli
Nick Alexander
Tarek Ziadé
marian.raiciof
Joel Maher
Kartikaya Gupta
Andrew Erickson
Florin Strugariu
Narcis Beleuzu
Cosmin Sabou
Greg Tatum
Brindusan Cristian
Junior Hsu
Ionut Goldan
Andrew Halberstadt
Bob Clary
Myk Melez
Dave Hunt
Geoff Brown
Razvan Maries
Andrew Creskey
Gijs Kruitbosch
arthur.iakab
Robert Strong
Ciure Andrei
Raphael Pierzina
Randell Jesup
Edwin Gao
Margareta Eliza Balazs
Emilio Cobos Álvarez
Kirk Steuber
Andreea Pavel
Gurzau Raul