40ff099e27
Bug 1549669 - [raptor] Handle "--disable-e10s" argument to avoid causing fennec tests to fail r=perftest-reviewers,whimboo,ahal,rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D30171
--HG--
extra : moz-landing-system : lando
2019-05-14 11:50:00 +00:00
2c218a311e
Bug 1548689: Hook idle-power-usage tests up to CI. r=perftest-reviewers,rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D30456
--HG--
extra : moz-landing-system : lando
2019-05-13 20:33:15 +00:00
4a55597f03
Bug 1550828: String fixes and minor cleanup for power.py and Raptor's mach_commands.py. r=bc
...
Differential Revision: https://phabricator.services.mozilla.com/D30775
--HG--
extra : moz-landing-system : lando
2019-05-11 08:13:29 +00:00
3dc303757f
Bug 1549948 Fenix jobs are failing with "activity class does not exist" r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D30359
--HG--
extra : moz-landing-system : lando
2019-05-13 07:30:08 +00:00
1b56450c60
Bug 1549843 - implement jitter reduction for Motorola G5 r=jmaher,rwood
...
Changes:
- implement cpu, gpu, memory bus and other kernel tweaks for Motorola G5 to complement D30116
Differential Revision: https://phabricator.services.mozilla.com/D30715
--HG--
extra : moz-landing-system : lando
2019-05-10 21:15:20 +00:00
e14f62f15c
Merge mozilla-central to autoland on a CLOSED TREE
2019-05-10 13:01:38 +03:00
9d23aa6093
Bug 1549949 Errors on launching activities are causing timeouts r=perftest-reviewers,davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D30343
--HG--
extra : moz-landing-system : lando
2019-05-10 09:32:00 +00:00
f5f94453ae
Backed out changeset ba9d948d404c (bug 1544470) for breaking raptor-chromium a=backout
2019-05-10 11:35:42 +03:00
80fbae9239
Bug 1544470 - Added in code that can be used to take a snapshot of CPU usage on Android devices; r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D27954
--HG--
extra : moz-landing-system : lando
2019-05-09 20:39:43 +00:00
1298ea44c8
Bug 1547135 - reduce tp6m test result jitter for Android (Pixel 2) r=jmaher,acreskey,rwood
...
All changes are reversible upon reboot, with exception of the animation setting which is restored to default settings once Raptor concludes testing.
All values are for Pixel 2. Motorola G5 patch will be available separately.
Changes:
- set cpu/gpu to `performance` mode, and override minimum frequency with the maximum available frequency
- tweak msm-bus related kernel settings
- set display to be permanently on when connected over USB
- disable animation for duration of test
- turn off thermal throttling
Differential Revision: https://phabricator.services.mozilla.com/D30116
--HG--
extra : moz-landing-system : lando
2019-05-09 16:35:27 +00:00
70d07476cb
Bug 1541041 Page timeouts are ignored during cold page-load test suites r=rwood,davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D26309
--HG--
extra : moz-landing-system : lando
2019-05-08 18:29:56 +00:00
ab23804ea9
Bug 1548577 - Add missing chromium counterparts r=perftest-reviewers,rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D30188
--HG--
extra : moz-landing-system : lando
2019-05-08 19:39:10 +00:00
d229732882
Bug 1548987: pypi.python.org should now just be pypi.org in mach_commands.py. r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D29985
--HG--
extra : moz-landing-system : lando
2019-05-08 17:50:21 +00:00
e52c3cef40
Bug 1546741. Land initial idle-power-usage-measurement test for Android. r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D29654
--HG--
extra : moz-landing-system : lando
2019-05-08 19:21:12 +00:00
046bef30c3
Bug 1545186 - Raptor test definitions and taskcluster configs for cold page-load tests on GeckoView Example App; #perftest r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D29207
--HG--
extra : moz-landing-system : lando
2019-05-03 15:53:27 +00:00
9914e7d5ec
Bug 1519884: Improve help text for --test argument r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D29541
--HG--
extra : moz-landing-system : lando
2019-05-01 19:26:41 +00:00
0678c2e034
Bug 1522972 - Raptor cold-load tests on Firefox and Chromium desktop; #perftest r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D29032
--HG--
extra : moz-landing-system : lando
2019-05-01 14:52:59 +00:00
fc6a577886
Bug 1547069 - [raptor] Always take a screenshot on page load timeouts. r=perftest-reviewers,rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D29178
--HG--
extra : moz-landing-system : lando
2019-04-30 07:59:28 +00:00
3b68194ffa
Bug 1547069 - [raptor] Refactoring screen capturing code in web extension. r=perftest-reviewers,rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D29177
--HG--
extra : moz-landing-system : lando
2019-04-30 07:59:11 +00:00
e1bb9a3e44
Bug 1547069 - [raptor] Reduce CPU overhead when waiting for results. r=perftest-reviewers,rwood
...
The method checkForResult is called each and every 5 milliseconds while the Raptor
tests are running. This actually consumes a lot of CPU which can decrease the
performance of the website under test.
It's totally enough to check for results 4 times in a minute.
Differential Revision: https://phabricator.services.mozilla.com/D29176
--HG--
extra : moz-landing-system : lando
2019-04-30 07:58:56 +00:00
f45dee943e
Bug 1547069 - [raptor] Generalize code in waitForResult(). r=perftest-reviewers,rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D29175
--HG--
extra : moz-landing-system : lando
2019-04-30 07:58:35 +00:00
fdfa7dd694
Bug 1544686 - [raptor] Allow CLI arguments to override Gecko profiler settings from test manifest. r=perftest reviewers,rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D28047
--HG--
extra : moz-landing-system : lando
2019-04-29 13:35:51 +00:00
27e49c37df
Bug 1544686 - [raptor] Make Gecko profiler threads customizable in the harness. r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D28046
--HG--
extra : moz-landing-system : lando
2019-04-23 15:37:30 +00:00
f957b3ea28
Bug 1544686 - [raptor] Fix Gecko profiler settings. r=rwood
...
When the Gecko profiler is enabled the interval and entries as specified
in manifest files aren't correctly set. Instead the default values from
the extension are always used.
Also with WebRender enabled the threads are "WR", and "Renderer", but
not "WR,Renderer".
Differential Revision: https://phabricator.services.mozilla.com/D28045
--HG--
extra : moz-landing-system : lando
2019-04-23 15:37:29 +00:00
d3d1d11735
Bug 1544356 4 - 281% raptor-tp6 regression r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D28598
--HG--
extra : moz-landing-system : lando
2019-04-26 12:49:09 +00:00
8f9aff6a55
Bug 1513467 - Disable raptor-tp6-amazon-firefox due to frequent failures. r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D29090
--HG--
extra : moz-landing-system : lando
2019-04-27 02:06:28 +00:00
b77e627ac4
Bug 1546611 - [raptor] Fix None checks when validating test manifests. r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D28642
--HG--
extra : moz-landing-system : lando
2019-04-26 12:48:02 +00:00
bb1110b6b8
Bug 1547074 - [raptor] Rename measure.js and benchmark-relay.js. r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D28896
--HG--
rename : testing/raptor/webext/raptor/benchmark-relay.js => testing/raptor/webext/raptor/benchmark.js
rename : testing/raptor/webext/raptor/measure.js => testing/raptor/webext/raptor/pageload.js
extra : moz-landing-system : lando
2019-04-26 05:13:42 +00:00
ac0b8d3376
Bug 1546704 - Fix subtest names for cold page-load Fenix suites; r=Bebe
...
Differential Revision: https://phabricator.services.mozilla.com/D28708
--HG--
extra : moz-landing-system : lando
2019-04-25 11:13:34 +00:00
e86db915f3
Bug 1506928 - [raptor] Use signal handler for safe shutdown. r=rwood,tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D25752
--HG--
extra : moz-landing-system : lando
2019-04-24 19:06:06 +00:00
317dd0b163
Bug 1506928 - [raptor] "get()" defaults to None by default if key isn't found. r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D27640
--HG--
extra : moz-landing-system : lando
2019-04-24 09:31:52 +00:00
dbdb18ef72
Bug 1506928 - [raptor] Fix inheritance of methods in raptor classes. r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D27639
--HG--
extra : moz-landing-system : lando
2019-04-24 09:31:37 +00:00
d8fa03fe11
Bug 1506928 - [raptor] Refactor arguments for constructors of Raptor classes. r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D25751
--HG--
extra : moz-landing-system : lando
2019-04-24 19:06:13 +00:00
e748412851
Bug 1506928 - [raptor] Handle "MOZ_UPLOAD_DIR" as optional in Output class. r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D25750
--HG--
extra : moz-landing-system : lando
2019-04-24 19:06:16 +00:00
f0ae2f4c0a
Bug 1546178 - Fix live-sites support when running Raptor cold page-load on android; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D28399
--HG--
extra : moz-landing-system : lando
2019-04-23 18:09:43 +00:00
f74efede94
Bug 1518793 Add Microsoft Office to tp6 r=AlexandruIonescu
...
Differential Revision: https://phabricator.services.mozilla.com/D27663
--HG--
extra : moz-landing-system : lando
2019-04-22 15:39:00 +00:00
bb78bfab8c
Bug 1545722 remove raptor-tp6-8-404 jobs r=AlexandruIonescu
...
Differential Revision: https://phabricator.services.mozilla.com/D28180
--HG--
extra : moz-landing-system : lando
2019-04-19 08:51:28 +00:00
2aab02dcd9
Bug 1533283 Intermittent timeouts running raptor-tp6m-google-restaurants-geckoview r=AlexandruIonescu
...
Differential Revision: https://phabricator.services.mozilla.com/D28182
--HG--
extra : moz-landing-system : lando
2019-04-22 09:17:11 +00:00
1105b8f744
Bug 1545175 - Raptor test definitions and taskcluster configs for cold page-load tests on Fenix; r=Bebe,jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D27964
--HG--
extra : moz-landing-system : lando
2019-04-18 19:34:10 +00:00
af84858720
Bug 1532747 - Create try-only raptor tp6m-1 fenix task, r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D27948
--HG--
extra : moz-landing-system : lando
2019-04-17 19:49:52 +00:00
ec6fa081bc
Bug 1544702 Clear app data between tests when running mobile warm raptor tests r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D27652
--HG--
extra : moz-landing-system : lando
2019-04-18 10:34:15 +00:00
dafcfb1456
Bug 1544707 - [raptor] Use format strings instead of concatenating log messages. r=rwood
...
Depends on D27812
Differential Revision: https://phabricator.services.mozilla.com/D27813
--HG--
extra : moz-landing-system : lando
2019-04-18 06:42:00 +00:00
647820f87f
Bug 1544707 - [raptor] Move most of if/elif blocks for testType to switch statements. r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D27812
--HG--
extra : moz-landing-system : lando
2019-04-18 06:41:42 +00:00
57bf658be0
Bug 1544516 - Add ability to specify intent when launching android app; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D27570
--HG--
extra : moz-landing-system : lando
2019-04-18 12:46:13 +00:00
2554c77019
Backed out changeset 20bbaead9017 (bug 1519884) for causing mozlint failure in /builds/worker/checkouts/gecko/testing/raptor/raptor/cmdline.py CLOSED TREE
2019-04-17 19:44:49 +03:00
438d9c71b3
Bug 1519884: Improve help text for --test argument r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D27608
--HG--
extra : moz-landing-system : lando
2019-04-17 14:17:35 +00:00
987bd630c6
Bug 1543996 Add test configurations for reference browser r=davehunt,rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D27284
--HG--
extra : moz-landing-system : lando
2019-04-17 13:34:23 +00:00
752022eeda
Bug 1533848 - Implement Android memory test using control server waits, r=rwood.
...
Depends on D26973
Differential Revision: https://phabricator.services.mozilla.com/D26974
--HG--
extra : moz-landing-system : lando
2019-04-16 18:55:34 +00:00
5968316eb9
Bug 1533848 - Suppress HTTP 200 request log output, r=rwood.
...
Depends on D26972
Differential Revision: https://phabricator.services.mozilla.com/D26973
--HG--
extra : moz-landing-system : lando
2019-04-16 18:26:44 +00:00
73d6f12ca4
Bug 1533848 - Make the control server multithreaded, r=rwood.
...
Differential Revision: https://phabricator.services.mozilla.com/D26972
--HG--
extra : moz-landing-system : lando
2019-04-16 19:26:26 +00:00
ae84bf2e0a
Bug 1518791 Add Microsoft Outlook to tp6 r=davehunt
...
Recording in bug comment.
https://drive.google.com/open?id=1p1hCJfW-d0gbEZNWHP3NMIr4sI3lPHEV
Differential Revision: https://phabricator.services.mozilla.com/D26143
--HG--
extra : moz-landing-system : lando
2019-04-15 07:50:35 +00:00
debe0f9baf
Bug 1513835 Add LinkedIn to tp6 r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D26896
--HG--
extra : moz-landing-system : lando
2019-04-12 17:03:32 +00:00
e0060de75c
Bug 1539437 - Replace Chrome with Chromium mentionings where needed r=sparky,davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D25094
--HG--
rename : taskcluster/ci/test/raptor-chrome.yml => taskcluster/ci/test/raptor-chromium.yml
extra : moz-landing-system : lando
2019-04-12 10:33:24 +00:00
4348f3974a
Bug 1509835 Raptor test raptor-tp6-amazon-chrome is not rendering a completely loaded amazon site r=tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D25597
--HG--
extra : moz-landing-system : lando
2019-04-09 09:49:03 +00:00
528fad068d
Bug 1519827 Measure "loadtime" in all tp6 tests r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D26674
--HG--
extra : moz-landing-system : lando
2019-04-11 07:22:17 +00:00
e8b1485d83
Bug 1533304 - remove disabled attribute for raptor-tp6m-bbc-geckoview r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D26665
--HG--
extra : moz-landing-system : lando
2019-04-10 12:53:29 +00:00
0870b461b1
Bug 1533666 - Remove disabled attribute for raptor-tp6m-cnn-ampstories-geckoview r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D26662
--HG--
extra : moz-landing-system : lando
2019-04-10 12:52:04 +00:00
1ffc7bf45a
Bug 1533306 - remove disabled attribute for raptor-tp6m-microsoft-support-geckoview r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D26670
--HG--
extra : moz-landing-system : lando
2019-04-10 12:57:25 +00:00
c4d7037af0
Bug 1542757 - Investigate and fix TEST-UNEXPECTED-FAIL: test 'raptor-tp6-paypal-chrome' r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D26524
--HG--
extra : moz-landing-system : lando
2019-04-08 17:20:16 +00:00
faeccf1361
Bug 1532545 Add support for running page load tests against Fennec r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D25723
--HG--
extra : moz-landing-system : lando
2019-04-08 17:47:59 +00:00
226e9fab72
Bug 1533008 - Fix Raptor Chromium OSX jobs by using mock-keychain; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D25861
--HG--
extra : moz-landing-system : lando
2019-04-04 14:54:38 +00:00
f1eb1ac35c
Bug 1538201 - Correctly extract subtest_lower_is_better value r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D25781
--HG--
extra : moz-landing-system : lando
2019-04-03 20:07:38 +00:00
e539398061
Bug 1541215 - [raptor] Use proper timeout values for test_start_browser. r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D25859
--HG--
extra : moz-landing-system : lando
2019-04-04 06:12:45 +00:00
e0b05f4996
Bug 1541215 - [raptor] Make post_startup_delay configurable. r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D25857
--HG--
extra : moz-landing-system : lando
2019-04-04 06:13:05 +00:00
e282f9c968
Bug 1541215 - [raptor] Check for failures in spawned thread for test_start_browser. r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D25855
--HG--
extra : moz-landing-system : lando
2019-04-04 06:12:23 +00:00
2bb8060847
Bug 1541215 - [raptor] Fall back to 1 browser_cycle / page_cycle if test doesn't specify a value. r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D25854
--HG--
extra : moz-landing-system : lando
2019-04-04 06:12:38 +00:00
f0624a23a4
Bug 1540629 remove screenshots from tp6-8-404 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D25563
--HG--
extra : moz-landing-system : lando
2019-04-01 15:00:50 +00:00
f9d59415ac
Bug 1534778. Abstract and enable power tests for non-GeckoView browsers. r=rwood,bc
...
Differential Revision: https://phabricator.services.mozilla.com/D24971
--HG--
extra : moz-landing-system : lando
2019-03-29 18:47:35 +00:00
1902546a62
Bug 1534628 add benchmark measurement to raptor error handeling r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D23304
--HG--
extra : moz-landing-system : lando
2019-03-29 14:36:56 +00:00
e2de20e8a8
Bug 1536095 - Add aframe.io Animation page to tp6-m r=davehunt,rwood
...
Bug 1536095 - Add aframe.io Animation page to tp6-m
Differential Revision: https://phabricator.services.mozilla.com/D23862
--HG--
extra : moz-landing-system : lando
2019-03-29 14:41:31 +00:00
548250ddec
Bug 1536758 Switch to using event listener instead of overloading window.onload in runner/measure.js r=acreskey
...
Differential Revision: https://phabricator.services.mozilla.com/D24163
--HG--
extra : moz-landing-system : lando
2019-03-29 13:14:33 +00:00
2efaefdfc3
Bug 1539438 - Expand tp6m-cold-1; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D25060
--HG--
extra : moz-landing-system : lando
2019-03-29 13:28:06 +00:00
5ef71add7a
Bug 1457274 Upgrade mitmproxy in production r=rwood,tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D21374
--HG--
rename : testing/raptor/raptor/playback/alternate-server-replay.py => testing/raptor/raptor/playback/alternate-server-replay-2.0.2.py
extra : moz-landing-system : lando
2019-03-29 09:54:53 +00:00
a720305501
Bug 1536874 - Temporarily remove measuring TTFI and Hero elements in order to stabilize pageload tests; r=Bebe
...
Differential Revision: https://phabricator.services.mozilla.com/D25112
--HG--
extra : moz-landing-system : lando
2019-03-28 09:44:47 +00:00
b309039307
Bug 1538786 - Fix 'KeyError: suites' when a tp6 page times out; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D24881
--HG--
extra : moz-landing-system : lando
2019-03-27 09:10:39 +00:00
8af903f814
Backed out changeset 030cb27161ee (bug 1538786) for raptor failures in testing/raptor/test/test_manifest.py::test_get_raptor_test_list_firefox CLOSED TREE
2019-03-26 04:52:51 +02:00
b6d015016c
Bug 1538786 - Fix 'KeyError suites' when a tp6 page times out; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D24746
--HG--
extra : moz-landing-system : lando
2019-03-25 19:30:38 +00:00
17dec601e9
Bug 1533423 - Raptor cold page-load support for Firefox android geckoview; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D24464
--HG--
extra : moz-landing-system : lando
2019-03-22 15:27:27 +00:00
6eea3b81dc
Bug 1536112 - testing/raptor misses moz.build file. r=ahal
...
Differential Revision: https://phabricator.services.mozilla.com/D23936
--HG--
extra : moz-landing-system : lando
2019-03-19 03:45:24 +00:00
7a1c539e39
Bug 1521967 - Part 1: Use MOZ_HOST_BIN to find certutil in `mach raptor-test` for Android. r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D17396
--HG--
extra : moz-landing-system : lando
2019-03-18 16:50:57 +00:00
05db28a64b
Bug 1534956 - Add Cristiano's facebook page to tp6-m r=Bebe
...
Differential Revision: https://phabricator.services.mozilla.com/D23317
--HG--
extra : moz-landing-system : lando
2019-03-15 11:46:22 +00:00
2f3c136a11
Bug 1534788 - add the playback_args option r=Bebe,rwood
...
This patch also removes custom_script and stops
executing start() in the constructor.
Differential Revision: https://phabricator.services.mozilla.com/D23288
--HG--
extra : moz-landing-system : lando
2019-03-13 14:50:03 +00:00
45cd40fa58
Bug 1527849 Add google search to tp6-m r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D19907
--HG--
extra : moz-landing-system : lando
2019-03-13 10:31:34 +00:00
29cb950a1e
Bug 1490048 - add cranelift to raptor wasm-misc and wasm-godot tests. r=bbouvier,rwood
...
add cranelift to raptor wasm-misc and wasm-godot tests.
Differential Revision: https://phabricator.services.mozilla.com/D23144
--HG--
extra : moz-landing-system : lando
2019-03-12 14:42:45 +00:00
5486eb421d
Bug 1533517 - [mozdevice] Remove FirefoxOS candidate test root paths. r=bc
...
Differential Revision: https://phabricator.services.mozilla.com/D22952
--HG--
extra : moz-landing-system : lando
2019-03-12 13:55:51 +00:00
63eb0a0132
Bug 1532671 output what measurements are still pending though when there is a page timeout in raptor r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D22107
--HG--
extra : moz-landing-system : lando
2019-03-12 12:16:09 +00:00
899b667ee0
Bug 1529207 - Add new Raptor tests in tp6m-4 r=davehunt,rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D20852
--HG--
extra : moz-landing-system : lando
2019-03-12 12:01:27 +00:00
78eb1bc26f
Bug 1529212 Add new Raptor tests in tp6m-7 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D21000
--HG--
extra : moz-landing-system : lando
2019-03-11 14:30:12 +00:00
941c77dc3a
Bug 1529211 Add new Raptor tests in tp6m-6 r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D20820
--HG--
extra : moz-landing-system : lando
2019-03-07 16:37:30 +00:00
9ed1006ca9
Bug 1528992 - extract raptor mitmproxy integration - r=rwood,Bebe,gbrown
...
This patch moves testing/raptor/raptor/playback into its own testing package in testing/mozbase/mozproxy
so we can use the proxy in other places than Raptor.
Differential Revision: https://phabricator.services.mozilla.com/D21200
--HG--
rename : testing/raptor/raptor/playback/__init__.py => testing/mozbase/mozproxy/mozproxy/__init__.py
rename : testing/raptor/raptor/playback/base.py => testing/mozbase/mozproxy/mozproxy/backends/base.py
rename : testing/raptor/raptor/playback/mitmproxy.py => testing/mozbase/mozproxy/mozproxy/backends/mitm.py
rename : testing/raptor/raptor/playback/mitmproxy-rel-bin-linux64.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-linux64.manifest
rename : testing/raptor/raptor/playback/mitmproxy-rel-bin-osx.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-osx.manifest
rename : testing/raptor/raptor/playback/mitmproxy-rel-bin-win.manifest => testing/mozbase/mozproxy/mozproxy/backends/mitmproxy-rel-bin-win.manifest
rename : testing/raptor/raptor/playback/mitmproxy_requirements.txt => testing/mozbase/mozproxy/mozproxy/backends/mitmproxy_requirements.txt
extra : moz-landing-system : lando
2019-03-06 17:13:21 +00:00
1b4fb7feae
Bug 1532542 raptor-tp6m-youtube-geckoview output problem r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D22061
--HG--
extra : moz-landing-system : lando
2019-03-05 11:04:30 +00:00
18ad654c50
Bug 1530353 - Temporarily stop measuring hero element in tp6-1 to prevent intermittent failures; r=acreskey,davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D21802
--HG--
extra : moz-landing-system : lando
2019-03-04 21:43:21 +00:00
8253608b85
Bug 1530546: change hostutils version in raptor test r=gbrown
...
Differential Revision: https://phabricator.services.mozilla.com/D22009
--HG--
extra : moz-landing-system : lando
2019-03-04 21:08:33 +00:00
28ef99fbcd
Bug 1531169 - Add the ability to run Raptor page-load tests against live sites; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D21466
--HG--
extra : moz-landing-system : lando
2019-03-04 20:40:51 +00:00
46accc2092
Bug 1531441 - Revert disabling of raptor-unity-webgl-geckoview; r=bc
...
Differential Revision: https://phabricator.services.mozilla.com/D21751
--HG--
extra : moz-landing-system : lando
2019-03-01 21:56:40 +00:00
361d5151c4
Bug 1529210 Add new Raptor tests in tp6m-5 r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D20815
--HG--
extra : moz-landing-system : lando
2019-03-01 14:46:36 +00:00
3042085516
Bug 1531079 - Stop capturing Firefox JS errors and warnings in the Raptor logs; r=stephendonner
...
Differential Revision: https://phabricator.services.mozilla.com/D21399
--HG--
extra : moz-landing-system : lando
2019-02-27 19:38:46 +00:00
7a132cc405
Bug 1523877 Add Instagram and bing to tp6-m r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D18072
--HG--
extra : moz-landing-system : lando
2019-02-28 08:46:33 +00:00
085345ac87
Bug 1524495 - Temporarily disable raptor-unity-webgl-geckoview due to frequent failures. r=jmaher
...
Reviewers: jmaher, rwood
Reviewed By: jmaher
Subscribers: reviewbot, jmaher
Bug #: 1524495
Differential Revision: https://phabricator.services.mozilla.com/D20939
--HG--
extra : rebase_source : 0dfc90e334d0d51b135614d5b48d7d4eb24866dd
extra : histedit_source : 42e6fdea6fd0a8fe5eaac00f3acf8d72d082e58f
2019-02-26 17:20:58 +02:00
c2918302b0
Backed out changeset e5fc352e6d65 (bug 1524495) for Raptor performance tests failures.
2019-02-26 17:19:43 +02:00
b63f29553f
Bug 1524495 - Temporarily disable raptor-unity-webgl-geckoview due to frequent failures r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D20939
--HG--
extra : moz-landing-system : lando
2019-02-26 12:00:41 +00:00
e489ab4f77
Backed out changeset 9b617c97285a (bug 1524495) for Py2 failure
...
--HG--
extra : rebase_source : 11dae674cfe6dfe1b9ac0c70ac463b64d148c48b
2019-02-26 11:36:11 +02:00
243105ce4c
Bug 1524495 - Temporarily disable raptor-unity-webgl-geckoview due to frequent failures r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D20939
--HG--
extra : moz-landing-system : lando
2019-02-25 13:32:22 +00:00
6adb5274af
Bug 1506936 - Temporarily disable raptor-tp6-facebook-firefox due to permafail. r=jmaher,davehunt
...
--HG--
extra : amend_source : 7c550f19ee58925ef15fd14b44d680078bbe5d1b
2019-02-23 23:15:44 +02:00
3aeb6355e0
Backed out changeset 05dc22d0131b (bug 1506936) for causing raptor failures on test_manifest.py.
2019-02-23 22:53:29 +02:00
59718a6d7c
Bug 1506936 - Temporarily disable raptor-tp6-facebook-firefox due to permafail; r=jmaher,davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D20911
--HG--
extra : moz-landing-system : lando
2019-02-23 20:00:21 +00:00
1f2bb6f01b
Bug 1529079 - Fix Raptor fennec shutdown failure; r=bc
...
Differential Revision: https://phabricator.services.mozilla.com/D20829
--HG--
extra : moz-landing-system : lando
2019-02-22 21:40:05 +00:00
2e13f2584d
Bug 1520523 - Update Raptor Chromium rev; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D20814
--HG--
extra : moz-landing-system : lando
2019-02-22 19:31:52 +00:00
8367e1b8cd
Bug 1527280 - Add deterministic js and injection script to raptor mitmproxy r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D19485
--HG--
extra : moz-landing-system : lando
2019-02-22 19:33:13 +00:00
39cd1d4845
Bug 1525358 - Rename perf.html to profiler.firefox.com; r=julienw
...
Differential Revision: https://phabricator.services.mozilla.com/D18728
--HG--
extra : moz-landing-system : lando
2019-02-21 23:16:40 +00:00
90f0dafc2a
Backed out changeset ad3aad4f529e (bug 1527280) for ESlint and flake failures at deterministic.js. CLOSED TREE
2019-02-21 19:01:32 +02:00
7d3ec27a10
Bug 1527280 - Add deterministic js and injection script to raptor mitmproxy r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D19485
--HG--
extra : moz-landing-system : lando
2019-02-21 16:31:39 +00:00
b7e28eddd2
Bug 1507110 - Allow hijacking localhost only if network.proxy.allow_hijacking_localhost is set r=Gijs,mayhemer,mkaply,jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D19325
--HG--
extra : moz-landing-system : lando
2019-02-19 21:53:22 +00:00
df7c74194f
Bug 1528055 - Raptor's extension measure.js onload overrides onload in mitmproxy page recordings; r=acreskey
...
Differential Revision: https://phabricator.services.mozilla.com/D19961
--HG--
extra : moz-landing-system : lando
2019-02-20 21:06:15 +00:00
47c7bf42ec
Bug 1522100 - Add Raptor support for running tests locally on the android-components reference browser; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D20414
--HG--
extra : moz-landing-system : lando
2019-02-21 14:14:05 +00:00
9096d62bdf
Bug 1523973 Review and update the raptor-tp6m-1 recordings r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D20309
--HG--
extra : moz-landing-system : lando
2019-02-19 12:22:32 +00:00
8584f3a17e
Bug 1508379 Add BinAST version of Instagram to tp6 r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D18824
--HG--
extra : moz-landing-system : lando
2019-02-15 15:41:53 +00:00
e7157bdeaa
Bug 1522972 - Make existing main Raptor code more modular; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D18689
--HG--
extra : moz-landing-system : lando
2019-02-15 14:55:16 +00:00
2db0262d3b
Bug 1515023 Abort page load test when mitmproxy recording can not be found r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D19649
--HG--
extra : moz-landing-system : lando
2019-02-15 10:48:25 +00:00
b4402089b6
Bug 1520447 For raptor tp6 on windows use mitmproxy executable instead of creating a separate python environment r=rwood,davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D16802
--HG--
extra : moz-landing-system : lando
2019-02-13 19:55:30 +00:00
75d8d540ab
Backed out changeset a5ad662d5bbb (bug 1520447) for android build bustages. CLOSED TREE
2019-02-13 17:04:19 +02:00
604b72af80
Bug 1520447 For raptor tp6 on windows use mitmproxy executable instead of creating a separate python environment r=rwood,davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D16802
--HG--
extra : moz-landing-system : lando
2019-02-12 14:33:49 +00:00
e9c99dfaf4
Bug 1520592 - Enable screen captures on pageload timeouts; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D18878
--HG--
extra : moz-landing-system : lando
2019-02-08 21:33:35 +00:00
92ed8bb564
Bug 1518776 Add Tumblr to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D16054
--HG--
extra : moz-landing-system : lando
2019-02-06 17:10:06 +00:00
f53b36fd57
Bug 1520417 - Do not combine test name with measurement r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D18323
--HG--
extra : moz-landing-system : lando
2019-02-06 13:57:28 +00:00
eb7e08c167
Bug 1525280 Raptor should clear app data before running tests on gecko view r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D18686
--HG--
extra : moz-landing-system : lando
2019-02-06 12:01:03 +00:00
8bc7850637
Bug 1483228 - [mozboot] Simplify get_state_dir()'s return value r=nalexander
...
mozboot.util.get_state_dir() returns a tuple of (<path>, <bool). The bool
denotes whether or not the state dir came from an environment variable.
But this value is only used in a single place, and is very easy to test for
anyway. It's not worth the added complexity it imposes on all other consumers
of this function. Let's just make this function return the path.
Differential Revision: https://phabricator.services.mozilla.com/D15723
--HG--
extra : moz-landing-system : lando
2019-02-04 20:52:31 +00:00
a50cb45a62
Bug 1517178 - [raptor] disable adb verbose output during logcat collection, r=rwood.
2019-01-31 20:35:56 -08:00
5ccc06113c
Bug 1520130 - [raptor] Improve Raptor no raptor test results were found message, r=rwood.
2019-01-31 20:35:56 -08:00
25349d2601
Bug 1518283 - prohibit blank lines at the beginning and end of blocks (eslint padded-blocks) r=mossop,Standard8
...
Differential Revision: https://phabricator.services.mozilla.com/D17526
--HG--
extra : moz-landing-system : lando
2019-01-30 17:26:25 +00:00
bff88648b3
Bug 1516015 - Fix proxy configuration for Raptor in Google Chrome; r=rwood
...
When investigating the timeouts for wikia.com on Google Chrome I discovered differences in the way proxy configuration is interpreted. It meant that insecure sites such as wikia were not using the proxy when launched via mach, and now that wikia.com redirects to a secure site we get redirected to a site that is not in the recordings. I have resolved this by fixing the command line argument for the proxy to include all protocols. It was also necesary to allow communication with the control server by adding localhost to the pass-through hosts.
I also removed the trailing disable-sync command line argument that was introduced recently in error.
Differential Revision: https://phabricator.services.mozilla.com/D17869
--HG--
extra : moz-landing-system : lando
2019-01-28 22:12:00 +00:00
2863bd9494
Bug 1504227 - Add raptor test option to specify what measurement(s) to alert on; r=davehunt
...
Depends on D17288
Differential Revision: https://phabricator.services.mozilla.com/D17289
--HG--
extra : moz-landing-system : lando
2019-01-25 18:01:45 +00:00
d7bb330c5f
Bug 1504227 - Add raptor test option to specify what measurement(s) to alert on; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D17288
--HG--
extra : moz-landing-system : lando
2019-01-24 19:06:49 +00:00
aa7f384d91
Bug 1517738 - Have Raptor use the correct binary name when running on android in production; r=gbrown
...
Differential Revision: https://phabricator.services.mozilla.com/D17251
--HG--
extra : moz-landing-system : lando
2019-01-22 19:56:58 +00:00
0debaf69dc
Bug 1520523 - Update Chromium version running with Raptor in production; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D16724
--HG--
extra : moz-landing-system : lando
2019-01-22 15:01:31 +00:00
791aa236d2
Bug 1521459 Add the certutil path to 'LD_LIBRARY_PATH' variable when running a local android tp6 run r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D16970
--HG--
extra : moz-landing-system : lando
2019-01-21 14:58:30 +00:00
ebffce4499
Bug 1521099 - Add FCP measurement to pageload on geckoview (tp6m-1); r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D17001
--HG--
extra : moz-landing-system : lando
2019-01-18 18:26:09 +00:00
3226dda355
Bug 1518479 - Add Firefox FirstContentfulPaint measurement to raptor tests (on behalf of :jesup); r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D16599
--HG--
extra : moz-landing-system : lando
2019-01-17 20:00:07 +00:00
fc98f89dd9
Bug 1506912 - Raptor tp6m-1 pageload test on android geckoview; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D15143
--HG--
extra : moz-landing-system : lando
2019-01-17 03:01:40 +00:00
cd72b29090
Bug 1513365 Add Google Mail to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D15939
--HG--
extra : moz-landing-system : lando
2019-01-15 08:33:31 +00:00
4aeedf5b2e
Bug 1517800 Add Pinterest to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D16048
--HG--
extra : moz-landing-system : lando
2019-01-14 19:42:12 +00:00
24d3ea5ce2
Bug 1518519 Add Paypal to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D16031
--HG--
extra : moz-landing-system : lando
2019-01-11 19:07:10 +00:00
61b758639c
Bug 1517738 - [raptor] Use the correct app name when running on fennec on beta; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D16209
--HG--
extra : moz-landing-system : lando
2019-01-11 19:25:22 +00:00
daa7fbeb2e
Bug 1513369 Add Yahoo Mail to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D14546
--HG--
extra : moz-landing-system : lando
2019-01-08 08:44:37 +00:00
0654d55e71
Bug 1513367 Add Yahoo to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D14425
--HG--
extra : moz-landing-system : lando
2019-01-07 16:25:54 +00:00
627ce82d7d
Bug 1510404 Add Wikipedia to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D14134
--HG--
extra : moz-landing-system : lando
2019-01-07 16:11:25 +00:00
ba667e28c0
Bug 1517270 - Add pageload measurement types to --print-tests output; r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D15642
--HG--
extra : moz-landing-system : lando
2019-01-04 17:04:27 +00:00
e957682403
Bug 1517052 - [raptor] Do not report power usage when raptor fails to report results; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D15744
--HG--
extra : moz-landing-system : lando
2019-01-04 20:09:31 +00:00
89ba457187
Bug 1512615 Support screenshots for tests r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D13972
--HG--
extra : moz-landing-system : lando
2019-01-04 13:02:44 +00:00
d64a93fbd2
Bug 1511356 - Run speedometer on fennec via Raptor; r=jmaher,jlund
...
Differential Revision: https://phabricator.services.mozilla.com/D13946
--HG--
extra : moz-landing-system : lando
2019-01-02 20:43:21 +00:00
622b218aa2
Bug 1512983 - Add crash reporting for android raptor; r=rwood
...
Also fix the symbols path, so that desktop crash reports are symbolicated.
2018-12-31 09:18:00 -07:00
0daee297ae
Bug 1491097 - Add utils unit test; r=ahal
...
Differential Revision: https://phabricator.services.mozilla.com/D13153
--HG--
extra : moz-landing-system : lando
2018-11-28 18:44:02 +00:00
a5e0666632
Bug 1491097 - Add manifest unit test; r=ahal
...
Differential Revision: https://phabricator.services.mozilla.com/D13139
--HG--
extra : moz-landing-system : lando
2018-12-28 20:01:10 +00:00
ddd69f99e8
Bug 1504013 - Add the ability to measure loadtime in raptor, and use loadtime as the overall test result for tp6 suites; r=jmaher,acreskey
...
Differential Revision: https://phabricator.services.mozilla.com/D14306
--HG--
extra : moz-landing-system : lando
2018-12-27 21:35:13 +00:00
9526040894
Bug 1512038 - Handle different batterystats output for Raptor power tests on Android 7, r=rwood.
2018-12-21 06:12:19 -08:00
bea8a390ce
Bug 1512038 - Enable raptor-speedometer-geckoview-power for android-hw-{p2,g5} on try, r=rwood.
...
Rap-P treeherder group for Raptor power tests.
Emit separate PERFHERDER_DATA for power in addition to the performance measurements.
Use magic --host HOST_IP value to have framework load host ip from environment
variable HOST_IP.
2018-12-21 06:12:18 -08:00
bfc96ac22a
Bug 1473997 - Add support to Raptor to receive/format/output power data; r=jmaher
...
Depends on D14997
Differential Revision: https://phabricator.services.mozilla.com/D14998
--HG--
extra : moz-landing-system : lando
2018-12-19 21:13:55 +00:00
c2349ad0f8
Bug 1473997 - find a way to measure the battery usage of geckoview (:bc's initial patch); r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D14997
--HG--
extra : moz-landing-system : lando
2018-12-19 20:52:28 +00:00
70f9100da6
Bug 1511029 Mitmproxy alternate-server-replay returns last found request ignoring match algorithm r=acreskey
...
Mitmproxy alternate-server-replay returns last found request ignoring match algorithm
Differential Revision: https://phabricator.services.mozilla.com/D13408
--HG--
extra : moz-landing-system : lando
2018-12-19 14:19:30 +00:00
f658ebcbab
Merge mozilla-inbound to mozilla-central a=merge
2018-12-20 07:04:06 +02:00
e5e351a5a2
Bug 1515189 - Consolidate ADBDevice and ADBAndroid classes; r=bc
2018-12-19 14:04:02 -07:00
1435da9871
Bug 1513837 Add ebay to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D14543
--HG--
extra : moz-landing-system : lando
2018-12-18 17:45:07 +00:00
4508b0fd5b
Bug 1513373 Add Twitter to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D14542
--HG--
extra : moz-landing-system : lando
2018-12-18 17:02:55 +00:00
96ae71fa3f
Bug 1514752 Define hero user timing before performance entry is created r=rwood
...
1-line fix to hero element timing: the performance entry would show up as 'undefined' in profiles because the variable was defined later.
Differential Revision: https://phabricator.services.mozilla.com/D14746
--HG--
extra : moz-landing-system : lando
2018-12-17 22:40:43 +00:00
a63f5d5395
Bug 1506912 - Raptor support for tp6 pageload on android geckoview; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D14186
--HG--
extra : moz-landing-system : lando
2018-12-14 07:19:59 +00:00
06b85a3fce
Bug 1508375 Add Instagram to tp6 r=rwood,davehunt rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D12520
--HG--
rename : testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6-6.manifest => testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6-7.manifest
extra : moz-landing-system : lando
2018-12-12 21:23:34 +00:00
28ea3cc015
Bug 1509904 - always use backslashes on Windows, r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D12935
--HG--
extra : moz-landing-system : lando
2018-11-26 21:43:37 +00:00
8a44f27935
Bug 1509381 - Fix debug-mode page-cycles value when page-cycles < 2; r=Bebe
...
Differential Revision: https://phabricator.services.mozilla.com/D12704
--HG--
extra : moz-landing-system : lando
2018-11-23 11:26:18 +00:00
1e43108db5
Bug 1509009 - Fix proxy policy for raptor http pageload; r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D12698
--HG--
extra : moz-landing-system : lando
2018-11-22 20:38:17 +00:00
6822f625cb
Bug 1508692 - Use Firefox policies instead of autoconfig for pageload tp6; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D12453
--HG--
extra : moz-landing-system : lando
2018-11-20 22:18:44 +00:00
208d16134b
Merge mozilla-inbound to mozilla-central a=merge
2018-11-20 07:03:17 +02:00
8ef2b84cb6
Bug 1503990 add additional pages to tp6 r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D11058
--HG--
extra : moz-landing-system : lando
2018-11-20 01:21:38 +00:00
a269e5f630
Bug 1470450 - Add a debug mode to raptor; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D11937
--HG--
extra : moz-landing-system : lando
2018-11-16 19:30:55 +00:00
78cd9dab3f
Bug 1502036 - Subtest results for raptor speedometer have incorrect lower_is_better setting; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D12142
--HG--
extra : moz-landing-system : lando
2018-11-16 17:25:32 +00:00
c0b26c4076
Merge inbound to mozilla-central a=merge
2018-11-15 11:54:15 +02:00
d40e331dae
Bug 1499539 - Add a raptor command that will just list all available raptor tests; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D11379
--HG--
extra : moz-landing-system : lando
2018-11-14 22:12:03 +00:00
dcc74f176f
Bug 1499253 - fix setting chrome proxy arguments when using playback, r=rwood.
2018-11-13 19:02:40 -08:00
ce780910f7
Bug 1506917 - Don't attempt to check for updates from Firefox's nsBrowserGlue.js when running tests. r=ted
...
This adds the app.update.checkInstallTime pref with a value of false in all tests that have the app.update.disabledForTesting pref except for geckodriver which is covered by bug 1508283.
2018-11-19 07:33:33 -08:00
9c728df81e
Bug 1506404 - [raptor] Convert dos line endings to unix, r=rwood.
2018-11-14 17:48:49 -08:00
91a1fd6dbd
Bug 1499352 - [raptor] Allow the use of wifi and adb over tcp to serve pages, r=rwood.
2018-11-10 03:10:08 -08:00
87801ab786
Bug 1505428 raptor --page-cycles only works at 'subtest' level r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D11455
--HG--
extra : moz-landing-system : lando
2018-11-09 13:48:19 +00:00
34ed2a4281
Bug 1505526 - Rename existing raptor tp6 to tp6-1 and raptor gdocs to tp6-2; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D11234
--HG--
rename : testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6.manifest => testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6-1.manifest
rename : testing/raptor/raptor/playback/mitmproxy-recordings-raptor-gdocs.manifest => testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6-2.manifest
rename : testing/raptor/raptor/tests/raptor-tp6.ini => testing/raptor/raptor/tests/raptor-tp6-1.ini
rename : testing/raptor/raptor/tests/raptor-gdocs.ini => testing/raptor/raptor/tests/raptor-tp6-2.ini
extra : moz-landing-system : lando
2018-11-07 21:33:21 +00:00
3ff1ca5cb2
Bug 1505479 - Add raptor webext browser toolbar icon; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D11193
--HG--
extra : moz-landing-system : lando
2018-11-07 17:46:24 +00:00
bbc7462eda
Bug 1503398 - Increase page-cycle limit to 3 while gecko-profiling is on; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D10756
--HG--
extra : moz-landing-system : lando
2018-11-02 19:58:00 +00:00
194c521f36
Merge mozilla-central to mozilla-inbound. a=merge CLOSED TREE
2018-11-02 18:59:30 +02:00
6133912e19
Bug 1503999 - Enable e10s on the geckoview example app when running raptor; r=bc
...
Differential Revision: https://phabricator.services.mozilla.com/D10715
--HG--
extra : moz-landing-system : lando
2018-11-02 14:01:03 +00:00
5b64e46782
Bug 1491114 - Add ability to specify page_cycles and page_timeout on the command line; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D10599
--HG--
extra : moz-landing-system : lando
2018-11-01 19:54:37 +00:00
e8ccc57b1e
Bug 1501040 - Raptor fix so unsigned webext will load on mozilla-beta; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D10453
--HG--
extra : moz-landing-system : lando
2018-11-01 08:43:49 +00:00
f5b7112fd5
Bug 1502873 - More tweaks for raptor gecko profiling support; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D10267
--HG--
extra : moz-landing-system : lando
2018-10-31 21:24:58 +00:00
0f2e4886fa
Bug 1492913 - When gecko profiling is enabled locally, have resulting gecko profiles open automatically in perf-html.io; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D10300
--HG--
extra : moz-landing-system : lando
2018-10-30 23:23:39 +00:00
1dfcab1a30
Bug 1502922 - Add --gecko-profile flag support to mach try fuzzy for raptor and talos jobs; r=ahal
...
Differential Revision: https://phabricator.services.mozilla.com/D10114
--HG--
rename : taskcluster/taskgraph/templates/talos-profile.yml => taskcluster/taskgraph/templates/gecko-profile.yml
extra : moz-landing-system : lando
2018-10-30 15:15:32 +00:00
2c1a3776aa
Bug 1502483 raptor-test should test for presence of Git and emit an error message if it's not found r=rwood rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D10054
--HG--
extra : moz-landing-system : lando
2018-10-29 16:43:22 +00:00
d1b2d84bf4
Bug 1473079 - Add gecko profiling support to raptor (part 3: enable gecko profiling); r=jmaher
...
Depends on D6309
Differential Revision: https://phabricator.services.mozilla.com/D6918
--HG--
extra : moz-landing-system : lando
2018-10-29 13:35:21 +00:00
e154044f63
Bug 1473079 - Add gecko profiling support to raptor (part 2: limit page cycles); r=jmaher
...
Depends on D6286
Differential Revision: https://phabricator.services.mozilla.com/D6309
--HG--
extra : moz-landing-system : lando
2018-10-29 13:33:13 +00:00
6f148acd8e
Bug 1473079 - Add gecko profiling support to raptor (part 1: cmd line args); r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D6286
--HG--
extra : moz-landing-system : lando
2018-10-29 13:32:25 +00:00
a62c29cd3e
Bug 1502190 - bump mozdevice requirements for raptor, marionette, mozrunner, r=gbrown.
2018-10-26 09:51:37 -07:00
c5742407d9
Bug 1495903 - When running raptor on chromium, remove the webext from the cmd line after each test is finished; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D9709
--HG--
extra : moz-landing-system : lando
2018-10-24 20:18:41 +00:00
562d40574c
Bug 1501809 - Fix Raptor tp6 'main application timed out'; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D9714
--HG--
extra : moz-landing-system : lando
2018-10-24 22:30:50 +00:00
e6070d471c
Bug 1501788 - godot tweaks r=jmaher jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D9754
--HG--
extra : moz-landing-system : lando
2018-10-25 11:34:21 +00:00
c7398f447c
Bug 1493648 - Can we run the Godot Engine wasm benchmark in automation? r=jmaher
...
Reviewers: jmaher
Tags: #secure-revision
Bug #: 1493648
Differential Revision: https://phabricator.services.mozilla.com/D8957
2018-10-17 10:40:57 +03:00
4409ba6681
Bug 1501224 - Update version requirement on mozprofile for raptor; r=davehunt
...
Depends on D9515
Differential Revision: https://phabricator.services.mozilla.com/D9516
--HG--
extra : moz-landing-system : lando
2018-10-23 16:40:31 +00:00
48a9b391fa
Bug 1500236 - Have Raptor use '127.0.0.1' instead of 'localhost' to fix timeouts on OSX; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D9147
--HG--
extra : moz-landing-system : lando
2018-10-18 20:30:13 +00:00
56904c821f
Bug 1487374 benchmark_score for Sunspider Chrome is unnecessary r=jmaher jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D8838
--HG--
extra : moz-landing-system : lando
2018-10-16 12:48:19 +00:00
21874f0702
Bug 1496544 - Don't timeout the pageload / fail raptor test when TTFI is not available; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D8590
--HG--
extra : moz-landing-system : lando
2018-10-15 17:06:58 +00:00
8bee4877e5
Bug 1496226 - Be sure raptor's capturing of first-contentful-paint in google chrome is the correct entry; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D8731
--HG--
extra : moz-landing-system : lando
2018-10-15 15:43:13 +00:00
1e918164f2
Bug 1299118: Measure TTI (or TTFI at the moment) in Raptor TP6 r=rwood
2018-10-11 13:23:38 -04:00
0f211616dc
Backed out 3 changesets (bug 1299118) for ES lint failures
...
Backed out changeset 14451eb9a2b8 (bug 1299118)
Backed out changeset e5adc30bdf7f (bug 1299118)
Backed out changeset 8f7bb583fbb5 (bug 1299118)
2018-10-11 20:47:58 +03:00
94b05e1202
Bug 1299118: Measure TTI (or TTFI at the moment) in Raptor TP6 r=rwood
2018-10-11 13:23:38 -04:00
e1c323b919
Bug 1460742 - Add raptor 'tp6' for google chrome; r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D7524
--HG--
extra : moz-landing-system : lando
2018-10-02 22:15:15 +00:00
24a553e036
Bug 1466648 - add unity3d benchmark to raptor/android; r=bc,jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D7114
--HG--
extra : moz-landing-system : lando
2018-10-01 19:01:57 +00:00
130b3341e6
Bug 1458242 - add DOMContentFlushed to tp6 as a measurement. r=rwood
...
add DOMContentFlushed to tp6, collect it and return the geometric mean of all measurements.
Differential Revision: https://phabricator.services.mozilla.com/D5797
--HG--
extra : moz-landing-system : lando
2018-09-14 13:51:05 +00:00
c4f0d02624
Bug 1478775 - Mark raptor test failed if any one test page times out r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D5463
--HG--
extra : moz-landing-system : lando
2018-09-13 19:17:10 +00:00
36100c0619
Bug 1471888 - Update mozprofile version used by raptor; r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D5594
--HG--
extra : moz-landing-system : lando
2018-09-11 21:09:23 +00:00
edc30e1b35
Bug 1488327 - Use new ADBDevice.reverse in Raptor r=rwood
...
Changed two occurrences of _cmd['reverse', port, port] to use the create_socket_connection method from 1484238.
Added code at end of clean_up() to remove opened socket connections.
Checked via manual execution of raptor-speedometer that opened reverse socket connections are removed at conclusion of test.
Differential Revision: https://phabricator.services.mozilla.com/D5286
--HG--
extra : moz-landing-system : lando
2018-09-07 20:11:55 +00:00
d421d8b58f
Bug 1478794 - Raptor should turn off the browser proxy after pageload tests are finished r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D5202
--HG--
extra : moz-landing-system : lando
2018-09-07 08:29:07 +00:00
67f06625a7
Bug 1461422 - Remove raptor/setup.py r=egao
...
Differential Revision: https://phabricator.services.mozilla.com/D5076
--HG--
extra : moz-landing-system : lando
2018-09-05 20:19:43 +00:00
b5430ee4da
Merge mozilla-central to autoland. a=merge CLOSED TREE
2018-09-05 15:42:52 +03:00
03af62563c
Bug 1488422 - Use boolean literal instead of string r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D5012
--HG--
extra : moz-landing-system : lando
2018-09-05 09:45:50 +00:00
1155dedeb1
Bug 1487244 - Remove mach's --debug-command argument before starting Raptor, r=gbrown.
2018-08-30 19:04:46 -07:00
7aed758f49
Bug 1487229 - Raptor should make sure app isn't already running before starting app, r=jmaher.
2018-08-30 19:04:46 -07:00
df0e8c3957
Bug 1486908 - ./mach raptor-test should prompt to install geckoview_example if needed, r=gbrown.
2018-08-30 19:04:46 -07:00
488c0b8b66
Bug 1486908 - Raptor should terminate with an exception if the app isn't installed during run_test, r=jmaher.
...
Otherwise the resourcemonitor will hang and it will wait 1800 seconds to timeout.
2018-08-30 19:04:46 -07:00
a09d9d7eaf
Bug 1486892 - Do not check for binary path when calling raptor via mach, r=jmaher.
2018-08-30 19:04:45 -07:00
111bbc5fbe
Bug 1488544 - Do not check for android device when running desktop raptor-test; r=rwood
2018-09-04 15:16:18 -06:00
49ed6e30bf
Bug 1486789 - support subtest units independent of benchmark units, set values for speedometer. r=ahal
...
allow support in .ini files for subtest units and lower_is_better values; implement this for speedometer.
Differential Revision: https://phabricator.services.mozilla.com/D4465
--HG--
extra : moz-landing-system : lando
2018-08-29 21:01:02 +00:00
924aa36a1b
Bug 1486788 - make sunspider lower_is_better and indicate it is a 'ms' benchmark. r=ahal
...
Adjust sunspider raptor test to make lower_is_better=true and treat it as 'ms' and not a 'score'
Differential Revision: https://phabricator.services.mozilla.com/D4454
--HG--
extra : moz-landing-system : lando
2018-08-28 16:30:58 +00:00
265d508303
Bug 1482151 - run wasm-misc in baseline and ion optional modes. r=ahal
...
move wasm-misc and unity3d benchmarks to tier2; run wasm-misc in different preferences
Differential Revision: https://phabricator.services.mozilla.com/D3903
--HG--
extra : moz-landing-system : lando
2018-08-21 18:21:40 +00:00
c0d0bc65ae
Bug 1481708 - run wasm-misc on desktop browsers. r=rwood
...
support wasm-misc as a benchmark in raptor
Differential Revision: https://phabricator.services.mozilla.com/D3616
--HG--
extra : moz-landing-system : lando
2018-08-17 19:22:29 +00:00
eeb6464d68
Bug 1480841 - Raptor support for running speedometer on geckoview r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D3446
--HG--
extra : moz-landing-system : lando
2018-08-17 18:06:22 +00:00
53873d772b
Bug 1482149 - raptor needs the ability to set preferences from configs. r=rwood
...
support adding prefs in raptor .ini files
Differential Revision: https://phabricator.services.mozilla.com/D3347
--HG--
extra : moz-landing-system : lando
2018-08-15 12:43:15 +00:00
3d3d8fe5f7
Bug 1482057 - [raptor] Fix benchmark setup on Windows, r=jmaher
...
This fixes a bug where the benchmarks weren't being copied properly on Windows.
While it is slightly slower to add every file to the manifest (~0.2 seconds), it
still outperforms shutil.copytree and is more robust (will use links on Linux/Mac
while using copy on Windows).
Differential Revision: https://phabricator.services.mozilla.com/D3234
--HG--
extra : moz-landing-system : lando
2018-08-14 18:06:20 +00:00
c9ecdec925
Bug 1473365 - migrate AWFY assortedDOM tests to a raptor benchmark r=jmaher
...
Differential Revision: https://phabricator.services.mozilla.com/D3046
--HG--
extra : moz-landing-system : lando
2018-08-13 21:30:33 +00:00
7dde9cf26e
Bug 1472800 - [ci] Add the raptor unity-webgl benchmark to taskcluster r=rwood
...
Enables the benchmark in CI, uses a fetch task to download the benchmark.
Depends on D2307.
Differential Revision: https://phabricator.services.mozilla.com/D2469
--HG--
extra : moz-landing-system : lando
2018-08-07 18:22:40 +00:00
5df71be96e
Bug 1472800 - [raptor] Add the unity-webgl benchmark r=rwood
...
This will run the benchmark in taskcluster as well as allow us to run it locally with:
./mach raptor-test -t raptor-unity-webgl
Depends on D2306.
Differential Revision: https://phabricator.services.mozilla.com/D2307
--HG--
extra : moz-landing-system : lando
2018-08-07 18:22:02 +00:00
a357cacbdb
Bug 1472800 - [raptor] Bootstrap webkit-benchmarks to the user's state dir r=rwood
...
Currently the benchmarks raptor runs are checked into the tree at:
third_party/webkit/PerformanceTests
However, some benchmarks are too big to vendor (200+MB). This patch will
clone a repo containing the benchmarks that *aren't* checked into the tree,
into the user's ~/.mozbuild directory. If the repo already exists, an update
will be run.
Differential Revision: https://phabricator.services.mozilla.com/D2306
--HG--
extra : moz-landing-system : lando
2018-08-07 18:21:08 +00:00
0f460b1379
Bug 1481037 - Update StyleBench. r=jmaher
...
Pick upstream changes.
Differential Revision: https://phabricator.services.mozilla.com/D2757
--HG--
extra : moz-landing-system : lando
2018-08-07 15:31:47 +00:00
ea00ef94a9
Bug 1504117 - [mozdevice] Bump mozdevice requirements to 1.1.6 for raptor, marionette, mozrunner, r=gbrown.
2018-11-02 08:04:02 -07:00
c70099b77d
Bug 1478057 - Report the mean of all measurements per pageload, not separate values per measurement type; r=igoldan
...
MozReview-Commit-ID: H0lYbZPFzMY
--HG--
extra : rebase_source : bcb5b801eeec0a585f49f9e4e638beecdd1ee7e2
2018-07-27 11:10:30 -04:00
b5fdd1ee41
Bug 1478443 - Fix Raptor webaudio benchmark (add webaudio back to the raptor webext manifest); r=ahal
...
MozReview-Commit-ID: FkrvLVKtKBh
--HG--
extra : rebase_source : 1de846f0f78d5fafea8e169d7b37f0d6a5a276ee
2018-07-25 14:09:21 -04:00
1d37fa795b
Bug 1436827 - add new raptor 'gdocs' pageload test suite (for google docs/slides/sheets); r=igoldan
...
MozReview-Commit-ID: EfhBJPgpyRc
--HG--
extra : rebase_source : 73e37a56af23f1a287e84fba4de4bf35016acba9
2018-07-20 11:50:48 -04:00
f1e3db10e4
Bug 1472803 - Rebase on latest m-i, resolve conflicts, address PR requests r=rwood
...
MozReview-Commit-ID: CnXZ6ucXbe1
--HG--
extra : rebase_source : 5fda301911496faaf6308b090cf09eeb79f7b8e7
2018-07-23 14:21:24 +03:00
0a75f53524
Bug 1472803 - Add dedicated parse method r=rwood
...
MozReview-Commit-ID: FEqq34xW02S
--HG--
extra : rebase_source : eda946c6f143d0709f28ff2373ebea2c123b059c
2018-07-19 14:17:31 +03:00
0eb2e670a3
Bug 1472803 - Add TaskCluster configs for Raptor's SunSpider; tweak new raptor ini r=jmaher,rwood
...
MozReview-Commit-ID: AKFMkb20vyS
--HG--
extra : rebase_source : a3ae3dea637c7b3bfe6e3bb75889cb74faf5a1e0
2018-07-19 12:11:42 +03:00
bdf791d659
Bug 1472803 - Run SunSpider in browser mode r=jmaher
...
MozReview-Commit-ID: GgWLVx5RveF
--HG--
extra : rebase_source : 3c00a1b0feb6831e3355e70022ae57e2d10be09b
2018-07-13 16:38:19 +03:00
15993592c1
Bug 1454053 - re-record tp6 pages for raptor; r=igoldan
...
MozReview-Commit-ID: Esy7cWeADdy
--HG--
rename : testing/raptor/raptor/playback/mitmproxy-playback-set.manifest => testing/raptor/raptor/playback/mitmproxy-recordings-raptor-tp6.manifest
extra : rebase_source : 99437134717bb9df35a7b70c493c3166319aad44
2018-07-24 09:33:10 -04:00
04f65a0f76
Bug 1473334 - run the webaudio benchmark in raptor instead of AWFY. r=rwood
...
port the webaudio benchmark from arewefastyet.com to in-tree raptor.
Differential Revision: https://phabricator.services.mozilla.com/D2224
--HG--
extra : moz-landing-system : lando
2018-07-19 19:03:43 +00:00
da107c225e
Bug 1420514 - Replace app.update.enabled with app.update.disabledForTesting in the test harness r=ato,chutten,jmaher,lina
...
MozReview-Commit-ID: GCGKQ5QCC7o
--HG--
extra : rebase_source : ba135c7d285987fd030fef4e18a5aa701a43cdba
extra : intermediate-source : e6c89a0ff0c7a7e7cd1c028e49660bab0416a531
extra : source : 646080a591c0d2365d6e8f4a493607fa3fff86c9
2018-05-22 09:14:19 -07:00
1e8d2e6f7d
Backed out 7 changesets (bug 1420514) for breaking bc on different files on a CLOSED TREE
...
Backed out changeset 5a46a221b6e8 (bug 1420514)
Backed out changeset 48ed6dfe8772 (bug 1420514)
Backed out changeset 01bf643c77e5 (bug 1420514)
Backed out changeset 5791b17ccb82 (bug 1420514)
Backed out changeset 416e398d942f (bug 1420514)
Backed out changeset de4a4592dbd9 (bug 1420514)
Backed out changeset d3399edf0197 (bug 1420514)
2018-07-12 21:22:32 +03:00
35d8c30dbb
Bug 1420514 - Replace app.update.enabled with app.update.disabledForTesting in the test harness r=ato,chutten,jmaher,lina
...
MozReview-Commit-ID: GCGKQ5QCC7o
--HG--
extra : rebase_source : e38cf587711192c3020cd9ac6a39cdbd97d2600b
extra : source : 646080a591c0d2365d6e8f4a493607fa3fff86c9
2018-05-22 09:14:19 -07:00
27356a6aa3
Bug 1473907 - adjust raptor default timeout while waiting for browser closure from 75 seconds to 15 seconds. r=rwood
...
Differential Revision: https://phabricator.services.mozilla.com/D2002
--HG--
extra : moz-landing-system : lando
2018-07-06 15:22:11 +00:00
alexandru.ionescu
Stephen Donner
Florin Strugariu
Edwin Gao
Andreea Pavel
Chris Hartjes
Ionut Goldan
Rob Wood
Ivan Yung
Henrik Skupin
Cosmin Sabou
Andrew Halberstadt
shindli
Bob Clary
Marian Raiciof
Nick Alexander
Tarek Ziadé
marian.raiciof
Joel Maher
Kartikaya Gupta
Andrew Erickson
Florin Strugariu
Narcis Beleuzu
Greg Tatum
Brindusan Cristian
Junior Hsu
Myk Melez
Dave Hunt
Geoff Brown
Razvan Maries
Andrew Creskey
Gijs Kruitbosch
arthur.iakab
Robert Strong
Ciure Andrei
Raphael Pierzina
Randell Jesup
Margareta Eliza Balazs
Emilio Cobos Álvarez
Kirk Steuber