Граф коммитов

142 Коммитов

Автор SHA1 Сообщение Дата
Kimberly Sereduck cc8b5f4f49 Bug 1716825: Navigate to a sub-page rather than about:blank for warm pageloads;r=perftest-reviewers,Bebe,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D120718
2021-08-10 16:18:54 +00:00
Butkovits Atila 1147123b55 Backed out changeset c5618823c6b5 (bug 1716825) for causing Btime failures. CLOSED TREE 2021-08-07 12:08:15 +03:00
Kimberly Sereduck c4fd908d12 Bug 1716825: Navigate to a sub-page rather than about:blank for warm pageloads;r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D120718
2021-08-07 01:42:16 +00:00
Butkovits Atila 74a8d8dd6b Backed out changeset e0eb8376a840 (bug 1716825) for causing Btime failures. CLOSED TREE 2021-08-05 23:58:46 +03:00
Kimberly Sereduck 62fe64a298 Bug 1716825: Navigate to a sub-page rather than about:blank for warm pageloads;r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D120718
2021-08-05 17:21:18 +00:00
Florin Strugariu 4b52d8e894 Bug 1721599 - [mozproxy] Drop mitm4 after migrating to mitm5 finished r=perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D120468
2021-07-29 12:07:17 +00:00
Mitchell Hentges 3ee6837e37 Bug 1714684: Don't `assert` the result of `assert_called()` r=perftest-reviewers,AlexandruIonescu
In the vendored `mock` library, `assert_called()` returns the
`MagicMock` instance again - I'm not sure that it does the actual
assertion, so `assert instance.is_called()` may be a no-op.

Fortunately, in `unittest.mock`, `assert_called()` does the assertion
internally, and returns `None`. Since `assert None` causes a failure,
we need to tweak the invalid usage accordingly.

Differential Revision: https://phabricator.services.mozilla.com/D117454
2021-06-14 15:34:47 +00:00
Mitchell Hentges e389cc4cc4 Bug 1714684: Remove usages of vendored "mock" library r=perftest-reviewers,ahal,sparky
Python 3 has access to `unittest.mock` in the standard library.

Differential Revision: https://phabricator.services.mozilla.com/D117073
2021-06-14 15:34:46 +00:00
Alex Ionescu 933ee7b5a5 Bug 1710995 - Remove webext benchmark configuration r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D115060
2021-05-21 14:24:48 +00:00
Florin Strugariu f655176486 Bug 1700955 - Use mitm5 recordings for tp6 desktop page load unittests. r=perftest-reviewers,sparky
This patch removes the mitm4 recordings that were being used in the raptor desktop unittests and replaces them with the mitm5 recordings.

Differential Revision: https://phabricator.services.mozilla.com/D114951
2021-05-13 07:14:52 +00:00
Steve Fink a45b73b47e Bug 1702310 - Add --gecko-profile-features and similar options to `mach try fuzzy` and `mach raptor` etc. to make it easier to generate marker-only profiles, configure threads and sampling interval, etc. r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D110451
2021-04-26 21:59:29 +00:00
Alexandru Michis 09b48c2afd Backed out changeset aab899c222a0 (bug 1702310) for causing talos failures. 2021-04-09 05:26:23 +03:00
Steve Fink be4388946e Bug 1702310 - Add --gecko-profile-features and similar options to `mach try fuzzy` and `mach raptor` etc. to make it easier to generate marker-only profiles, configure threads and sampling interval, etc. r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D110451
2021-04-08 20:41:34 +00:00
Dave Hunt 06ee4b5177 Bug 1701764 - Only use a conditioned profile if a scenario is passed on the command line; r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D110213
2021-04-03 11:08:14 +00:00
Dorel Luca f24e678083 Backed out changeset 6c9de2b9cb43 (bug 1701764) for Raptor failures. CLOSED TREE 2021-04-02 19:52:11 +03:00
Dave Hunt 055d195a14 Bug 1701764 - Only use a conditioned profile if a scenario is passed on the command line; r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D110213
2021-04-02 07:15:30 +00:00
Dave Hunt f7f9d0978a Bug 1670005 - Remove all references to Fennec from performance testing r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D109486
2021-03-24 10:44:22 +00:00
Joel Maher 6d3102668a Bug 1520458 - run raptor with python-3 r=ahal,perftest-reviewers
run raptor in CI with python-3

Differential Revision: https://phabricator.services.mozilla.com/D108188
2021-03-17 13:31:32 +00:00
Dave Hunt 93b09177fe Bug 1697199 - Remove remaining raptor-webext pageload test configurations r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D108490
2021-03-17 09:57:41 +00:00
Gregory Mierzwinski 40f4b63085 Bug 1686327 - Rewrite raptor gecko-profiling code. r=julienw
This patch rewrites some parts of the GeckoProfiler code to make it clearer and easier to maintain. It also changes how the profiles get organized into separate folders for each type. Furthermore, the archives no longer have the full directory path in them. To do this, we also have to update browsertime.

Differential Revision: https://phabricator.services.mozilla.com/D102043
2021-01-20 15:40:35 +00:00
Akshat Dixit 12816b69de Bug 1629857 - Added --enable-marionette-trace raptor flag r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D101272
2021-01-15 11:17:29 +00:00
Bob Clary 1584100fb2 Bug 1681096 - python3 - pylint --py3k - W1618: from __future__ import absolute_import r=perftest-reviewers,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D98939
2020-12-14 17:50:17 +00:00
Bob Clary 9e125ea710 Bug 1681096 - python3 - pylint --py3k - W1619: from __future__ import division r=marionette-reviewers,perftest-reviewers,gbrown
Differential Revision: https://phabricator.services.mozilla.com/D98938
2020-12-11 16:05:25 +00:00
Andrey Bienkowski 200f3d82bf Bug 1675925 - [raptor] Fix deprecation warning in testing/raptor/test/test_utils.py. r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D96313
2020-11-07 15:15:11 +00:00
Ricky Stewart 02a7b4ebdf Bug 1654103: Standardize on Black for Python code in `mozilla-central`.
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-26 18:34:53 +00:00
Florin Strugariu 48929af845 Bug 1642329 - Migrate unity-webgl benchmarks from raptor to browsertime on android r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D94294
2020-10-26 09:25:56 +00:00
Florin Strugariu bc0d2e2fa2 Bug 1642329 - Migrate speedometer benchmarks from raptor to browsertime on android r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D94292
2020-10-22 14:06:25 +00:00
Bogdan Tara da1098d4aa Backed out 10 changesets (bug 1654103, bug 1672023, bug 1518999) for PanZoomControllerTest.touchEventForResult gv-junit failures CLOSED TREE
Backed out changeset ff3fb0b4a512 (bug 1672023)
Backed out changeset e7834b600201 (bug 1654103)
Backed out changeset 807893ca8069 (bug 1518999)
Backed out changeset 13e6b92440e9 (bug 1518999)
Backed out changeset 8b2ac5a6c98a (bug 1518999)
Backed out changeset 575748295752 (bug 1518999)
Backed out changeset 65f07ce7b39b (bug 1518999)
Backed out changeset 4bb80556158d (bug 1518999)
Backed out changeset 8ac8461d7bd7 (bug 1518999)
Backed out changeset e8ba13ee17f5 (bug 1518999)
2020-10-24 03:36:18 +03:00
Ricky Stewart c0cea3b0fa Bug 1654103: Standardize on Black for Python code in `mozilla-central`. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-23 20:40:42 +00:00
Dorel Luca 1ff59cb7a3 Backed out changeset 7558c8821a07 (bug 1654103) for multiple failures. CLOSED TREE 2020-10-22 03:51:06 +03:00
Ricky Stewart 50762dacab Bug 1654103: Standardize on Black for Python code in `mozilla-central`. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-21 21:27:27 +00:00
Florin Strugariu ccd808d402 Bug 1670874 - [mozproxy]Setup mozproxy to use 1 entry point for recordings (zip, manifest, url) r=perftest-reviewers,tarek,sparky
Differential Revision: https://phabricator.services.mozilla.com/D93341
2020-10-20 14:29:09 +00:00
Florin Strugariu b1063ca538 Bug 1670874 - [mozproxy]Update mitm file structure r=tarek,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D93330
2020-10-19 15:34:28 +00:00
Florin Strugariu c6a83dc1a4 Bug 1666264 - [Mozproxy] Implement a recording .zip file manager r=tarek,perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D90954
2020-10-09 12:32:26 +00:00
Narcis Beleuzu d4efb23149 Backed out changeset 272700ebb8c9 (bug 1666264) as requested by :Bebe 2020-10-08 11:35:50 +03:00
Florin Strugariu 9e8634cedc Bug 1666264 - [Mozproxy] Implement a recording .zip file manager r=tarek,perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D90954
2020-10-07 11:44:45 +00:00
Gregory Mierzwinski 11ff239729 Bug 1639372 - Run visual metrics locally through raptor. r=tarek,perftest-reviewers,Bebe
This patch makes it possible to run visual metrics through raptor-browsertime locally.

Differential Revision: https://phabricator.services.mozilla.com/D90548
2020-09-30 15:13:06 +00:00
Gregory Mierzwinski b0fde5b680 Bug 1652508 - Add chimera pageload testing mode. r=tarek
This patch adds a new pageload testing mode called chimera mode. This mode runs the cold and warm pageload tests together within a single browser session (cold first, warm second). Some changes had to be made in the visual metrics task to be able to do this (per-test specification of extraOptions).

Differential Revision: https://phabricator.services.mozilla.com/D83356
2020-07-17 22:26:07 +00:00
alexandru.ionescu 03b195d045 Bug 1643263 Update mitm from 5.0.1 to 5.1.1. r=perftest-reviewers,Bebe
This patch is updating the code to mitm 5.1.1 and mitmproxy manifest.

Differential Revision: https://phabricator.services.mozilla.com/D79256
2020-07-15 14:41:29 +00:00
Gregory Mierzwinski 8d10f86507 Bug 1650871 - Add all browsertime desktop tests. r=perftest-reviewers,AlexandruIonescu
This patch adds all desktop pageload tests to browsertime. It adds taskcluster tasks for these but doesn't enable them in production. They can only be run when --full is used.

Differential Revision: https://phabricator.services.mozilla.com/D82432
2020-07-08 07:48:16 +00:00
Gregory Mierzwinski 9d800df7de Bug 1614755 - Disable conditioned profiles properly in raptor cpu unittest. r=tarek
This patch disables conditioned-profiles in the cpu raptor tests - we have no need for conditioned profiles in this unittest.

Differential Revision: https://phabricator.services.mozilla.com/D73064
2020-05-04 17:40:59 +00:00
Myeongjun Go e5d2c2720f Bug 1532365 - Add a Raptor manifest unit test for use_live_sites r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D72677
2020-04-28 22:30:40 +00:00
Gregory Mierzwinski a417067744 Bug 1625470 - Part 1: Add --live-sites command line option to Raptor. r=perftest-reviewers,Bebe,AlexandruIonescu
This is the first patch of a multi-part patch to enable live site testing on Google Chrome for Android and Fenix. It adds the `--live-sites` command line option that disables the mozproxy playback (or enables live sites) when it is supplied.

Differential Revision: https://phabricator.services.mozilla.com/D69051
2020-04-23 10:02:06 +00:00
Marian Raiciof 9b74a0d7e6 Bug 1623027 - Improve error line for page load failures r=perftest-reviewers,AlexandruIonescu,whimboo,sparky
Differential Revision: https://phabricator.services.mozilla.com/D70550
2020-04-23 04:53:49 +00:00
Tarek Ziadé 99eb52a05a Bug 1631354 - very frequent browsertime speedometer logs too big to parse r=perftest-reviewers,sparky
Browsertime's -vvv displays the gecko profile passed through HTTP
in the logs, making them very big. This patch makes verbose output
an option and deactivates it by default.

Differential Revision: https://phabricator.services.mozilla.com/D71511
2020-04-21 12:07:56 +00:00
Gregory Mierzwinski bc30982e2a Bug 1628379 - Make browsertime fail early if chromedriver doesn't exist. r=perftest-reviewers,AlexandruIonescu
Some phones aren't updating their google-chrome version so we are hitting issues where the chromedriver is not being found because it's looking for an older version. This patch makes the error occur earlier and prevents browsertime from running if we hit it.

Differential Revision: https://phabricator.services.mozilla.com/D70210

--HG--
extra : moz-landing-system : lando
2020-04-13 07:17:28 +00:00
octavian.negru 4124e5bed3 Bug 1616818 - Get rid of bool_from_str method. Use distutils.util.strtobool instead. r=perftest-reviewers,Marian,sparky
Differential Revision: https://phabricator.services.mozilla.com/D63462

--HG--
extra : moz-landing-system : lando
2020-02-27 13:51:05 +00:00
Bogdan Tara 16c6f3244e Backed out changeset 026538af0f95 (bug 1616818) on sparky's request 2020-02-24 18:24:54 +02:00
octavian.negru 7b3ff520e4 Bug 1616818 - Get rid of bool_from_str method. Use distutils.util.strtobool instead. r=perftest-reviewers,Marian,sparky
Differential Revision: https://phabricator.services.mozilla.com/D63462

--HG--
extra : moz-landing-system : lando
2020-02-24 10:21:06 +00:00
octavian.negru 41750e345f Bug 1532315 - Allow Raptor test INI settings to use 'False/false' or 'True/true' r=perftest-reviewers,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D62563

--HG--
extra : moz-landing-system : lando
2020-02-14 08:28:40 +00:00