Граф коммитов

78 Коммитов

Автор SHA1 Сообщение Дата
Alex Lopez 07cf832a8a Bug 1696251 - Turn all properties in MachCommandBase subclasses into methods. r=mhentges,perftest-reviewers,sparky
As a step towards moving mach commands outside of classes, this converts all
properties into methods so that they can later become top-level helper functions.

Differential Revision: https://phabricator.services.mozilla.com/D112196
2021-05-26 18:08:02 +00:00
Alex Lopez 455d9a088b Bug 1696251 - Pass MachCommandBase object as first argument for Mach Commands. r=mhentges,remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers
As an intermediate step to allow mach commands as standalone functions, the MachCommandBase
subclass instance that currently corresponds to self has to be made available as a separate
argument (named command_context).

Differential Revision: https://phabricator.services.mozilla.com/D109650
2021-05-17 16:15:58 +00:00
Gregory Mierzwinski d02f8dc2a2 Bug 1675788 - Output supported perftest tools when mach browsertime is run. r=perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D115005
2021-05-13 12:46:37 +00:00
Butkovits Atila 2e34e363b9 Backed out 2 changesets (bug 1696251) for causing js-bench-sm failures. CLOSED TREE
Backed out changeset 1c84c9a34575 (bug 1696251)
Backed out changeset e169193b7423 (bug 1696251)
2021-04-23 02:53:36 +03:00
Alex Lopez 41687360e8 Bug 1696251 - Turn all properties in MachCommandBase subclasses into methods. r=mhentges,perftest-reviewers,sparky
As a step towards moving mach commands outside of classes, this converts all
properties into methods so that they can later become top-level helper functions.

Differential Revision: https://phabricator.services.mozilla.com/D112196
2021-04-22 19:44:52 +00:00
Alex Lopez d1a82b8092 Bug 1696251 - Pass MachCommandBase object as first argument for Mach Commands. r=mhentges,remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers
As an intermediate step to allow mach commands as standalone functions, the MachCommandBase
subclass instance that currently corresponds to self has to be made available as a separate
argument (named command_context).

Differential Revision: https://phabricator.services.mozilla.com/D109650
2021-04-22 18:56:15 +00:00
Cosmin Sabou 785f9b8a87 Backed out changeset d4a5d8567977 (bug 1696251) for non-unified build bustages. CLOSED TREE 2021-04-19 19:43:31 +03:00
Alex Lopez 75dfe35468 Bug 1696251 - Pass MachCommandBase object as first argument for Mach Commands. r=mhentges,remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers
As an intermediate step to allow mach commands as standalone functions, the MachCommandBase
subclass instance that currently corresponds to self has to be made available as a separate
argument (named command_context).

Differential Revision: https://phabricator.services.mozilla.com/D109650
2021-04-19 16:15:11 +00:00
Gregory Mierzwinski 40f4b63085 Bug 1686327 - Rewrite raptor gecko-profiling code. r=julienw
This patch rewrites some parts of the GeckoProfiler code to make it clearer and easier to maintain. It also changes how the profiles get organized into separate folders for each type. Furthermore, the archives no longer have the full directory path in them. To do this, we also have to update browsertime.

Differential Revision: https://phabricator.services.mozilla.com/D102043
2021-01-20 15:40:35 +00:00
Gregory Mierzwinski ddfec86473 Bug 1680998 - Update browsertime to v11. r=perftest-reviewers,davehunt
This patch updates browsertime to v11 which has a fix for the visual metrics failures that we've been seeing recently.

Differential Revision: https://phabricator.services.mozilla.com/D101193
2021-01-08 17:03:30 +00:00
Gregory Mierzwinski 233644d18b Bug 1680560 - Fix webrender on browsertime. r=perftest-reviewers,AlexandruIonescu
Currently the MOZ_WEBRENDER environment variable isn't being for browsertime tests, this patch fixes this isse. This patch also updates the browsertime version to pick up a fix in how the Firefox environment variables are set.

Differential Revision: https://phabricator.services.mozilla.com/D99925
2020-12-17 19:49:43 +00:00
Butkovits Atila f50a07a123 Backed out changeset 765d94836c7f (bug 1680560) for Raptor failures. CLOSED TREE 2020-12-17 19:26:50 +02:00
Gregory Mierzwinski 8c45b5e723 Bug 1680560 - Fix webrender on browsertime. r=perftest-reviewers,AlexandruIonescu
Currently the MOZ_WEBRENDER environment variable isn't being for browsertime tests, this patch fixes this isse. This patch also updates the browsertime version to pick up a fix in how the Firefox environment variables are set.

Differential Revision: https://phabricator.services.mozilla.com/D99925
2020-12-17 15:03:02 +00:00
Gregory Mierzwinski e9584941e4 Bug 1638365 - Use webdriver navigation for pageload tests. r=perftest-reviewers,Bebe,AlexandruIonescu
This patch upgrade browsertime to v10, and enables webdriver-based navigation in browsertime tests.

Differential Revision: https://phabricator.services.mozilla.com/D95425
2020-12-02 17:33:30 +00:00
Brindusan Cristian 0f710bf462 Backed out changeset 2052e35c9932 (bug 1638365) for performance regressions as requested by alexandrui on irc. CLOSED TREE 2020-11-12 14:31:20 +02:00
Gregory Mierzwinski 5c2926e336 Bug 1638365 - Use webdriver navigation for pageload tests. r=perftest-reviewers,Bebe
This patch upgrade browsertime to v10, enables webdriver-based navigation in browsertime tests, and also disables the Firefox WindowRecorder for a fairer comparison between Chrome and Firefox.

Differential Revision: https://phabricator.services.mozilla.com/D95425
2020-11-05 14:27:56 +00:00
Sean Feng bc73c91f55 Bug 1518999 - Bump the browsertime hash to 8bf45e80ccc65237c622246b11c0739f0409e8e4 r=sparky,perftest-reviewers
Bump the browsertime hash to add a fix from upstream which fixes a
firstPaint related bug when FCP is supported.

Differential Revision: https://phabricator.services.mozilla.com/D90108
2020-10-27 16:13:23 +00:00
Ricky Stewart 210585edd2 Bug 1672023 - Remove excluded files from `black.yml`
These files were omitted from the original patch because reformatting them required some manual intervention in order to avoid breaking unit tests. Generally the `noqa` lines were already there and just needed to be moved from one line to another (due to the reformatting by `black`), but sometimes `black` saw fit to move a bunch of stuff all onto one line, requiring me to introduce new `noqa` lines.

Besides the autoformat by `black` and some manual fixups, this patch contains no other changes.

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94052

Depends on D94045
2020-10-26 18:21:44 +00:00
Bogdan Tara da1098d4aa Backed out 10 changesets (bug 1654103, bug 1672023, bug 1518999) for PanZoomControllerTest.touchEventForResult gv-junit failures CLOSED TREE
Backed out changeset ff3fb0b4a512 (bug 1672023)
Backed out changeset e7834b600201 (bug 1654103)
Backed out changeset 807893ca8069 (bug 1518999)
Backed out changeset 13e6b92440e9 (bug 1518999)
Backed out changeset 8b2ac5a6c98a (bug 1518999)
Backed out changeset 575748295752 (bug 1518999)
Backed out changeset 65f07ce7b39b (bug 1518999)
Backed out changeset 4bb80556158d (bug 1518999)
Backed out changeset 8ac8461d7bd7 (bug 1518999)
Backed out changeset e8ba13ee17f5 (bug 1518999)
2020-10-24 03:36:18 +03:00
Ricky Stewart fe80718d67 Bug 1672023 - Remove excluded files from `black.yml` r=sylvestre,perftest-reviewers,geckoview-reviewers,agi
These files were omitted from the original patch because reformatting them required some manual intervention in order to avoid breaking unit tests. Generally the `noqa` lines were already there and just needed to be moved from one line to another (due to the reformatting by `black`), but sometimes `black` saw fit to move a bunch of stuff all onto one line, requiring me to introduce new `noqa` lines.

Besides the autoformat by `black` and some manual fixups, this patch contains no other changes.

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94052
2020-10-23 20:40:44 +00:00
Sean Feng 10786ede6c Bug 1518999 - Bump the browsertime hash to 8bf45e80ccc65237c622246b11c0739f0409e8e4 r=sparky,perftest-reviewers
Bump the browsertime hash to add a fix from upstream which fixes a
firstPaint related bug when FCP is supported.

Differential Revision: https://phabricator.services.mozilla.com/D90108
2020-10-23 19:46:56 +00:00
Ben Hearsum 427616a2a1 Bug 1598823: remove visualmetrics mach command r=sparky,releng-reviewers,perftest-reviewers,aki DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D94160
2020-10-22 15:20:20 +00:00
Dorel Luca 26941cf2f5 Backed out changeset 94ec15429e21 (bug 1672023) for Backout conflicts with Bug 1654103. CLOSED TREE 2020-10-22 03:43:01 +03:00
Ricky Stewart 8b352f1843 Bug 1672023 - Remove excluded files from `black.yml` r=sylvestre,perftest-reviewers,geckoview-reviewers,agi
These files were omitted from the original patch because reformatting them required some manual intervention in order to avoid breaking unit tests. Generally the `noqa` lines were already there and just needed to be moved from one line to another (due to the reformatting by `black`), but sometimes `black` saw fit to move a bunch of stuff all onto one line, requiring me to introduce new `noqa` lines.

Besides the autoformat by `black` and some manual fixups, this patch contains no other changes.

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94052
2020-10-21 21:29:30 +00:00
Gregory Mierzwinski 11ff239729 Bug 1639372 - Run visual metrics locally through raptor. r=tarek,perftest-reviewers,Bebe
This patch makes it possible to run visual metrics through raptor-browsertime locally.

Differential Revision: https://phabricator.services.mozilla.com/D90548
2020-09-30 15:13:06 +00:00
Dorel Luca 72ef712fd0 Backed out 10 changesets (bug 1518999) for GeckoView failures in PanZoomControllerTest.scroll. CLOSED TREE
Backed out changeset 7b5bdd071d05 (bug 1518999)
Backed out changeset 401e488734dd (bug 1518999)
Backed out changeset c13e51e17329 (bug 1518999)
Backed out changeset 2a2d67ba15b8 (bug 1518999)
Backed out changeset 3d4d84003227 (bug 1518999)
Backed out changeset 972731762965 (bug 1518999)
Backed out changeset f21b13582dad (bug 1518999)
Backed out changeset 13a4c749a802 (bug 1518999)
Backed out changeset 5a6cea5fd344 (bug 1518999)
Backed out changeset c3bb552e76a3 (bug 1518999)
2020-09-17 02:58:34 +03:00
Sean Feng 5a6573c11e Bug 1518999 - Bump the browsertime hash to 8bf45e80ccc65237c622246b11c0739f0409e8e4 r=sparky,perftest-reviewers
Bump the browsertime hash to add a fix from upstream which fixes a
firstPaint related bug when FCP is supported.

Differential Revision: https://phabricator.services.mozilla.com/D90108
2020-09-16 14:56:43 +00:00
Gregory Mierzwinski 7101f264ef Bug 1650879 - Upgrade browsertime to v9.4.0. r=tarek,perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D88324
2020-09-01 14:01:18 +00:00
Andrew Halberstadt d0fbcca0b6 Bug 985141 - [mozbuild] Remove leading underscore from MozbuildObject._activate_virtualenv, r=firefox-build-system-reviewers,perftest-reviewers,andi,AlexandruIonescu,rstewart
This function is used all across the tree and should be considered a public API.

Differential Revision: https://phabricator.services.mozilla.com/D85045
2020-07-28 16:06:10 +00:00
Gregory Mierzwinski 8d10f86507 Bug 1650871 - Add all browsertime desktop tests. r=perftest-reviewers,AlexandruIonescu
This patch adds all desktop pageload tests to browsertime. It adds taskcluster tasks for these but doesn't enable them in production. They can only be run when --full is used.

Differential Revision: https://phabricator.services.mozilla.com/D82432
2020-07-08 07:48:16 +00:00
Sylvestre Ledru 46af48052b Bug 1646421 - flake8 Fix a bunch of actual errors r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D80078
2020-06-20 09:46:45 +00:00
Gregory Mierzwinski cf5ee680a4 Bug 1642964 - Add small README file to tools/browsertime. r=tarek
This patch adds a small README file to the tools/browsertime folder to give people more information about its purpose and provides a link to the perftest wiki.

Depends on D78044

Differential Revision: https://phabricator.services.mozilla.com/D78045
2020-06-03 12:51:41 +00:00
Gregory Mierzwinski 44d2279d2e Bug 1642963 - Add bugzilla componenet to tools/browsertime code. r=tarek
This patch adds the Testing :: Raptor component to all files under `tools/browsertime`.

Differential Revision: https://phabricator.services.mozilla.com/D78044
2020-06-03 12:50:45 +00:00
Gregory Mierzwinski 115d1b4294 Bug 1641566 - Update in-tree browsertime to latest. r=tarek,perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D77257
2020-05-29 12:24:33 +00:00
Tooru Fujisawa 2108f90fcf Bug 1623965 - Improve error message when binary not found while testing. r=glandium,remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,Bebe,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D67726
2020-04-21 11:58:04 +00:00
Myeongjun Go d83a7f3703 Bug 1614443 - added browsertime usage command(--browsertime-help) r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D67985

--HG--
extra : moz-landing-system : lando
2020-03-26 12:44:08 +00:00
Gregory Mierzwinski 61a0db5200 Bug 1623055 - Update in-tree browsertime to 8.3.0. r=perftest-reviewers,tarek,AlexandruIonescu
This patch updates the in-tree browsertime to v8.3.0.

Differential Revision: https://phabricator.services.mozilla.com/D67170

--HG--
extra : moz-landing-system : lando
2020-03-26 07:58:39 +00:00
Tarek Ziadé 5fb873ad16 Bug 1607522 - improve dependency detection r=sefeng,perftest-reviewers,sparky
When a package is installed with "pip --user", the import works right after the virtualenv activation.
Even if we force its install via mozbuild virtualenv it will fail. This patch checks if the installed package is **inside** or
**outside** the virtualenv. If it's outside, it forces its installation **inside**.

Notice that we might want to move that logic in mozbuild/virtualenv.py

Differential Revision: https://phabricator.services.mozilla.com/D67592

--HG--
extra : moz-landing-system : lando
2020-03-20 14:16:34 +00:00
Nick Alexander 4d7d9f4968 Bug 1612191 - Implement `mach browsertime --update-upstream-url $URL` for bumping version. r=Standard8,tarek
Might as well automate what we can automate.  I considered making the
"update package.json" logic part of setup_helper.py, so that it can be
used more broadly, but it's not clear it would be used with the
general push towards vendoring into the tree as part of `mach vendor`.

Depends on D63370

Differential Revision: https://phabricator.services.mozilla.com/D63371

--HG--
extra : moz-landing-system : lando
2020-02-24 10:53:50 +00:00
Nick Alexander df11faa804 Bug 1607851 - Bump browsertime version to sitespeedio/browsertime@v8.0.1+. r=tarek
This patch upgrades the major browsertime version used in-tree from 4 to 8 (including some additional fixes to fix some failing tests on our end).

We also add the node v10 requirement in this patch. Also, there were some changes in the browsertime repo's visualmetrics.py script that made it necessary to change where we find the file.

Differential Revision: https://phabricator.services.mozilla.com/D59235

--HG--
extra : moz-landing-system : lando
2020-02-17 20:20:18 +00:00
Tarek Ziadé d3d110bba7 Bug 1608136 - Fixed ContentfulSpeedIndex extraction r=sparky
The convert output is now parsed in a more robust manner.

Differential Revision: https://phabricator.services.mozilla.com/D60108

--HG--
extra : moz-landing-system : lando
2020-01-21 19:56:52 +00:00
Tarek Ziadé dc4e8c242a Bug 1608464 - Stop trying to set --firefox.binaryPath if --android is used r=jnicol
Differential Revision: https://phabricator.services.mozilla.com/D59835

--HG--
extra : moz-landing-system : lando
2020-01-14 10:35:38 +00:00
Tarek Ziadé 9bb6e90df8 Bug 1565027 - check browsertime node install
Teach `mach browsertime` to tell you to `mach browsertime --setup` if we're not already set up

Differential Revision: https://phabricator.services.mozilla.com/D59501

--HG--
extra : moz-landing-system : lando
2020-01-14 08:14:35 +00:00
Tarek Ziadé c1555abb86 Bug 1607522 - hard stop if Pillow or pyssim could not be installed r=nalexander
Let's stop if the packages could not be installed.
Also, let's skip the call if we find them.

Differential Revision: https://phabricator.services.mozilla.com/D59690

--HG--
extra : moz-landing-system : lando
2020-01-14 08:04:54 +00:00
Tarek Ziadé b1af7191f1 Bug 1596237 - make sure ImageMagick's ffmpeg does not take precedence r=acreskey
Tweaked sys.path on windows to make sure we use the right ffmpeg binary

Differential Revision: https://phabricator.services.mozilla.com/D59681

--HG--
extra : moz-landing-system : lando
2020-01-14 06:58:04 +00:00
Tarek Ziadé d6564b8479 Bug 1558239 - Use MOZ_OBJDIR as default binary for ./mach browsertime r=dpalmeiro
Use the binary from MOZ_OBJDIR as the default when invoking mach browsertime.
The options --firefox.binaryPath, --firefox.release, --firefox.beta, --firefox.nightly, or -b chrome, will override this default.

Differential Revision: https://phabricator.services.mozilla.com/D34382

--HG--
extra : moz-landing-system : lando
2019-12-16 17:02:43 +00:00
Tarek Ziadé b66bbc9375 Bug 1602577 - Update in-tree Browsertime version r=barret
Update in-tree Browsertime version

Differential Revision: https://phabricator.services.mozilla.com/D56454

--HG--
extra : moz-landing-system : lando
2019-12-09 21:36:58 +00:00
Tarek Ziadé db1843773d Bug 1601367 - Don't install ImageMagick for Browsertime @ macOS r=rwood
Differential Revision: https://phabricator.services.mozilla.com/D55856

--HG--
extra : moz-landing-system : lando
2019-12-07 07:30:17 +00:00
Tarek Ziadé ae3f8a3171 Bug 1600553 - Update in-tree Browsertime version r=barret
Update in-tree Browsertime version

Differential Revision: https://phabricator.services.mozilla.com/D55412

--HG--
extra : moz-landing-system : lando
2019-12-02 19:52:03 +00:00
Gregory Mierzwinski 787b280e15 Bug 1594795 - Fix local browsertime issues on Windows and MacOS. r=perftest-reviewers,barret,stephendonner,davehunt
This patch fixes local `./mach browsertime` issues on Windows.

First issue that is fixed is that the archive is extracted into the browsertime folder instead of a separate folder for imagemagick within the browsertime folder. Now, it is extracted into it's own folder whose name depends on the `fetches` path entry. Second issue fixed is that the environment was being contaminated with bad strings because of the `GECKODRIVER_BASE_URL` addition - using `str` on the entries solves this issue.

Finally, convert and compare were not passing in the visualmetrics.py check call. This is because ImageMagick expects to find the path to them within `ProgramFiles` on windows. Since we don't have them there, we have to add an entry in the `PATH` environment variable to point to the imagemagick directory to get around this.

There is also an issue with the macosx imagemagick directory which was being extracted as 7.0.9, but we expected 7.0.8. The imagemagick version used is modified to the correct version with the expected directory.

Differential Revision: https://phabricator.services.mozilla.com/D52751

--HG--
extra : moz-landing-system : lando
2019-11-19 14:08:40 +00:00