Граф коммитов

135 Коммитов

Автор SHA1 Сообщение Дата
Yue Zhang 72faa9da2c Bug 1639693 - Allow mach perftest users to provide their own custom tranformer from the command line. r=sparky,tarek
Differential Revision: https://phabricator.services.mozilla.com/D86417
2020-09-01 15:03:32 +00:00
Cristina Coroiu 8eaafae8fd Backed out 2 changesets (bug 1661514) for lint failure on a CLOSED TREE
Backed out changeset 8e58c88f756b (bug 1661514)
Backed out changeset aef89f9a8031 (bug 1661514)
2020-09-01 19:34:12 +03:00
Sylvestre Ledru 5ee2fbd7cb Bug 1661514 - Reformat some python files with black 20.8b1 r=rstewart
# ignore-this-changeset

Depends on D88711

Differential Revision: https://phabricator.services.mozilla.com/D88712
2020-08-31 17:06:22 +00:00
Gregory Mierzwinski 756d14a209 Bug 1662278 - Simplify mozperftest metric names. r=tarek
This patch adds two new options to mozperftest. The --simplify-names argument can be provided to enable simplification of metric names and the --simplify-exclude option allows users to select which metrics to skip in the simplification. A bug relating to setting the default of a list option is also fixed here.

Differential Revision: https://phabricator.services.mozilla.com/D88917
2020-09-01 15:29:41 +00:00
Gregory Mierzwinski b2e2d7432f Bug 1662278 - Fix test_visualmetrics local linux failure. r=tarek
This fixes a local failure in mozperftest by mocking the find_node_executable function in the visual-metrics tests. It is not needed for those tests.

Depends on D88915

Differential Revision: https://phabricator.services.mozilla.com/D88916
2020-09-01 14:57:19 +00:00
Gregory Mierzwinski ae98f6130b Bug 1662278 - Pin black to version 19.10b0. r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D88915
2020-09-01 15:09:44 +00:00
Gregory Mierzwinski 7101f264ef Bug 1650879 - Upgrade browsertime to v9.4.0. r=tarek,perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D88324
2020-09-01 14:01:18 +00:00
Tarek Ziadé bbb7d4b5d5 Bug 1659411 - add missing dep r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D88295
2020-08-26 15:47:02 +00:00
Tarek Ziadé 2909efb662 Bug 1650363 - Performance testing of HTTP3 in Firefox using only xpcshell tests r=michal,sparky
Differential Revision: https://phabricator.services.mozilla.com/D84021
2020-08-10 06:26:39 +00:00
Gregory Mierzwinski f87d8a4859 Bug 1657898 - Fix fenix artifact paths. r=jlorenzo,tarek
Differential Revision: https://phabricator.services.mozilla.com/D86351
2020-08-08 12:16:49 +00:00
Tarek Ziadé abb4969c3e Bug 1656235 - support visual metrics r=acreskey,sparky
Differential Revision: https://phabricator.services.mozilla.com/D85561
2020-08-08 12:17:48 +00:00
Tarek Ziadé 5a38472369 Bug 1651818 - fixed logger when runner is used directly r=acreskey
Differential Revision: https://phabricator.services.mozilla.com/D86305
2020-08-08 12:17:48 +00:00
Jim Porter 8e234c7598 Bug 1537763 - [mozproxy] Add a record mode; r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D84399
2020-08-05 19:43:55 +00:00
Bogdan Tara abfa3262b8 Backed out changeset 1ccda1d0c3ea (bug 1650363) for causing a serious regression in packaging time 2020-08-05 04:23:20 +03:00
Yue Zhang cb36d08ccc Bug 1630611 - Remove the nested helper function in the flat() function. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D85677
2020-08-04 17:15:40 +00:00
Tarek Ziadé 03cbd4d536 Bug 1650363 - Performance testing of HTTP3 in Firefox using only xpcshell tests r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D84021
2020-08-02 17:28:57 +00:00
Gregory Mierzwinski a4e1ebe204 Bug 1656540 - Allow specifying perfherder settings on a per-metric basis. r=tarek
This patch fixes an issue where the metric settings were not being used because they don't use the test name. It also handles some changes (from a bad copy-paste) that didn't make it into the last live-site patch series.

Differential Revision: https://phabricator.services.mozilla.com/D85609
2020-08-01 16:13:28 +00:00
Yue Zhang 210c0b2307 Bug 1635930 - Activate a layer when its options are used. r=sparky,tarek
Differential Revision: https://phabricator.services.mozilla.com/D83551
2020-07-31 17:23:51 +00:00
Gregory Mierzwinski ee2aa57e5c Bug 1655031 - Fix how mozperftest metrics are parsed. r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D85318
2020-07-31 15:33:12 +00:00
Gregory Mierzwinski d93acb6b75 Bug 1655032 - Add splitting functionality to metrics module. r=tarek
This patch adds the `--<LAYER>-split-by` option to the metric layers. It allows users to split the data they obtain using a given data field name. For instance, if `browserScripts.pageinfo.url` is provided, then the data will be split based on the unique URLs that are found.

Differential Revision: https://phabricator.services.mozilla.com/D84822
2020-07-30 23:12:28 +00:00
Tarek Ziadé cb00bce720 Bug 1655956 - removed unused perf tuning code r=sparky
Removes unused API and add missing coverage

Differential Revision: https://phabricator.services.mozilla.com/D85285
2020-07-29 17:35:35 +00:00
Andrew Halberstadt cc0b1f8e5f Bug 985141 - [mozperftest] Fix missed instances of _activate_virtualenv in mozperftest framework, r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D85203
2020-07-28 20:54:58 +00:00
Andrew Halberstadt d0fbcca0b6 Bug 985141 - [mozbuild] Remove leading underscore from MozbuildObject._activate_virtualenv, r=firefox-build-system-reviewers,perftest-reviewers,andi,AlexandruIonescu,rstewart
This function is used all across the tree and should be considered a public API.

Differential Revision: https://phabricator.services.mozilla.com/D85045
2020-07-28 16:06:10 +00:00
Andrew Creskey c6c9bc4f6f Bug 1648857 - Add applink perftest for the reference browser r=tarek,sparky
The Reference Browser represents our tech stack up to and including the Android-Components layer.
It would be useful to have an applink startup test for this browser to detect improvements and regressions.

Differential Revision: https://phabricator.services.mozilla.com/D81407
2020-07-23 14:11:38 +00:00
Yue Zhang 04a60db9fe Bug 1635930 - Fix notebookupload.py layer. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D83726
2020-07-21 18:45:40 +00:00
Gregory Mierzwinski 14830697f7 Bug 1652979 - Use org.mozilla.fenix package name in mozperftest. r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D84375
2020-07-21 17:07:00 +00:00
Tarek Ziadé cb88926dd6 Bug 1651624 - Add a macOS layer r=sparky
Adds a macOS layer that provides the ability to
mount DMGs on the fly. For instance Firefox's distribution.

Differential Revision: https://phabricator.services.mozilla.com/D84162
2020-07-21 12:51:58 +00:00
Bob Clary 6b2b24ee30 Bug 1486004 - Part 6 - Update mach perftest to support unrooted android devices using mozdevice 4.0.0, ? r=tarek
Depends on D82748

Differential Revision: https://phabricator.services.mozilla.com/D82749
2020-07-17 20:48:35 +00:00
Johan Lorenzo b651a3366d Bug 1631839 - Update mobile routes to use new namespace r=tarek,sparky,acreskey
Differential Revision: https://phabricator.services.mozilla.com/D81038
2020-07-17 16:00:57 +00:00
Tarek Ziadé df3af8361c Bug 1651300 - support for xpcshell tests r=sparky
Implements xpcshell support, through the new flavor

Differential Revision: https://phabricator.services.mozilla.com/D82727
2020-07-17 22:12:26 +00:00
Tarek Ziadé 883db95e9d Bug 1628278 - added conditioned profile support r=acreskey
Adds conditioned profiles and make the Profile
layer a system layer instead of a test layer

Differential Revision: https://phabricator.services.mozilla.com/D83612
2020-07-16 13:30:11 +00:00
Narcis Beleuzu b1faa2872a Backed out 17 changesets (bug 1486004) for wrench bustage on android.py . CLOSED TREE
Backed out changeset cae730f105d7 (bug 1486004)
Backed out changeset e0094d50a315 (bug 1486004)
Backed out changeset 424425ed98c6 (bug 1486004)
Backed out changeset 551232749abe (bug 1486004)
Backed out changeset 505747095def (bug 1486004)
Backed out changeset 5b1c62c4a4d5 (bug 1486004)
Backed out changeset 0a1c8d50ee69 (bug 1486004)
Backed out changeset 6ef81c676859 (bug 1486004)
Backed out changeset 234e55153fb6 (bug 1486004)
Backed out changeset 2f33b309d746 (bug 1486004)
Backed out changeset 48947692c176 (bug 1486004)
Backed out changeset 473bac8eedd9 (bug 1486004)
Backed out changeset af6afed0a04a (bug 1486004)
Backed out changeset a0e2f91eb4d4 (bug 1486004)
Backed out changeset 138c987440c7 (bug 1486004)
Backed out changeset 6d2e305f4722 (bug 1486004)
Backed out changeset 1181ff03bb05 (bug 1486004)
2020-07-17 23:43:57 +03:00
Bob Clary d667fb0fa1 Bug 1486004 - Part 6 - Update mach perftest to support unrooted android devices using mozdevice 4.0.0, ? r=tarek
Depends on D82748

Differential Revision: https://phabricator.services.mozilla.com/D82749
2020-07-16 21:32:53 +00:00
Narcis Beleuzu 1eb115035d Backed out 20 changesets (bug 1486004, bug 1653094) for wrench bustages. CLOSED TREE
Backed out changeset 120c64ebdea3 (bug 1486004)
Backed out changeset b10f105b1c36 (bug 1486004)
Backed out changeset 7f186e6bcccc (bug 1486004)
Backed out changeset cdda7b349cd8 (bug 1486004)
Backed out changeset 650c47e81402 (bug 1486004)
Backed out changeset 2bcca7cf3f1b (bug 1486004)
Backed out changeset e1df276f8a8d (bug 1486004)
Backed out changeset f6f5e7f2bd0a (bug 1486004)
Backed out changeset 1c56cb03ce53 (bug 1486004)
Backed out changeset 582cd190f174 (bug 1486004)
Backed out changeset 7c162e1b3a79 (bug 1486004)
Backed out changeset d1088e178216 (bug 1486004)
Backed out changeset 40763f4afd26 (bug 1486004)
Backed out changeset f20eb5b5a670 (bug 1486004)
Backed out changeset 6349ee0bd63f (bug 1486004)
Backed out changeset 7c23729053f6 (bug 1486004)
Backed out changeset 49586014bd29 (bug 1486004)
Backed out changeset 07971e82ae85 (bug 1653094)
Backed out changeset 47e7295e9c19 (bug 1653094)
Backed out changeset 57a25bbeec37 (bug 1653094)
2020-07-16 17:58:09 +03:00
Bob Clary 8f3e6b9e4c Bug 1486004 - Part 6 - Update mach perftest to support unrooted android devices using mozdevice 4.0.0, ? r=tarek
Depends on D82748

Differential Revision: https://phabricator.services.mozilla.com/D82749
2020-07-15 20:58:20 +00:00
Mihai Alexandru Michis a1d49fb98d Backed out 17 changesets (bug 1486004) for causing bustages in AccessCheck.h
CLOSED TREE

Backed out changeset 86a0855e1e45 (bug 1486004)
Backed out changeset 4fc98067edc5 (bug 1486004)
Backed out changeset 8ab3f1597fde (bug 1486004)
Backed out changeset b487e98320fb (bug 1486004)
Backed out changeset 4cba8e6bc515 (bug 1486004)
Backed out changeset d0db5eef2343 (bug 1486004)
Backed out changeset 50285a87de6b (bug 1486004)
Backed out changeset 9730c0303810 (bug 1486004)
Backed out changeset 140a9d2362f3 (bug 1486004)
Backed out changeset 9d1ce06f6039 (bug 1486004)
Backed out changeset 88a5a4ab39fa (bug 1486004)
Backed out changeset eb186c92232d (bug 1486004)
Backed out changeset 677f2129750e (bug 1486004)
Backed out changeset 81427a5f2103 (bug 1486004)
Backed out changeset 38d7def3d425 (bug 1486004)
Backed out changeset a9e73221c471 (bug 1486004)
Backed out changeset ebe8c2d5432e (bug 1486004)
2020-07-16 15:29:29 +03:00
Bob Clary bcf4eeb0d5 Bug 1486004 - Part 6 - Update mach perftest to support unrooted android devices using mozdevice 4.0.0, ? r=tarek
Depends on D82748

Differential Revision: https://phabricator.services.mozilla.com/D82749
2020-07-15 20:58:20 +00:00
Myeongjun Go 32cbdb3b33 Bug 1649497 - [perfdocs] Port mozperftest into Performance Testing r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D82207
2020-07-15 17:13:30 +00:00
Csoregi Natalia 2d34e224ae Backed out changeset 448679382b06 (bug 1649497) for linting failures on framework_gatherers.py. CLOSED TREE 2020-07-14 20:20:48 +03:00
Myeongjun Go 62777a18b5 Bug 1649497 - [perfdocs] Port mozperftest into Performance Testing r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D82207
2020-07-14 16:55:56 +00:00
Tarek Ziadé 7dfca9db55 Bug 1644778 - add a mozperftest to measure browser.xhtml DOM size, r=tarek,dhouse,sparky
Differential Revision: https://phabricator.services.mozilla.com/D79152
2020-07-13 15:44:38 +00:00
Bob Clary 13b8cbabeb Bug 1652339 - set mozdevice version requirements to exclude version 4.0.0 on trunk, beta r=marionette-reviewers,perftest-reviewers,whimboo,sparky
Differential Revision: https://phabricator.services.mozilla.com/D83278
2020-07-13 11:36:39 +00:00
Jim Porter 5c759e3542 Bug 1631806 - [mozproxy] Add a command line interface r=tarek,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D76017
2020-07-08 13:41:24 +00:00
Tarek Ziadé 44eb9c7f7e Bug 1651048 - remove unused transformer r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D82521
2020-07-07 12:48:47 +00:00
Tarek Ziadé 93ae761b53 Bug 1651044 - Fixed a test in mozperftest r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D82515
2020-07-07 12:34:32 +00:00
Tarek Ziadé ee86c32c2e Bug 1648360 - complex metrics in --perfherder-metrics r=sparky
This patch adds the ability to define complex metrics

Differential Revision: https://phabricator.services.mozilla.com/D82161
2020-07-06 14:28:37 +00:00
xuanqi xu a4676c048b Bug 1640875 - Add compare function to notebook layer. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D80384
2020-07-06 15:05:06 +00:00
Coroiu Cristina 50d2261646 Backed out changeset 65acd64b9e0e (bug 1640875) for mpu failures 2020-07-03 15:59:28 +03:00
xuanqi xu aff7d7822c Bug 1640875 - Add compare function to notebook layer. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D80384
2020-07-02 16:14:23 +00:00
Yue Zhang 765e406782 Bug 1643469 - Swap NotebookLogger for MachLogger. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D81156
2020-06-30 13:14:38 +00:00