Tarek Ziadé
5f7fe6ede4
Bug 1663937 - add options metadata r=sparky,perftest-reviewers
...
Differential Revision: https://phabricator.services.mozilla.com/D89922
2020-09-16 14:00:18 +00:00
Tarek Ziadé
3021e5b216
Bug 1662706 - add a fuzzy runner r=sparky,necko-reviewers,rstewart
...
Differential Revision: https://phabricator.services.mozilla.com/D89123
2020-09-11 08:13:27 +00:00
Tarek Ziadé
9c8bb6e963
Bug 1663417 - make scriptinfo compatible with xpcshell tests r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D89372
2020-09-10 23:15:09 +00:00
Tarek Ziadé
0bf97a3ebc
Bug 1661809 - use mach lint r=sparky
...
Removed our custom linter calls and use mach lint
Differential Revision: https://phabricator.services.mozilla.com/D89703
2020-09-10 23:15:07 +00:00
Narcis Beleuzu
f837964009
Backed out 3 changesets (bug 1661809, bug 1662706, bug 1663417) for SM bustages. CLOSED TREE
...
Backed out changeset 96e69574f7ee (bug 1662706)
Backed out changeset a584b11a503a (bug 1663417)
Backed out changeset 655ce94f20f3 (bug 1661809)
2020-09-11 01:50:09 +03:00
Tarek Ziadé
282632b3a0
Bug 1662706 - add a fuzzy runner r=sparky,necko-reviewers,rstewart DONTBUILD
...
Differential Revision: https://phabricator.services.mozilla.com/D89123
2020-09-10 11:36:29 +00:00
Tarek Ziadé
2e207a9e80
Bug 1663417 - make scriptinfo compatible with xpcshell tests r=sparky DONTBUILD
...
Differential Revision: https://phabricator.services.mozilla.com/D89372
2020-09-10 11:18:26 +00:00
Tarek Ziadé
fa3f23fe40
Bug 1661809 - use mach lint r=sparky DONTBUILD
...
Removed our custom linter calls and use mach lint
Differential Revision: https://phabricator.services.mozilla.com/D89703
2020-09-10 14:00:15 +00:00
Myeongjun Go
b53336d5a4
Bug 1653326 - [perfdocs] Add documentation about individual mozperftest tests to perfdocs r=sparky,perftest-reviewers
...
Differential Revision: https://phabricator.services.mozilla.com/D86488
2020-09-09 17:58:39 +00:00
Sylvestre Ledru
da34b6a58e
Bug 1661514 - Reformat some python files with black 20.8b1 r=rstewart
...
# ignore-this-changeset
Depends on D88711
Differential Revision: https://phabricator.services.mozilla.com/D88712
2020-09-07 14:05:10 +00:00
Yue Zhang
72faa9da2c
Bug 1639693 - Allow mach perftest users to provide their own custom tranformer from the command line. r=sparky,tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D86417
2020-09-01 15:03:32 +00:00
Cristina Coroiu
8eaafae8fd
Backed out 2 changesets (bug 1661514) for lint failure on a CLOSED TREE
...
Backed out changeset 8e58c88f756b (bug 1661514)
Backed out changeset aef89f9a8031 (bug 1661514)
2020-09-01 19:34:12 +03:00
Sylvestre Ledru
5ee2fbd7cb
Bug 1661514 - Reformat some python files with black 20.8b1 r=rstewart
...
# ignore-this-changeset
Depends on D88711
Differential Revision: https://phabricator.services.mozilla.com/D88712
2020-08-31 17:06:22 +00:00
Gregory Mierzwinski
756d14a209
Bug 1662278 - Simplify mozperftest metric names. r=tarek
...
This patch adds two new options to mozperftest. The --simplify-names argument can be provided to enable simplification of metric names and the --simplify-exclude option allows users to select which metrics to skip in the simplification. A bug relating to setting the default of a list option is also fixed here.
Differential Revision: https://phabricator.services.mozilla.com/D88917
2020-09-01 15:29:41 +00:00
Gregory Mierzwinski
b2e2d7432f
Bug 1662278 - Fix test_visualmetrics local linux failure. r=tarek
...
This fixes a local failure in mozperftest by mocking the find_node_executable function in the visual-metrics tests. It is not needed for those tests.
Depends on D88915
Differential Revision: https://phabricator.services.mozilla.com/D88916
2020-09-01 14:57:19 +00:00
Gregory Mierzwinski
ae98f6130b
Bug 1662278 - Pin black to version 19.10b0. r=tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D88915
2020-09-01 15:09:44 +00:00
Gregory Mierzwinski
7101f264ef
Bug 1650879 - Upgrade browsertime to v9.4.0. r=tarek,perftest-reviewers,Bebe
...
Differential Revision: https://phabricator.services.mozilla.com/D88324
2020-09-01 14:01:18 +00:00
Tarek Ziadé
bbb7d4b5d5
Bug 1659411 - add missing dep r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D88295
2020-08-26 15:47:02 +00:00
Tarek Ziadé
2909efb662
Bug 1650363 - Performance testing of HTTP3 in Firefox using only xpcshell tests r=michal,sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D84021
2020-08-10 06:26:39 +00:00
Gregory Mierzwinski
f87d8a4859
Bug 1657898 - Fix fenix artifact paths. r=jlorenzo,tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D86351
2020-08-08 12:16:49 +00:00
Tarek Ziadé
abb4969c3e
Bug 1656235 - support visual metrics r=acreskey,sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D85561
2020-08-08 12:17:48 +00:00
Tarek Ziadé
5a38472369
Bug 1651818 - fixed logger when runner is used directly r=acreskey
...
Differential Revision: https://phabricator.services.mozilla.com/D86305
2020-08-08 12:17:48 +00:00
Jim Porter
8e234c7598
Bug 1537763 - [mozproxy] Add a record mode; r=tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D84399
2020-08-05 19:43:55 +00:00
Bogdan Tara
abfa3262b8
Backed out changeset 1ccda1d0c3ea (bug 1650363) for causing a serious regression in packaging time
2020-08-05 04:23:20 +03:00
Yue Zhang
cb36d08ccc
Bug 1630611 - Remove the nested helper function in the flat() function. r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D85677
2020-08-04 17:15:40 +00:00
Tarek Ziadé
03cbd4d536
Bug 1650363 - Performance testing of HTTP3 in Firefox using only xpcshell tests r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D84021
2020-08-02 17:28:57 +00:00
Gregory Mierzwinski
a4e1ebe204
Bug 1656540 - Allow specifying perfherder settings on a per-metric basis. r=tarek
...
This patch fixes an issue where the metric settings were not being used because they don't use the test name. It also handles some changes (from a bad copy-paste) that didn't make it into the last live-site patch series.
Differential Revision: https://phabricator.services.mozilla.com/D85609
2020-08-01 16:13:28 +00:00
Yue Zhang
210c0b2307
Bug 1635930 - Activate a layer when its options are used. r=sparky,tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D83551
2020-07-31 17:23:51 +00:00
Gregory Mierzwinski
ee2aa57e5c
Bug 1655031 - Fix how mozperftest metrics are parsed. r=tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D85318
2020-07-31 15:33:12 +00:00
Gregory Mierzwinski
d93acb6b75
Bug 1655032 - Add splitting functionality to metrics module. r=tarek
...
This patch adds the `--<LAYER>-split-by` option to the metric layers. It allows users to split the data they obtain using a given data field name. For instance, if `browserScripts.pageinfo.url` is provided, then the data will be split based on the unique URLs that are found.
Differential Revision: https://phabricator.services.mozilla.com/D84822
2020-07-30 23:12:28 +00:00
Tarek Ziadé
cb00bce720
Bug 1655956 - removed unused perf tuning code r=sparky
...
Removes unused API and add missing coverage
Differential Revision: https://phabricator.services.mozilla.com/D85285
2020-07-29 17:35:35 +00:00
Andrew Halberstadt
cc0b1f8e5f
Bug 985141 - [mozperftest] Fix missed instances of _activate_virtualenv in mozperftest framework, r=perftest-reviewers,sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D85203
2020-07-28 20:54:58 +00:00
Andrew Halberstadt
d0fbcca0b6
Bug 985141 - [mozbuild] Remove leading underscore from MozbuildObject._activate_virtualenv, r=firefox-build-system-reviewers,perftest-reviewers,andi,AlexandruIonescu,rstewart
...
This function is used all across the tree and should be considered a public API.
Differential Revision: https://phabricator.services.mozilla.com/D85045
2020-07-28 16:06:10 +00:00
Andrew Creskey
c6c9bc4f6f
Bug 1648857 - Add applink perftest for the reference browser r=tarek,sparky
...
The Reference Browser represents our tech stack up to and including the Android-Components layer.
It would be useful to have an applink startup test for this browser to detect improvements and regressions.
Differential Revision: https://phabricator.services.mozilla.com/D81407
2020-07-23 14:11:38 +00:00
Yue Zhang
04a60db9fe
Bug 1635930 - Fix notebookupload.py layer. r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D83726
2020-07-21 18:45:40 +00:00
Gregory Mierzwinski
14830697f7
Bug 1652979 - Use org.mozilla.fenix package name in mozperftest. r=tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D84375
2020-07-21 17:07:00 +00:00
Tarek Ziadé
cb88926dd6
Bug 1651624 - Add a macOS layer r=sparky
...
Adds a macOS layer that provides the ability to
mount DMGs on the fly. For instance Firefox's distribution.
Differential Revision: https://phabricator.services.mozilla.com/D84162
2020-07-21 12:51:58 +00:00
Bob Clary
6b2b24ee30
Bug 1486004 - Part 6 - Update mach perftest to support unrooted android devices using mozdevice 4.0.0, ? r=tarek
...
Depends on D82748
Differential Revision: https://phabricator.services.mozilla.com/D82749
2020-07-17 20:48:35 +00:00
Johan Lorenzo
b651a3366d
Bug 1631839 - Update mobile routes to use new namespace r=tarek,sparky,acreskey
...
Differential Revision: https://phabricator.services.mozilla.com/D81038
2020-07-17 16:00:57 +00:00
Tarek Ziadé
df3af8361c
Bug 1651300 - support for xpcshell tests r=sparky
...
Implements xpcshell support, through the new flavor
Differential Revision: https://phabricator.services.mozilla.com/D82727
2020-07-17 22:12:26 +00:00
Tarek Ziadé
883db95e9d
Bug 1628278 - added conditioned profile support r=acreskey
...
Adds conditioned profiles and make the Profile
layer a system layer instead of a test layer
Differential Revision: https://phabricator.services.mozilla.com/D83612
2020-07-16 13:30:11 +00:00
Narcis Beleuzu
b1faa2872a
Backed out 17 changesets (bug 1486004) for wrench bustage on android.py . CLOSED TREE
...
Backed out changeset cae730f105d7 (bug 1486004)
Backed out changeset e0094d50a315 (bug 1486004)
Backed out changeset 424425ed98c6 (bug 1486004)
Backed out changeset 551232749abe (bug 1486004)
Backed out changeset 505747095def (bug 1486004)
Backed out changeset 5b1c62c4a4d5 (bug 1486004)
Backed out changeset 0a1c8d50ee69 (bug 1486004)
Backed out changeset 6ef81c676859 (bug 1486004)
Backed out changeset 234e55153fb6 (bug 1486004)
Backed out changeset 2f33b309d746 (bug 1486004)
Backed out changeset 48947692c176 (bug 1486004)
Backed out changeset 473bac8eedd9 (bug 1486004)
Backed out changeset af6afed0a04a (bug 1486004)
Backed out changeset a0e2f91eb4d4 (bug 1486004)
Backed out changeset 138c987440c7 (bug 1486004)
Backed out changeset 6d2e305f4722 (bug 1486004)
Backed out changeset 1181ff03bb05 (bug 1486004)
2020-07-17 23:43:57 +03:00
Bob Clary
d667fb0fa1
Bug 1486004 - Part 6 - Update mach perftest to support unrooted android devices using mozdevice 4.0.0, ? r=tarek
...
Depends on D82748
Differential Revision: https://phabricator.services.mozilla.com/D82749
2020-07-16 21:32:53 +00:00
Narcis Beleuzu
1eb115035d
Backed out 20 changesets (bug 1486004, bug 1653094) for wrench bustages. CLOSED TREE
...
Backed out changeset 120c64ebdea3 (bug 1486004)
Backed out changeset b10f105b1c36 (bug 1486004)
Backed out changeset 7f186e6bcccc (bug 1486004)
Backed out changeset cdda7b349cd8 (bug 1486004)
Backed out changeset 650c47e81402 (bug 1486004)
Backed out changeset 2bcca7cf3f1b (bug 1486004)
Backed out changeset e1df276f8a8d (bug 1486004)
Backed out changeset f6f5e7f2bd0a (bug 1486004)
Backed out changeset 1c56cb03ce53 (bug 1486004)
Backed out changeset 582cd190f174 (bug 1486004)
Backed out changeset 7c162e1b3a79 (bug 1486004)
Backed out changeset d1088e178216 (bug 1486004)
Backed out changeset 40763f4afd26 (bug 1486004)
Backed out changeset f20eb5b5a670 (bug 1486004)
Backed out changeset 6349ee0bd63f (bug 1486004)
Backed out changeset 7c23729053f6 (bug 1486004)
Backed out changeset 49586014bd29 (bug 1486004)
Backed out changeset 07971e82ae85 (bug 1653094)
Backed out changeset 47e7295e9c19 (bug 1653094)
Backed out changeset 57a25bbeec37 (bug 1653094)
2020-07-16 17:58:09 +03:00
Bob Clary
8f3e6b9e4c
Bug 1486004 - Part 6 - Update mach perftest to support unrooted android devices using mozdevice 4.0.0, ? r=tarek
...
Depends on D82748
Differential Revision: https://phabricator.services.mozilla.com/D82749
2020-07-15 20:58:20 +00:00
Mihai Alexandru Michis
a1d49fb98d
Backed out 17 changesets (bug 1486004) for causing bustages in AccessCheck.h
...
CLOSED TREE
Backed out changeset 86a0855e1e45 (bug 1486004)
Backed out changeset 4fc98067edc5 (bug 1486004)
Backed out changeset 8ab3f1597fde (bug 1486004)
Backed out changeset b487e98320fb (bug 1486004)
Backed out changeset 4cba8e6bc515 (bug 1486004)
Backed out changeset d0db5eef2343 (bug 1486004)
Backed out changeset 50285a87de6b (bug 1486004)
Backed out changeset 9730c0303810 (bug 1486004)
Backed out changeset 140a9d2362f3 (bug 1486004)
Backed out changeset 9d1ce06f6039 (bug 1486004)
Backed out changeset 88a5a4ab39fa (bug 1486004)
Backed out changeset eb186c92232d (bug 1486004)
Backed out changeset 677f2129750e (bug 1486004)
Backed out changeset 81427a5f2103 (bug 1486004)
Backed out changeset 38d7def3d425 (bug 1486004)
Backed out changeset a9e73221c471 (bug 1486004)
Backed out changeset ebe8c2d5432e (bug 1486004)
2020-07-16 15:29:29 +03:00
Bob Clary
bcf4eeb0d5
Bug 1486004 - Part 6 - Update mach perftest to support unrooted android devices using mozdevice 4.0.0, ? r=tarek
...
Depends on D82748
Differential Revision: https://phabricator.services.mozilla.com/D82749
2020-07-15 20:58:20 +00:00
Myeongjun Go
32cbdb3b33
Bug 1649497 - [perfdocs] Port mozperftest into Performance Testing r=sparky,perftest-reviewers
...
Differential Revision: https://phabricator.services.mozilla.com/D82207
2020-07-15 17:13:30 +00:00
Csoregi Natalia
2d34e224ae
Backed out changeset 448679382b06 (bug 1649497) for linting failures on framework_gatherers.py. CLOSED TREE
2020-07-14 20:20:48 +03:00
Myeongjun Go
62777a18b5
Bug 1649497 - [perfdocs] Port mozperftest into Performance Testing r=sparky,perftest-reviewers
...
Differential Revision: https://phabricator.services.mozilla.com/D82207
2020-07-14 16:55:56 +00:00