Tarek Ziadé
03cbd4d536
Bug 1650363 - Performance testing of HTTP3 in Firefox using only xpcshell tests r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D84021
2020-08-02 17:28:57 +00:00
Gregory Mierzwinski
a4e1ebe204
Bug 1656540 - Allow specifying perfherder settings on a per-metric basis. r=tarek
...
This patch fixes an issue where the metric settings were not being used because they don't use the test name. It also handles some changes (from a bad copy-paste) that didn't make it into the last live-site patch series.
Differential Revision: https://phabricator.services.mozilla.com/D85609
2020-08-01 16:13:28 +00:00
Yue Zhang
210c0b2307
Bug 1635930 - Activate a layer when its options are used. r=sparky,tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D83551
2020-07-31 17:23:51 +00:00
Gregory Mierzwinski
ee2aa57e5c
Bug 1655031 - Fix how mozperftest metrics are parsed. r=tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D85318
2020-07-31 15:33:12 +00:00
Gregory Mierzwinski
d93acb6b75
Bug 1655032 - Add splitting functionality to metrics module. r=tarek
...
This patch adds the `--<LAYER>-split-by` option to the metric layers. It allows users to split the data they obtain using a given data field name. For instance, if `browserScripts.pageinfo.url` is provided, then the data will be split based on the unique URLs that are found.
Differential Revision: https://phabricator.services.mozilla.com/D84822
2020-07-30 23:12:28 +00:00
Tarek Ziadé
cb00bce720
Bug 1655956 - removed unused perf tuning code r=sparky
...
Removes unused API and add missing coverage
Differential Revision: https://phabricator.services.mozilla.com/D85285
2020-07-29 17:35:35 +00:00
Andrew Halberstadt
cc0b1f8e5f
Bug 985141 - [mozperftest] Fix missed instances of _activate_virtualenv in mozperftest framework, r=perftest-reviewers,sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D85203
2020-07-28 20:54:58 +00:00
Andrew Halberstadt
d0fbcca0b6
Bug 985141 - [mozbuild] Remove leading underscore from MozbuildObject._activate_virtualenv, r=firefox-build-system-reviewers,perftest-reviewers,andi,AlexandruIonescu,rstewart
...
This function is used all across the tree and should be considered a public API.
Differential Revision: https://phabricator.services.mozilla.com/D85045
2020-07-28 16:06:10 +00:00
Andrew Creskey
c6c9bc4f6f
Bug 1648857 - Add applink perftest for the reference browser r=tarek,sparky
...
The Reference Browser represents our tech stack up to and including the Android-Components layer.
It would be useful to have an applink startup test for this browser to detect improvements and regressions.
Differential Revision: https://phabricator.services.mozilla.com/D81407
2020-07-23 14:11:38 +00:00
Yue Zhang
04a60db9fe
Bug 1635930 - Fix notebookupload.py layer. r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D83726
2020-07-21 18:45:40 +00:00
Gregory Mierzwinski
14830697f7
Bug 1652979 - Use org.mozilla.fenix package name in mozperftest. r=tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D84375
2020-07-21 17:07:00 +00:00
Tarek Ziadé
cb88926dd6
Bug 1651624 - Add a macOS layer r=sparky
...
Adds a macOS layer that provides the ability to
mount DMGs on the fly. For instance Firefox's distribution.
Differential Revision: https://phabricator.services.mozilla.com/D84162
2020-07-21 12:51:58 +00:00
Bob Clary
6b2b24ee30
Bug 1486004 - Part 6 - Update mach perftest to support unrooted android devices using mozdevice 4.0.0, ? r=tarek
...
Depends on D82748
Differential Revision: https://phabricator.services.mozilla.com/D82749
2020-07-17 20:48:35 +00:00
Johan Lorenzo
b651a3366d
Bug 1631839 - Update mobile routes to use new namespace r=tarek,sparky,acreskey
...
Differential Revision: https://phabricator.services.mozilla.com/D81038
2020-07-17 16:00:57 +00:00
Tarek Ziadé
df3af8361c
Bug 1651300 - support for xpcshell tests r=sparky
...
Implements xpcshell support, through the new flavor
Differential Revision: https://phabricator.services.mozilla.com/D82727
2020-07-17 22:12:26 +00:00
Tarek Ziadé
883db95e9d
Bug 1628278 - added conditioned profile support r=acreskey
...
Adds conditioned profiles and make the Profile
layer a system layer instead of a test layer
Differential Revision: https://phabricator.services.mozilla.com/D83612
2020-07-16 13:30:11 +00:00
Narcis Beleuzu
b1faa2872a
Backed out 17 changesets (bug 1486004) for wrench bustage on android.py . CLOSED TREE
...
Backed out changeset cae730f105d7 (bug 1486004)
Backed out changeset e0094d50a315 (bug 1486004)
Backed out changeset 424425ed98c6 (bug 1486004)
Backed out changeset 551232749abe (bug 1486004)
Backed out changeset 505747095def (bug 1486004)
Backed out changeset 5b1c62c4a4d5 (bug 1486004)
Backed out changeset 0a1c8d50ee69 (bug 1486004)
Backed out changeset 6ef81c676859 (bug 1486004)
Backed out changeset 234e55153fb6 (bug 1486004)
Backed out changeset 2f33b309d746 (bug 1486004)
Backed out changeset 48947692c176 (bug 1486004)
Backed out changeset 473bac8eedd9 (bug 1486004)
Backed out changeset af6afed0a04a (bug 1486004)
Backed out changeset a0e2f91eb4d4 (bug 1486004)
Backed out changeset 138c987440c7 (bug 1486004)
Backed out changeset 6d2e305f4722 (bug 1486004)
Backed out changeset 1181ff03bb05 (bug 1486004)
2020-07-17 23:43:57 +03:00
Bob Clary
d667fb0fa1
Bug 1486004 - Part 6 - Update mach perftest to support unrooted android devices using mozdevice 4.0.0, ? r=tarek
...
Depends on D82748
Differential Revision: https://phabricator.services.mozilla.com/D82749
2020-07-16 21:32:53 +00:00
Narcis Beleuzu
1eb115035d
Backed out 20 changesets (bug 1486004, bug 1653094) for wrench bustages. CLOSED TREE
...
Backed out changeset 120c64ebdea3 (bug 1486004)
Backed out changeset b10f105b1c36 (bug 1486004)
Backed out changeset 7f186e6bcccc (bug 1486004)
Backed out changeset cdda7b349cd8 (bug 1486004)
Backed out changeset 650c47e81402 (bug 1486004)
Backed out changeset 2bcca7cf3f1b (bug 1486004)
Backed out changeset e1df276f8a8d (bug 1486004)
Backed out changeset f6f5e7f2bd0a (bug 1486004)
Backed out changeset 1c56cb03ce53 (bug 1486004)
Backed out changeset 582cd190f174 (bug 1486004)
Backed out changeset 7c162e1b3a79 (bug 1486004)
Backed out changeset d1088e178216 (bug 1486004)
Backed out changeset 40763f4afd26 (bug 1486004)
Backed out changeset f20eb5b5a670 (bug 1486004)
Backed out changeset 6349ee0bd63f (bug 1486004)
Backed out changeset 7c23729053f6 (bug 1486004)
Backed out changeset 49586014bd29 (bug 1486004)
Backed out changeset 07971e82ae85 (bug 1653094)
Backed out changeset 47e7295e9c19 (bug 1653094)
Backed out changeset 57a25bbeec37 (bug 1653094)
2020-07-16 17:58:09 +03:00
Bob Clary
8f3e6b9e4c
Bug 1486004 - Part 6 - Update mach perftest to support unrooted android devices using mozdevice 4.0.0, ? r=tarek
...
Depends on D82748
Differential Revision: https://phabricator.services.mozilla.com/D82749
2020-07-15 20:58:20 +00:00
Mihai Alexandru Michis
a1d49fb98d
Backed out 17 changesets (bug 1486004) for causing bustages in AccessCheck.h
...
CLOSED TREE
Backed out changeset 86a0855e1e45 (bug 1486004)
Backed out changeset 4fc98067edc5 (bug 1486004)
Backed out changeset 8ab3f1597fde (bug 1486004)
Backed out changeset b487e98320fb (bug 1486004)
Backed out changeset 4cba8e6bc515 (bug 1486004)
Backed out changeset d0db5eef2343 (bug 1486004)
Backed out changeset 50285a87de6b (bug 1486004)
Backed out changeset 9730c0303810 (bug 1486004)
Backed out changeset 140a9d2362f3 (bug 1486004)
Backed out changeset 9d1ce06f6039 (bug 1486004)
Backed out changeset 88a5a4ab39fa (bug 1486004)
Backed out changeset eb186c92232d (bug 1486004)
Backed out changeset 677f2129750e (bug 1486004)
Backed out changeset 81427a5f2103 (bug 1486004)
Backed out changeset 38d7def3d425 (bug 1486004)
Backed out changeset a9e73221c471 (bug 1486004)
Backed out changeset ebe8c2d5432e (bug 1486004)
2020-07-16 15:29:29 +03:00
Bob Clary
bcf4eeb0d5
Bug 1486004 - Part 6 - Update mach perftest to support unrooted android devices using mozdevice 4.0.0, ? r=tarek
...
Depends on D82748
Differential Revision: https://phabricator.services.mozilla.com/D82749
2020-07-15 20:58:20 +00:00
Myeongjun Go
32cbdb3b33
Bug 1649497 - [perfdocs] Port mozperftest into Performance Testing r=sparky,perftest-reviewers
...
Differential Revision: https://phabricator.services.mozilla.com/D82207
2020-07-15 17:13:30 +00:00
Csoregi Natalia
2d34e224ae
Backed out changeset 448679382b06 (bug 1649497) for linting failures on framework_gatherers.py. CLOSED TREE
2020-07-14 20:20:48 +03:00
Myeongjun Go
62777a18b5
Bug 1649497 - [perfdocs] Port mozperftest into Performance Testing r=sparky,perftest-reviewers
...
Differential Revision: https://phabricator.services.mozilla.com/D82207
2020-07-14 16:55:56 +00:00
Tarek Ziadé
7dfca9db55
Bug 1644778 - add a mozperftest to measure browser.xhtml DOM size, r=tarek,dhouse,sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D79152
2020-07-13 15:44:38 +00:00
Bob Clary
13b8cbabeb
Bug 1652339 - set mozdevice version requirements to exclude version 4.0.0 on trunk, beta r=marionette-reviewers,perftest-reviewers,whimboo,sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D83278
2020-07-13 11:36:39 +00:00
Jim Porter
5c759e3542
Bug 1631806 - [mozproxy] Add a command line interface r=tarek,Bebe
...
Differential Revision: https://phabricator.services.mozilla.com/D76017
2020-07-08 13:41:24 +00:00
Tarek Ziadé
44eb9c7f7e
Bug 1651048 - remove unused transformer r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D82521
2020-07-07 12:48:47 +00:00
Tarek Ziadé
93ae761b53
Bug 1651044 - Fixed a test in mozperftest r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D82515
2020-07-07 12:34:32 +00:00
Tarek Ziadé
ee86c32c2e
Bug 1648360 - complex metrics in --perfherder-metrics r=sparky
...
This patch adds the ability to define complex metrics
Differential Revision: https://phabricator.services.mozilla.com/D82161
2020-07-06 14:28:37 +00:00
xuanqi xu
a4676c048b
Bug 1640875 - Add compare function to notebook layer. r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D80384
2020-07-06 15:05:06 +00:00
Coroiu Cristina
50d2261646
Backed out changeset 65acd64b9e0e (bug 1640875) for mpu failures
2020-07-03 15:59:28 +03:00
xuanqi xu
aff7d7822c
Bug 1640875 - Add compare function to notebook layer. r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D80384
2020-07-02 16:14:23 +00:00
Yue Zhang
765e406782
Bug 1643469 - Swap NotebookLogger for MachLogger. r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D81156
2020-06-30 13:14:38 +00:00
Tarek Ziadé
9294a5bfc1
Bug 1649176 - add batch attribute to add --test-date r=sparky
...
Right now setup_perftest_test_date adds --test-date yesterday to all perftest
runs. we want that only for the ones doing batches
Differential Revision: https://phabricator.services.mozilla.com/D81562
2020-06-29 20:12:42 +00:00
Gregory Mierzwinski
91291fe122
Bug 1646697 - Modify how the multi-commit tasks work. r=mozperftest-reviewers,tarek
...
This patch adds a `--test-date` option to mozperftest that lets us specify the date that we are testing on. This lets us trigger multi-commit tests on past dates, and also ensures that retriggers of the multi-commit tests use the same day that they were pushed on (giving us reproducibility).
Differential Revision: https://phabricator.services.mozilla.com/D80173
2020-06-18 22:37:35 +00:00
Gregory Mierzwinski
b1676248ea
Bug 1646368 - Add performance tuning feature to android layer. r=mozperftest-reviewers,tarek
...
This patch ports the performance tuning functionality from Raptor to mozperftest and adds a small test for it.
Differential Revision: https://phabricator.services.mozilla.com/D80168
2020-06-18 22:37:27 +00:00
Sylvestre Ledru
4b7c742212
Bug 1646405 - update the code using pyyaml to use the new path r=ahal
...
Differential Revision: https://phabricator.services.mozilla.com/D80025
2020-06-18 19:40:28 +00:00
Yue Zhang
f9a1c0c02d
Bug 1640951 - Implement a jsonschema for results coming from transformer merge functions. r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D78622
2020-06-18 16:48:05 +00:00
Jim Porter
c9a16c40ed
Bug 1631806 - [part 1] Update perftests to use new API and fix `--proxy` option; r=tarek
...
This patch fixes the tests in testing/performance/ that hadn't been updated to
the new API, as well as fixing a couple issues with the `--proxy` option:
* `policy.json` wasn't being logged correctly, since mozlog was treating the
data as a format string
* Proxy prefs weren't being set correctly for the profile
Differential Revision: https://phabricator.services.mozilla.com/D79937
2020-06-18 03:59:54 +00:00
Mihai Alexandru Michis
6387c1ed23
Backed out changeset fa227b47dac7 (bug 1631806) for causing awsy failures regarding mitmproxy.
...
CLOSED TREE
2020-06-18 00:27:47 +03:00
Jim Porter
da72965e62
Bug 1631806 - [part 1] Update perftests to use new API and fix `--proxy` option; r=tarek
...
This patch fixes the tests in testing/performance/ that hadn't been updated to
the new API, as well as fixing a couple issues with the `--proxy` option:
* `policy.json` wasn't being logged correctly, since mozlog was treating the
data as a format string
* Proxy prefs weren't being set correctly for the profile
Differential Revision: https://phabricator.services.mozilla.com/D79937
2020-06-17 09:41:24 +00:00
Tarek Ziadé
6ccb7d2797
Bug 1644912 - remove python.ini r=sparky
...
We're using a custom test runner.
Differential Revision: https://phabricator.services.mozilla.com/D79247
2020-06-11 12:19:59 +00:00
Gregory Mierzwinski
83d3f92844
Bug 1644993 - Add a non-standard prefix field to mozperftest data. r=mozperftest-reviewers,tarek
...
This patch adds a prefix field to the mozperftest perfherder data. This is a non-standard data field so the performance-artifact-schema.json file isn't modified to include it.
Differential Revision: https://phabricator.services.mozilla.com/D79296
2020-06-11 14:38:53 +00:00
Gregory Mierzwinski
9a6913c3d3
Bug 1644706 - Make a multi-commit test for app-link in CI. r=mozperftest-reviewers,tarek
...
This patch adds a new method to test multiple Fenix builds within one test run.
Depends on D78926
Differential Revision: https://phabricator.services.mozilla.com/D79107
2020-06-10 22:10:35 +00:00
Tarek Ziadé
afbe6e3cff
Bug 1644437 - add --test-iterations r=sparky
...
Adds a new option to allow running the whole test several times,
and a `before_iterations` hook
Differential Revision: https://phabricator.services.mozilla.com/D78926
2020-06-10 22:11:05 +00:00
Tarek Ziadé
a677101fc4
Bug 1644368 - improved scriptinfo r=sparky
...
Move scriptinfo to where it belongs and clean it
Differential Revision: https://phabricator.services.mozilla.com/D78870
2020-06-10 22:44:19 +00:00
Bogdan Tara
633c636ab1
Backed out 3 changesets (bug 1644706, bug 1644437, bug 1644368) for python related bustage CLOSED TREE
...
Backed out changeset 2a6645398c5a (bug 1644706)
Backed out changeset e695f5748e04 (bug 1644437)
Backed out changeset d615591507b9 (bug 1644368)
2020-06-11 01:04:33 +03:00
Gregory Mierzwinski
8d81e0549f
Bug 1644706 - Make a multi-commit test for app-link in CI. r=mozperftest-reviewers,tarek
...
This patch adds a new method to test multiple Fenix builds within one test run.
Depends on D78926
Differential Revision: https://phabricator.services.mozilla.com/D79107
2020-06-10 21:18:57 +00:00