Граф коммитов

120 Коммитов

Автор SHA1 Сообщение Дата
Tarek Ziadé 03cbd4d536 Bug 1650363 - Performance testing of HTTP3 in Firefox using only xpcshell tests r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D84021
2020-08-02 17:28:57 +00:00
Gregory Mierzwinski a4e1ebe204 Bug 1656540 - Allow specifying perfherder settings on a per-metric basis. r=tarek
This patch fixes an issue where the metric settings were not being used because they don't use the test name. It also handles some changes (from a bad copy-paste) that didn't make it into the last live-site patch series.

Differential Revision: https://phabricator.services.mozilla.com/D85609
2020-08-01 16:13:28 +00:00
Yue Zhang 210c0b2307 Bug 1635930 - Activate a layer when its options are used. r=sparky,tarek
Differential Revision: https://phabricator.services.mozilla.com/D83551
2020-07-31 17:23:51 +00:00
Gregory Mierzwinski ee2aa57e5c Bug 1655031 - Fix how mozperftest metrics are parsed. r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D85318
2020-07-31 15:33:12 +00:00
Gregory Mierzwinski d93acb6b75 Bug 1655032 - Add splitting functionality to metrics module. r=tarek
This patch adds the `--<LAYER>-split-by` option to the metric layers. It allows users to split the data they obtain using a given data field name. For instance, if `browserScripts.pageinfo.url` is provided, then the data will be split based on the unique URLs that are found.

Differential Revision: https://phabricator.services.mozilla.com/D84822
2020-07-30 23:12:28 +00:00
Tarek Ziadé cb00bce720 Bug 1655956 - removed unused perf tuning code r=sparky
Removes unused API and add missing coverage

Differential Revision: https://phabricator.services.mozilla.com/D85285
2020-07-29 17:35:35 +00:00
Andrew Halberstadt cc0b1f8e5f Bug 985141 - [mozperftest] Fix missed instances of _activate_virtualenv in mozperftest framework, r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D85203
2020-07-28 20:54:58 +00:00
Andrew Halberstadt d0fbcca0b6 Bug 985141 - [mozbuild] Remove leading underscore from MozbuildObject._activate_virtualenv, r=firefox-build-system-reviewers,perftest-reviewers,andi,AlexandruIonescu,rstewart
This function is used all across the tree and should be considered a public API.

Differential Revision: https://phabricator.services.mozilla.com/D85045
2020-07-28 16:06:10 +00:00
Andrew Creskey c6c9bc4f6f Bug 1648857 - Add applink perftest for the reference browser r=tarek,sparky
The Reference Browser represents our tech stack up to and including the Android-Components layer.
It would be useful to have an applink startup test for this browser to detect improvements and regressions.

Differential Revision: https://phabricator.services.mozilla.com/D81407
2020-07-23 14:11:38 +00:00
Yue Zhang 04a60db9fe Bug 1635930 - Fix notebookupload.py layer. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D83726
2020-07-21 18:45:40 +00:00
Gregory Mierzwinski 14830697f7 Bug 1652979 - Use org.mozilla.fenix package name in mozperftest. r=tarek
Differential Revision: https://phabricator.services.mozilla.com/D84375
2020-07-21 17:07:00 +00:00
Tarek Ziadé cb88926dd6 Bug 1651624 - Add a macOS layer r=sparky
Adds a macOS layer that provides the ability to
mount DMGs on the fly. For instance Firefox's distribution.

Differential Revision: https://phabricator.services.mozilla.com/D84162
2020-07-21 12:51:58 +00:00
Bob Clary 6b2b24ee30 Bug 1486004 - Part 6 - Update mach perftest to support unrooted android devices using mozdevice 4.0.0, ? r=tarek
Depends on D82748

Differential Revision: https://phabricator.services.mozilla.com/D82749
2020-07-17 20:48:35 +00:00
Johan Lorenzo b651a3366d Bug 1631839 - Update mobile routes to use new namespace r=tarek,sparky,acreskey
Differential Revision: https://phabricator.services.mozilla.com/D81038
2020-07-17 16:00:57 +00:00
Tarek Ziadé df3af8361c Bug 1651300 - support for xpcshell tests r=sparky
Implements xpcshell support, through the new flavor

Differential Revision: https://phabricator.services.mozilla.com/D82727
2020-07-17 22:12:26 +00:00
Tarek Ziadé 883db95e9d Bug 1628278 - added conditioned profile support r=acreskey
Adds conditioned profiles and make the Profile
layer a system layer instead of a test layer

Differential Revision: https://phabricator.services.mozilla.com/D83612
2020-07-16 13:30:11 +00:00
Narcis Beleuzu b1faa2872a Backed out 17 changesets (bug 1486004) for wrench bustage on android.py . CLOSED TREE
Backed out changeset cae730f105d7 (bug 1486004)
Backed out changeset e0094d50a315 (bug 1486004)
Backed out changeset 424425ed98c6 (bug 1486004)
Backed out changeset 551232749abe (bug 1486004)
Backed out changeset 505747095def (bug 1486004)
Backed out changeset 5b1c62c4a4d5 (bug 1486004)
Backed out changeset 0a1c8d50ee69 (bug 1486004)
Backed out changeset 6ef81c676859 (bug 1486004)
Backed out changeset 234e55153fb6 (bug 1486004)
Backed out changeset 2f33b309d746 (bug 1486004)
Backed out changeset 48947692c176 (bug 1486004)
Backed out changeset 473bac8eedd9 (bug 1486004)
Backed out changeset af6afed0a04a (bug 1486004)
Backed out changeset a0e2f91eb4d4 (bug 1486004)
Backed out changeset 138c987440c7 (bug 1486004)
Backed out changeset 6d2e305f4722 (bug 1486004)
Backed out changeset 1181ff03bb05 (bug 1486004)
2020-07-17 23:43:57 +03:00
Bob Clary d667fb0fa1 Bug 1486004 - Part 6 - Update mach perftest to support unrooted android devices using mozdevice 4.0.0, ? r=tarek
Depends on D82748

Differential Revision: https://phabricator.services.mozilla.com/D82749
2020-07-16 21:32:53 +00:00
Narcis Beleuzu 1eb115035d Backed out 20 changesets (bug 1486004, bug 1653094) for wrench bustages. CLOSED TREE
Backed out changeset 120c64ebdea3 (bug 1486004)
Backed out changeset b10f105b1c36 (bug 1486004)
Backed out changeset 7f186e6bcccc (bug 1486004)
Backed out changeset cdda7b349cd8 (bug 1486004)
Backed out changeset 650c47e81402 (bug 1486004)
Backed out changeset 2bcca7cf3f1b (bug 1486004)
Backed out changeset e1df276f8a8d (bug 1486004)
Backed out changeset f6f5e7f2bd0a (bug 1486004)
Backed out changeset 1c56cb03ce53 (bug 1486004)
Backed out changeset 582cd190f174 (bug 1486004)
Backed out changeset 7c162e1b3a79 (bug 1486004)
Backed out changeset d1088e178216 (bug 1486004)
Backed out changeset 40763f4afd26 (bug 1486004)
Backed out changeset f20eb5b5a670 (bug 1486004)
Backed out changeset 6349ee0bd63f (bug 1486004)
Backed out changeset 7c23729053f6 (bug 1486004)
Backed out changeset 49586014bd29 (bug 1486004)
Backed out changeset 07971e82ae85 (bug 1653094)
Backed out changeset 47e7295e9c19 (bug 1653094)
Backed out changeset 57a25bbeec37 (bug 1653094)
2020-07-16 17:58:09 +03:00
Bob Clary 8f3e6b9e4c Bug 1486004 - Part 6 - Update mach perftest to support unrooted android devices using mozdevice 4.0.0, ? r=tarek
Depends on D82748

Differential Revision: https://phabricator.services.mozilla.com/D82749
2020-07-15 20:58:20 +00:00
Mihai Alexandru Michis a1d49fb98d Backed out 17 changesets (bug 1486004) for causing bustages in AccessCheck.h
CLOSED TREE

Backed out changeset 86a0855e1e45 (bug 1486004)
Backed out changeset 4fc98067edc5 (bug 1486004)
Backed out changeset 8ab3f1597fde (bug 1486004)
Backed out changeset b487e98320fb (bug 1486004)
Backed out changeset 4cba8e6bc515 (bug 1486004)
Backed out changeset d0db5eef2343 (bug 1486004)
Backed out changeset 50285a87de6b (bug 1486004)
Backed out changeset 9730c0303810 (bug 1486004)
Backed out changeset 140a9d2362f3 (bug 1486004)
Backed out changeset 9d1ce06f6039 (bug 1486004)
Backed out changeset 88a5a4ab39fa (bug 1486004)
Backed out changeset eb186c92232d (bug 1486004)
Backed out changeset 677f2129750e (bug 1486004)
Backed out changeset 81427a5f2103 (bug 1486004)
Backed out changeset 38d7def3d425 (bug 1486004)
Backed out changeset a9e73221c471 (bug 1486004)
Backed out changeset ebe8c2d5432e (bug 1486004)
2020-07-16 15:29:29 +03:00
Bob Clary bcf4eeb0d5 Bug 1486004 - Part 6 - Update mach perftest to support unrooted android devices using mozdevice 4.0.0, ? r=tarek
Depends on D82748

Differential Revision: https://phabricator.services.mozilla.com/D82749
2020-07-15 20:58:20 +00:00
Myeongjun Go 32cbdb3b33 Bug 1649497 - [perfdocs] Port mozperftest into Performance Testing r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D82207
2020-07-15 17:13:30 +00:00
Csoregi Natalia 2d34e224ae Backed out changeset 448679382b06 (bug 1649497) for linting failures on framework_gatherers.py. CLOSED TREE 2020-07-14 20:20:48 +03:00
Myeongjun Go 62777a18b5 Bug 1649497 - [perfdocs] Port mozperftest into Performance Testing r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D82207
2020-07-14 16:55:56 +00:00
Tarek Ziadé 7dfca9db55 Bug 1644778 - add a mozperftest to measure browser.xhtml DOM size, r=tarek,dhouse,sparky
Differential Revision: https://phabricator.services.mozilla.com/D79152
2020-07-13 15:44:38 +00:00
Bob Clary 13b8cbabeb Bug 1652339 - set mozdevice version requirements to exclude version 4.0.0 on trunk, beta r=marionette-reviewers,perftest-reviewers,whimboo,sparky
Differential Revision: https://phabricator.services.mozilla.com/D83278
2020-07-13 11:36:39 +00:00
Jim Porter 5c759e3542 Bug 1631806 - [mozproxy] Add a command line interface r=tarek,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D76017
2020-07-08 13:41:24 +00:00
Tarek Ziadé 44eb9c7f7e Bug 1651048 - remove unused transformer r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D82521
2020-07-07 12:48:47 +00:00
Tarek Ziadé 93ae761b53 Bug 1651044 - Fixed a test in mozperftest r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D82515
2020-07-07 12:34:32 +00:00
Tarek Ziadé ee86c32c2e Bug 1648360 - complex metrics in --perfherder-metrics r=sparky
This patch adds the ability to define complex metrics

Differential Revision: https://phabricator.services.mozilla.com/D82161
2020-07-06 14:28:37 +00:00
xuanqi xu a4676c048b Bug 1640875 - Add compare function to notebook layer. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D80384
2020-07-06 15:05:06 +00:00
Coroiu Cristina 50d2261646 Backed out changeset 65acd64b9e0e (bug 1640875) for mpu failures 2020-07-03 15:59:28 +03:00
xuanqi xu aff7d7822c Bug 1640875 - Add compare function to notebook layer. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D80384
2020-07-02 16:14:23 +00:00
Yue Zhang 765e406782 Bug 1643469 - Swap NotebookLogger for MachLogger. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D81156
2020-06-30 13:14:38 +00:00
Tarek Ziadé 9294a5bfc1 Bug 1649176 - add batch attribute to add --test-date r=sparky
Right now setup_perftest_test_date adds --test-date yesterday to all perftest
runs. we want that only for the ones doing batches

Differential Revision: https://phabricator.services.mozilla.com/D81562
2020-06-29 20:12:42 +00:00
Gregory Mierzwinski 91291fe122 Bug 1646697 - Modify how the multi-commit tasks work. r=mozperftest-reviewers,tarek
This patch adds a `--test-date` option to mozperftest that lets us specify the date that we are testing on. This lets us trigger multi-commit tests on past dates, and also ensures that retriggers of the multi-commit tests use the same day that they were pushed on (giving us reproducibility).

Differential Revision: https://phabricator.services.mozilla.com/D80173
2020-06-18 22:37:35 +00:00
Gregory Mierzwinski b1676248ea Bug 1646368 - Add performance tuning feature to android layer. r=mozperftest-reviewers,tarek
This patch ports the performance tuning functionality from Raptor to mozperftest and adds a small test for it.

Differential Revision: https://phabricator.services.mozilla.com/D80168
2020-06-18 22:37:27 +00:00
Sylvestre Ledru 4b7c742212 Bug 1646405 - update the code using pyyaml to use the new path r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D80025
2020-06-18 19:40:28 +00:00
Yue Zhang f9a1c0c02d Bug 1640951 - Implement a jsonschema for results coming from transformer merge functions. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D78622
2020-06-18 16:48:05 +00:00
Jim Porter c9a16c40ed Bug 1631806 - [part 1] Update perftests to use new API and fix `--proxy` option; r=tarek
This patch fixes the tests in testing/performance/ that hadn't been updated to
the new API, as well as fixing a couple issues with the `--proxy` option:

 * `policy.json` wasn't being logged correctly, since mozlog was treating the
   data as a format string

 * Proxy prefs weren't being set correctly for the profile

Differential Revision: https://phabricator.services.mozilla.com/D79937
2020-06-18 03:59:54 +00:00
Mihai Alexandru Michis 6387c1ed23 Backed out changeset fa227b47dac7 (bug 1631806) for causing awsy failures regarding mitmproxy.
CLOSED TREE
2020-06-18 00:27:47 +03:00
Jim Porter da72965e62 Bug 1631806 - [part 1] Update perftests to use new API and fix `--proxy` option; r=tarek
This patch fixes the tests in testing/performance/ that hadn't been updated to
the new API, as well as fixing a couple issues with the `--proxy` option:

 * `policy.json` wasn't being logged correctly, since mozlog was treating the
   data as a format string

 * Proxy prefs weren't being set correctly for the profile

Differential Revision: https://phabricator.services.mozilla.com/D79937
2020-06-17 09:41:24 +00:00
Tarek Ziadé 6ccb7d2797 Bug 1644912 - remove python.ini r=sparky
We're using a custom test runner.

Differential Revision: https://phabricator.services.mozilla.com/D79247
2020-06-11 12:19:59 +00:00
Gregory Mierzwinski 83d3f92844 Bug 1644993 - Add a non-standard prefix field to mozperftest data. r=mozperftest-reviewers,tarek
This patch adds a prefix field to the mozperftest perfherder data. This is a non-standard data field so the performance-artifact-schema.json file isn't modified to include it.

Differential Revision: https://phabricator.services.mozilla.com/D79296
2020-06-11 14:38:53 +00:00
Gregory Mierzwinski 9a6913c3d3 Bug 1644706 - Make a multi-commit test for app-link in CI. r=mozperftest-reviewers,tarek
This patch adds a new method to test multiple Fenix builds within one test run.

Depends on D78926

Differential Revision: https://phabricator.services.mozilla.com/D79107
2020-06-10 22:10:35 +00:00
Tarek Ziadé afbe6e3cff Bug 1644437 - add --test-iterations r=sparky
Adds a new option to allow running the whole test several times,
and a `before_iterations` hook

Differential Revision: https://phabricator.services.mozilla.com/D78926
2020-06-10 22:11:05 +00:00
Tarek Ziadé a677101fc4 Bug 1644368 - improved scriptinfo r=sparky
Move scriptinfo to where it belongs and clean it

Differential Revision: https://phabricator.services.mozilla.com/D78870
2020-06-10 22:44:19 +00:00
Bogdan Tara 633c636ab1 Backed out 3 changesets (bug 1644706, bug 1644437, bug 1644368) for python related bustage CLOSED TREE
Backed out changeset 2a6645398c5a (bug 1644706)
Backed out changeset e695f5748e04 (bug 1644437)
Backed out changeset d615591507b9 (bug 1644368)
2020-06-11 01:04:33 +03:00
Gregory Mierzwinski 8d81e0549f Bug 1644706 - Make a multi-commit test for app-link in CI. r=mozperftest-reviewers,tarek
This patch adds a new method to test multiple Fenix builds within one test run.

Depends on D78926

Differential Revision: https://phabricator.services.mozilla.com/D79107
2020-06-10 21:18:57 +00:00