31380bc0c1
Bug 1681669 - Add vision document for mozperftest. r=davehunt
...
Differential Revision: https://phabricator.services.mozilla.com/D99318
2021-02-16 18:37:23 +00:00
2502c7c5dd
Bug 1688995 - Fall back to default PATH if fzf doesn't exist in mozbuild r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D103115
2021-02-16 18:11:38 +00:00
b20d3edb85
Bug 1682989 - remove CertBlocklist implementation and MOZ_NEW_CERT_STORAGE build variable r=rmf
...
Differential Revision: https://phabricator.services.mozilla.com/D100034
2021-01-19 22:11:25 +00:00
50dfc2cb3a
Bug 1672142 - Update mozperftest perfdocs to include new test. r=tarek,perftest-reviewers
...
Differential Revision: https://phabricator.services.mozilla.com/D98773
2020-12-04 15:47:22 +00:00
0269049986
Bug 1672142 - Add perf test for the controlled website r=sparky,dragana
...
Differential Revision: https://phabricator.services.mozilla.com/D94089
2020-12-04 14:56:43 +00:00
888400592c
Bug 1675863 - mozperftest uses a fixed build of geckoview_example from 05/21/2020 r=sparky
...
Updated the url used by perftest from 'nightly' to 'shippable'
Differential Revision: https://phabricator.services.mozilla.com/D96463
2020-11-10 14:07:43 +00:00
7c132a5e1b
Bug 1668494 - add an influxdb layer r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D92480
2020-11-10 08:36:44 +00:00
83a9dd6f9f
Bug 1667151 - add support for pre-compiled scipy/numpy r=sparky
...
This patch will make sure that we select the right
wheels for numpy and scipy when `--visualmetrics` is used,
so we don't need to compile them.
It also make sure we don't install all those packages
unless the environment wants to use visual metrics.
Differential Revision: https://phabricator.services.mozilla.com/D91740
2020-11-05 17:16:34 +00:00
6bc860d7cd
Bug 1671330 - create a telemetry layer r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D94809
2020-11-03 14:32:33 +00:00
9ed7a7b8be
Bug 1674243 - Check for colon when deciding between old/new metric format. r=tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D95218
2020-10-29 23:39:08 +00:00
27e4a2b691
Bug 1672207 - [perfdocs] Remove legacy code on build_test_description r=sparky,perftest-reviewers
...
Differential Revision: https://phabricator.services.mozilla.com/D94127
2020-10-23 13:04:19 +00:00
10359c348a
Bug 1663708 - [perfdocs] Find tests to add to documentation using manifests instead of path searching r=sparky,perftest-reviewers
...
Differential Revision: https://phabricator.services.mozilla.com/D91703
2020-10-19 15:17:04 +00:00
f3c2b155b5
Bug 1670631 - browsertime keeps on reinstalling itself r=sparky
...
Let's use `_from` instead of `_resolved`
Differential Revision: https://phabricator.services.mozilla.com/D93629
2020-10-15 14:07:09 +00:00
616eb184b2
Bug 1670216 - Speed up tests. r=sparky
...
Shaved off 15 seconds (and fixed small code issues in the proxy layer)
Differential Revision: https://phabricator.services.mozilla.com/D93080
2020-10-14 19:31:51 +00:00
c6a83dc1a4
Bug 1666264 - [Mozproxy] Implement a recording .zip file manager r=tarek,perftest-reviewers,AlexandruIonescu
...
Differential Revision: https://phabricator.services.mozilla.com/D90954
2020-10-09 12:32:26 +00:00
cad53f4804
Bug 1588458 - Replace dxr links by searchfox in the code/test r=kats,sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D92792
2020-10-08 14:02:40 +00:00
96be950645
Bug 1667180 - Reinstall existing browsertime package if its outdated. r=tarek
...
This patch changes how/when we decide to (re-)install browsertime. We do this by checking the package.json entries to see if they match or not.
Differential Revision: https://phabricator.services.mozilla.com/D91329
2020-10-01 07:14:37 +00:00
05a0d1e9b3
Bug 1665972 - Parse metrics correctly from test scripts. r=tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D90727
2020-09-23 15:00:19 +00:00
7e373ac7fd
Bug 1666699 - Keep the hooks module state r=sparky
...
Some hooks modules use global variables to share state between hooks calls.
This patch makes sure we reuse the same module instance once it's loaded by a
Hook class.
Differential Revision: https://phabricator.services.mozilla.com/D91096
2020-09-23 17:10:19 +00:00
c7cf4bad66
Bug 1665556 - make the try-platform option handle multiple platforms r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D90550
2020-09-22 15:59:15 +00:00
d0ec0cd96a
Bug 1659072 - Add commit timestamps to Fenix batch-mode tests. r=tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D89642
2020-09-17 12:28:30 +00:00
5f7fe6ede4
Bug 1663937 - add options metadata r=sparky,perftest-reviewers
...
Differential Revision: https://phabricator.services.mozilla.com/D89922
2020-09-16 14:00:18 +00:00
3021e5b216
Bug 1662706 - add a fuzzy runner r=sparky,necko-reviewers,rstewart
...
Differential Revision: https://phabricator.services.mozilla.com/D89123
2020-09-11 08:13:27 +00:00
9c8bb6e963
Bug 1663417 - make scriptinfo compatible with xpcshell tests r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D89372
2020-09-10 23:15:09 +00:00
0bf97a3ebc
Bug 1661809 - use mach lint r=sparky
...
Removed our custom linter calls and use mach lint
Differential Revision: https://phabricator.services.mozilla.com/D89703
2020-09-10 23:15:07 +00:00
f837964009
Backed out 3 changesets (bug 1661809, bug 1662706, bug 1663417) for SM bustages. CLOSED TREE
...
Backed out changeset 96e69574f7ee (bug 1662706)
Backed out changeset a584b11a503a (bug 1663417)
Backed out changeset 655ce94f20f3 (bug 1661809)
2020-09-11 01:50:09 +03:00
282632b3a0
Bug 1662706 - add a fuzzy runner r=sparky,necko-reviewers,rstewart DONTBUILD
...
Differential Revision: https://phabricator.services.mozilla.com/D89123
2020-09-10 11:36:29 +00:00
2e207a9e80
Bug 1663417 - make scriptinfo compatible with xpcshell tests r=sparky DONTBUILD
...
Differential Revision: https://phabricator.services.mozilla.com/D89372
2020-09-10 11:18:26 +00:00
fa3f23fe40
Bug 1661809 - use mach lint r=sparky DONTBUILD
...
Removed our custom linter calls and use mach lint
Differential Revision: https://phabricator.services.mozilla.com/D89703
2020-09-10 14:00:15 +00:00
b53336d5a4
Bug 1653326 - [perfdocs] Add documentation about individual mozperftest tests to perfdocs r=sparky,perftest-reviewers
...
Differential Revision: https://phabricator.services.mozilla.com/D86488
2020-09-09 17:58:39 +00:00
da34b6a58e
Bug 1661514 - Reformat some python files with black 20.8b1 r=rstewart
...
# ignore-this-changeset
Depends on D88711
Differential Revision: https://phabricator.services.mozilla.com/D88712
2020-09-07 14:05:10 +00:00
72faa9da2c
Bug 1639693 - Allow mach perftest users to provide their own custom tranformer from the command line. r=sparky,tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D86417
2020-09-01 15:03:32 +00:00
8eaafae8fd
Backed out 2 changesets (bug 1661514) for lint failure on a CLOSED TREE
...
Backed out changeset 8e58c88f756b (bug 1661514)
Backed out changeset aef89f9a8031 (bug 1661514)
2020-09-01 19:34:12 +03:00
5ee2fbd7cb
Bug 1661514 - Reformat some python files with black 20.8b1 r=rstewart
...
# ignore-this-changeset
Depends on D88711
Differential Revision: https://phabricator.services.mozilla.com/D88712
2020-08-31 17:06:22 +00:00
756d14a209
Bug 1662278 - Simplify mozperftest metric names. r=tarek
...
This patch adds two new options to mozperftest. The --simplify-names argument can be provided to enable simplification of metric names and the --simplify-exclude option allows users to select which metrics to skip in the simplification. A bug relating to setting the default of a list option is also fixed here.
Differential Revision: https://phabricator.services.mozilla.com/D88917
2020-09-01 15:29:41 +00:00
b2e2d7432f
Bug 1662278 - Fix test_visualmetrics local linux failure. r=tarek
...
This fixes a local failure in mozperftest by mocking the find_node_executable function in the visual-metrics tests. It is not needed for those tests.
Depends on D88915
Differential Revision: https://phabricator.services.mozilla.com/D88916
2020-09-01 14:57:19 +00:00
ae98f6130b
Bug 1662278 - Pin black to version 19.10b0. r=tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D88915
2020-09-01 15:09:44 +00:00
7101f264ef
Bug 1650879 - Upgrade browsertime to v9.4.0. r=tarek,perftest-reviewers,Bebe
...
Differential Revision: https://phabricator.services.mozilla.com/D88324
2020-09-01 14:01:18 +00:00
bbb7d4b5d5
Bug 1659411 - add missing dep r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D88295
2020-08-26 15:47:02 +00:00
2909efb662
Bug 1650363 - Performance testing of HTTP3 in Firefox using only xpcshell tests r=michal,sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D84021
2020-08-10 06:26:39 +00:00
f87d8a4859
Bug 1657898 - Fix fenix artifact paths. r=jlorenzo,tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D86351
2020-08-08 12:16:49 +00:00
abb4969c3e
Bug 1656235 - support visual metrics r=acreskey,sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D85561
2020-08-08 12:17:48 +00:00
5a38472369
Bug 1651818 - fixed logger when runner is used directly r=acreskey
...
Differential Revision: https://phabricator.services.mozilla.com/D86305
2020-08-08 12:17:48 +00:00
8e234c7598
Bug 1537763 - [mozproxy] Add a record mode; r=tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D84399
2020-08-05 19:43:55 +00:00
abfa3262b8
Backed out changeset 1ccda1d0c3ea (bug 1650363) for causing a serious regression in packaging time
2020-08-05 04:23:20 +03:00
cb36d08ccc
Bug 1630611 - Remove the nested helper function in the flat() function. r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D85677
2020-08-04 17:15:40 +00:00
03cbd4d536
Bug 1650363 - Performance testing of HTTP3 in Firefox using only xpcshell tests r=sparky
...
Differential Revision: https://phabricator.services.mozilla.com/D84021
2020-08-02 17:28:57 +00:00
a4e1ebe204
Bug 1656540 - Allow specifying perfherder settings on a per-metric basis. r=tarek
...
This patch fixes an issue where the metric settings were not being used because they don't use the test name. It also handles some changes (from a bad copy-paste) that didn't make it into the last live-site patch series.
Differential Revision: https://phabricator.services.mozilla.com/D85609
2020-08-01 16:13:28 +00:00
210c0b2307
Bug 1635930 - Activate a layer when its options are used. r=sparky,tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D83551
2020-07-31 17:23:51 +00:00
ee2aa57e5c
Bug 1655031 - Fix how mozperftest metrics are parsed. r=tarek
...
Differential Revision: https://phabricator.services.mozilla.com/D85318
2020-07-31 15:33:12 +00:00
Tarek Ziadé
Sean Feng
Dana Keeler
Gregory Mierzwinski
Andrew Creskey
Myeongjun Go
Florin Strugariu
Sylvestre Ledru
Narcis Beleuzu
Yue Zhang
Cristina Coroiu
Jim Porter
Bogdan Tara