mozilla
/
gecko-dev
зеркало из https://github.com/mozilla/gecko-dev.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность

Bug 1720301 - replace bbc with dailymail r=perftest-reviewers,AlexandruIonescu 

Differential Revision: https://phabricator.services.mozilla.com/D119766
This commit is contained in:
Florin Strugariu 2021-07-19 11:29:16 +00:00
Родитель 0db87ebeb5
Коммит b97a13dd42
8 изменённых файлов: 135 добавлений и 138 удалений
Показать статистику Скачать Patch файл Скачать Diff файл Показать все файлы Свернуть все файлы

4
taskcluster/ci/test/browsertime-mobile.yml
Просмотреть файл

@ -82,12 +82,12 @@ browsertime-tp6m:
treeherder-symbol: Btime(tp6m)
raptor-subtests:
- amazon
- bbc
- bing
- [bing-search-restaurants, bing-s-r]
- booking
- cnn
- [cnn-ampstories, cnn-amp]
- dailymail
- [ebay-kleinanzeigen, ebay-k]
- [ebay-kleinanzeigen-search, ebay-k-s]
- [facebook-cristiano, fb-cris]
@ -198,13 +198,13 @@ browsertime-tp6m-live:
- allrecipes
- amazon
- [amazon-search, amazon-s]
- bbc
- bing
- [bing-search-restaurants, bing-s-r]
- booking
- booking-sf
- cnn
- [cnn-ampstories, cnn-amp]
- dailymail
- discord
- [ebay-kleinanzeigen, ebay-k]
- [ebay-kleinanzeigen-search, ebay-k-s]

228
testing/perfdocs/generated/raptor.rst
Просмотреть файл

@ -3581,120 +3581,6 @@ Page-load performance test suite on Android. The links direct to the actual webs
* browsertime-tp6m-live-geckoview-amazon-search-e10s: None
.. dropdown:: bbc (BT, GV, FE, RB, CH-M)
:container: + anchor-id-bbc-m
* **alert on**: fcp, loadtime
* **alert threshold**: 2.0
* **apps**: geckoview, fenix, refbrow, chrome-m
* **browser cycles**: 15
* **expected**: pass
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
* **playback**: mitmproxy-android
* **playback pageset manifest**: mitm4-pixel2-fennec-bbc.manifest
* **playback recordings**: mitm4-pixel2-fennec-bbc.mp
* **playback version**: 6.0.2
* **test url**: `<https://www.bbc.com/news/business-47245877>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
* test-android-hw-g5-7-0-arm7-qr/opt
* browsertime-tp6m-fenix-bbc-e10s: None
* browsertime-tp6m-geckoview-bbc-e10s: None
* browsertime-tp6m-live-fenix-bbc-e10s: None
* browsertime-tp6m-live-geckoview-bbc-e10s: None
* browsertime-tp6m-refbrow-bbc-e10s: None
* test-android-hw-g5-7-0-arm7-shippable-qr/opt
* browsertime-tp6m-fenix-bbc-e10s: None
* browsertime-tp6m-geckoview-bbc-e10s: mozilla-beta, trunk
* browsertime-tp6m-live-fenix-bbc-e10s: None
* browsertime-tp6m-live-geckoview-bbc-e10s: None
* browsertime-tp6m-refbrow-bbc-e10s: None
* test-android-hw-g5-7-0-arm7-shippable/opt
* browsertime-tp6m-chrome-m-bbc-e10s: None
* browsertime-tp6m-fenix-bbc-e10s: None
* browsertime-tp6m-geckoview-bbc-e10s: None
* browsertime-tp6m-live-chrome-m-bbc-e10s: None
* browsertime-tp6m-live-fenix-bbc-e10s: None
* browsertime-tp6m-live-geckoview-bbc-e10s: None
* browsertime-tp6m-refbrow-bbc-e10s: None
* test-android-hw-g5-7-0-arm7/opt
* browsertime-tp6m-fenix-bbc-e10s: None
* browsertime-tp6m-geckoview-bbc-e10s: None
* browsertime-tp6m-live-fenix-bbc-e10s: None
* browsertime-tp6m-live-geckoview-bbc-e10s: None
* browsertime-tp6m-refbrow-bbc-e10s: None
* test-android-hw-p2-8-0-android-aarch64-qr/opt
* browsertime-tp6m-fenix-bbc-e10s: None
* browsertime-tp6m-geckoview-bbc-e10s: None
* browsertime-tp6m-live-fenix-bbc-e10s: None
* browsertime-tp6m-live-geckoview-bbc-e10s: None
* browsertime-tp6m-refbrow-bbc-e10s: None
* test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt
* browsertime-tp6m-fenix-bbc-e10s: None
* browsertime-tp6m-geckoview-bbc-e10s: mozilla-beta, trunk
* browsertime-tp6m-live-fenix-bbc-e10s: None
* browsertime-tp6m-live-geckoview-bbc-e10s: None
* browsertime-tp6m-refbrow-bbc-e10s: None
* test-android-hw-p2-8-0-android-aarch64-shippable/opt
* browsertime-tp6m-chrome-m-bbc-e10s: None
* browsertime-tp6m-fenix-bbc-e10s: None
* browsertime-tp6m-geckoview-bbc-e10s: None
* browsertime-tp6m-live-chrome-m-bbc-e10s: None
* browsertime-tp6m-live-fenix-bbc-e10s: None
* browsertime-tp6m-live-geckoview-bbc-e10s: None
* browsertime-tp6m-refbrow-bbc-e10s: None
* test-android-hw-p2-8-0-android-aarch64/opt
* browsertime-tp6m-fenix-bbc-e10s: None
* browsertime-tp6m-geckoview-bbc-e10s: None
* browsertime-tp6m-live-fenix-bbc-e10s: None
* browsertime-tp6m-live-geckoview-bbc-e10s: None
* browsertime-tp6m-refbrow-bbc-e10s: None
* test-android-hw-p2-8-0-arm7-shippable/opt
* browsertime-tp6m-chrome-m-bbc-e10s: None
* browsertime-tp6m-fenix-bbc-e10s: None
* browsertime-tp6m-geckoview-bbc-e10s: None
* browsertime-tp6m-live-chrome-m-bbc-e10s: None
* browsertime-tp6m-live-fenix-bbc-e10s: None
* browsertime-tp6m-live-geckoview-bbc-e10s: None
* browsertime-tp6m-refbrow-bbc-e10s: None
* test-android-hw-p2-8-0-arm7/opt
* browsertime-tp6m-fenix-bbc-e10s: None
* browsertime-tp6m-geckoview-bbc-e10s: None
* browsertime-tp6m-live-fenix-bbc-e10s: None
* browsertime-tp6m-live-geckoview-bbc-e10s: None
* browsertime-tp6m-refbrow-bbc-e10s: None
* test-android-hw-s7-8-0-android-aarch64-qr/opt
* browsertime-tp6m-fenix-bbc-e10s: None
* browsertime-tp6m-geckoview-bbc-e10s: None
* browsertime-tp6m-live-fenix-bbc-e10s: None
* browsertime-tp6m-live-geckoview-bbc-e10s: None
* browsertime-tp6m-refbrow-bbc-e10s: None
* test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt
* browsertime-tp6m-fenix-bbc-e10s: None
* browsertime-tp6m-geckoview-bbc-e10s: None
* browsertime-tp6m-live-fenix-bbc-e10s: None
* browsertime-tp6m-live-geckoview-bbc-e10s: None
* browsertime-tp6m-refbrow-bbc-e10s: None
* test-android-hw-s7-8-0-android-aarch64-shippable/opt
* browsertime-tp6m-chrome-m-bbc-e10s: None
* browsertime-tp6m-fenix-bbc-e10s: None
* browsertime-tp6m-geckoview-bbc-e10s: None
* browsertime-tp6m-live-chrome-m-bbc-e10s: None
* browsertime-tp6m-live-fenix-bbc-e10s: None
* browsertime-tp6m-live-geckoview-bbc-e10s: None
* browsertime-tp6m-refbrow-bbc-e10s: None
* test-android-hw-s7-8-0-android-aarch64/opt
* browsertime-tp6m-fenix-bbc-e10s: None
* browsertime-tp6m-geckoview-bbc-e10s: None
* browsertime-tp6m-live-fenix-bbc-e10s: None
* browsertime-tp6m-live-geckoview-bbc-e10s: None
* browsertime-tp6m-refbrow-bbc-e10s: None
.. dropdown:: bing (BT, GV, FE, RB, CH-M)
:container: + anchor-id-bing-m
@ -4265,6 +4151,120 @@ Page-load performance test suite on Android. The links direct to the actual webs
* browsertime-tp6m-refbrow-cnn-ampstories-e10s: None
.. dropdown:: dailymail (BT, GV, FE, RB, CH-M)
:container: + anchor-id-dailymail-m
* **alert on**: fcp, loadtime
* **alert threshold**: 2.0
* **apps**: geckoview, fenix, refbrow, chrome-m
* **browser cycles**: 15
* **expected**: pass
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
* **playback**: mitmproxy-android
* **playback pageset manifest**: mitm6-android-fenix-dailymail.manifest
* **playback recordings**: mitm6-android-fenix-dailymail.mp
* **playback version**: 6.0.2
* **test url**: `<https://www.dailymail.co.uk/sciencetech/article-9749081/Experts-say-Hubble-repair-despite-NASA-insisting-multiple-options-fix.html>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
* test-android-hw-g5-7-0-arm7-qr/opt
* browsertime-tp6m-fenix-dailymail-e10s: None
* browsertime-tp6m-geckoview-dailymail-e10s: None
* browsertime-tp6m-live-fenix-dailymail-e10s: None
* browsertime-tp6m-live-geckoview-dailymail-e10s: None
* browsertime-tp6m-refbrow-dailymail-e10s: None
* test-android-hw-g5-7-0-arm7-shippable-qr/opt
* browsertime-tp6m-fenix-dailymail-e10s: None
* browsertime-tp6m-geckoview-dailymail-e10s: mozilla-beta, trunk
* browsertime-tp6m-live-fenix-dailymail-e10s: None
* browsertime-tp6m-live-geckoview-dailymail-e10s: None
* browsertime-tp6m-refbrow-dailymail-e10s: None
* test-android-hw-g5-7-0-arm7-shippable/opt
* browsertime-tp6m-chrome-m-dailymail-e10s: None
* browsertime-tp6m-fenix-dailymail-e10s: None
* browsertime-tp6m-geckoview-dailymail-e10s: None
* browsertime-tp6m-live-chrome-m-dailymail-e10s: None
* browsertime-tp6m-live-fenix-dailymail-e10s: None
* browsertime-tp6m-live-geckoview-dailymail-e10s: None
* browsertime-tp6m-refbrow-dailymail-e10s: None
* test-android-hw-g5-7-0-arm7/opt
* browsertime-tp6m-fenix-dailymail-e10s: None
* browsertime-tp6m-geckoview-dailymail-e10s: None
* browsertime-tp6m-live-fenix-dailymail-e10s: None
* browsertime-tp6m-live-geckoview-dailymail-e10s: None
* browsertime-tp6m-refbrow-dailymail-e10s: None
* test-android-hw-p2-8-0-android-aarch64-qr/opt
* browsertime-tp6m-fenix-dailymail-e10s: None
* browsertime-tp6m-geckoview-dailymail-e10s: None
* browsertime-tp6m-live-fenix-dailymail-e10s: None
* browsertime-tp6m-live-geckoview-dailymail-e10s: None
* browsertime-tp6m-refbrow-dailymail-e10s: None
* test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt
* browsertime-tp6m-fenix-dailymail-e10s: None
* browsertime-tp6m-geckoview-dailymail-e10s: mozilla-beta, trunk
* browsertime-tp6m-live-fenix-dailymail-e10s: None
* browsertime-tp6m-live-geckoview-dailymail-e10s: None
* browsertime-tp6m-refbrow-dailymail-e10s: None
* test-android-hw-p2-8-0-android-aarch64-shippable/opt
* browsertime-tp6m-chrome-m-dailymail-e10s: None
* browsertime-tp6m-fenix-dailymail-e10s: None
* browsertime-tp6m-geckoview-dailymail-e10s: None
* browsertime-tp6m-live-chrome-m-dailymail-e10s: None
* browsertime-tp6m-live-fenix-dailymail-e10s: None
* browsertime-tp6m-live-geckoview-dailymail-e10s: None
* browsertime-tp6m-refbrow-dailymail-e10s: None
* test-android-hw-p2-8-0-android-aarch64/opt
* browsertime-tp6m-fenix-dailymail-e10s: None
* browsertime-tp6m-geckoview-dailymail-e10s: None
* browsertime-tp6m-live-fenix-dailymail-e10s: None
* browsertime-tp6m-live-geckoview-dailymail-e10s: None
* browsertime-tp6m-refbrow-dailymail-e10s: None
* test-android-hw-p2-8-0-arm7-shippable/opt
* browsertime-tp6m-chrome-m-dailymail-e10s: None
* browsertime-tp6m-fenix-dailymail-e10s: None
* browsertime-tp6m-geckoview-dailymail-e10s: None
* browsertime-tp6m-live-chrome-m-dailymail-e10s: None
* browsertime-tp6m-live-fenix-dailymail-e10s: None
* browsertime-tp6m-live-geckoview-dailymail-e10s: None
* browsertime-tp6m-refbrow-dailymail-e10s: None
* test-android-hw-p2-8-0-arm7/opt
* browsertime-tp6m-fenix-dailymail-e10s: None
* browsertime-tp6m-geckoview-dailymail-e10s: None
* browsertime-tp6m-live-fenix-dailymail-e10s: None
* browsertime-tp6m-live-geckoview-dailymail-e10s: None
* browsertime-tp6m-refbrow-dailymail-e10s: None
* test-android-hw-s7-8-0-android-aarch64-qr/opt
* browsertime-tp6m-fenix-dailymail-e10s: None
* browsertime-tp6m-geckoview-dailymail-e10s: None
* browsertime-tp6m-live-fenix-dailymail-e10s: None
* browsertime-tp6m-live-geckoview-dailymail-e10s: None
* browsertime-tp6m-refbrow-dailymail-e10s: None
* test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt
* browsertime-tp6m-fenix-dailymail-e10s: None
* browsertime-tp6m-geckoview-dailymail-e10s: None
* browsertime-tp6m-live-fenix-dailymail-e10s: None
* browsertime-tp6m-live-geckoview-dailymail-e10s: None
* browsertime-tp6m-refbrow-dailymail-e10s: None
* test-android-hw-s7-8-0-android-aarch64-shippable/opt
* browsertime-tp6m-chrome-m-dailymail-e10s: None
* browsertime-tp6m-fenix-dailymail-e10s: None
* browsertime-tp6m-geckoview-dailymail-e10s: None
* browsertime-tp6m-live-chrome-m-dailymail-e10s: None
* browsertime-tp6m-live-fenix-dailymail-e10s: None
* browsertime-tp6m-live-geckoview-dailymail-e10s: None
* browsertime-tp6m-refbrow-dailymail-e10s: None
* test-android-hw-s7-8-0-android-aarch64/opt
* browsertime-tp6m-fenix-dailymail-e10s: None
* browsertime-tp6m-geckoview-dailymail-e10s: None
* browsertime-tp6m-live-fenix-dailymail-e10s: None
* browsertime-tp6m-live-geckoview-dailymail-e10s: None
* browsertime-tp6m-refbrow-dailymail-e10s: None
.. dropdown:: ebay-kleinanzeigen (BT, GV, FE, RB, CH-M)
:container: + anchor-id-ebay-kleinanzeigen-m

11
testing/performance/pageload_sites.json
Просмотреть файл

@ -15,12 +15,6 @@
"name": "amazon-search",
"test_url": "https://www.amazon.com/s/ref=nb_sb_noss_2/139-6317191-5622045?url=search-alias%3Daps&field-keywords=mobile+phone"
},
{
"login": true,
"comment": "not login test but fails to load",
"name": "bbc",
"test_url": "https://www.bbc.com/news/business-47245877"
},
{
"login": false,
"name": "bing",
@ -46,6 +40,11 @@
"name": "cnn-ampstories",
"test_url": "https://cnn.com/ampstories/us/why-hurricane-michael-is-a-monster-unlike-any-other"
},
{
"login": false,
"name": "dailymail",
"test_url": "https://www.dailymail.co.uk/sciencetech/article-9749081/Experts-say-Hubble-repair-despite-NASA-insisting-multiple-options-fix.html"
},
{
"login": false,
"name": "ebay-kleinanzeigen",

2
testing/raptor/raptor/perfdocs/config.yml
Просмотреть файл

@ -48,12 +48,12 @@ suites:
youtube: "BT, GV, FE, RB, CH-M"
allrecipes: "BT, GV, FE, RB, CH-M"
amazon-search: "BT, GV, FE, RB, CH-M"
bbc: "BT, GV, FE, RB, CH-M"
bing: "BT, GV, FE, RB, CH-M"
bing-search-restaurants: "BT, GV, FE, RB, CH-M"
booking: "BT, GV, FE, RB, CH-M"
cnn: "BT, GV, FE, RB, CH-M"
cnn-ampstories: "BT, GV, FE, RB, CH-M"
dailymail: "BT, GV, FE, RB, CH-M"
ebay-kleinanzeigen: "BT, GV, FE, RB, CH-M"
ebay-kleinanzeigen-search: "BT, GV, FE, RB, CH-M"
espn: "BT, GV, FE, RB, CH-M"

8
testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.ini
Просмотреть файл

@ -31,11 +31,6 @@ test_url = https://www.amazon.com
[amazon-search]
test_url = https://www.amazon.com/s/ref=nb_sb_noss_2/139-6317191-5622045?url=search-alias%3Daps&field-keywords=mobile+phone
[bbc]
test_url = https://www.bbc.com/news/business-47245877
playback_pageset_manifest = mitm4-pixel2-fennec-{subtest}.manifest
playback_recordings = mitm4-pixel2-fennec-{subtest}.mp
[bing]
test_url = https://www.bing.com/
@ -51,6 +46,9 @@ test_url = https://cnn.com
[cnn-ampstories]
test_url = https://cnn.com/ampstories/us/why-hurricane-michael-is-a-monster-unlike-any-other
[dailymail]
test_url = https://www.dailymail.co.uk/sciencetech/article-9749081/Experts-say-Hubble-repair-despite-NASA-insisting-multiple-options-fix.html
[ebay-kleinanzeigen]
test_url = https://m.ebay-kleinanzeigen.de

9
testing/raptor/raptor/tooltool-manifests/playback/mitm4-pixel2-fennec-bbc.manifest
Просмотреть файл

@ -1,9 +0,0 @@
[
{
"algorithm": "sha512",
"visibility": "public",
"filename": "mitm4-pixel2-fennec-bbc.zip",
"digest": "2dbbde8d408c28121b04b9a0696e4dd7c7020d3cef9c2a947563c3dacea4f930f9a8248c5c2b440d86265bb64720453abd88e64825f4a9848b987e1992bb2bc2",
"size": 4399751
}
]

9
testing/raptor/raptor/tooltool-manifests/playback/mitm6-android-fenix-dailymail.manifest Normal file
Просмотреть файл

@ -0,0 +1,9 @@
[
{
"algorithm": "sha512",
"digest": "58186e45a1a43234e6b6e30cae230e98ba528cf63fba822e43306010832e57462aefc631a493e6e75f1011c41cc54c7ce9ebbeed0292a22f3e867292d044250a",
"filename": "mitm6-android-fenix-dailymail.zip",
"size": 8427999,
"visibility": "public"
}
]

2
testing/raptor/webext/raptor/manifest.json
Просмотреть файл

@ -17,10 +17,10 @@
"*://*.allrecipes.com/*",
"*://*.apple.com/*",
"*://*.amazon.com/*",
"*://*.bbc.com/*",
"*://*.bing.com/*",
"*://*.booking.com/*",
"*://*.cnn.com/*",
"*://*.dailymail.co.uk/*",
"*://*.ebay.com/*",
"*://*.ebay-kleinanzeigen.de/*",
"*://*.espn.com/*",