Bug 1706035 - Re-record tp6 mobile tests with login r=perftest-reviewers,Bebe

Differential Revision: https://phabricator.services.mozilla.com/D112923
This commit is contained in:
Alex Ionescu 2021-04-27 13:17:50 +00:00
Родитель 39acafe01e
Коммит 7af9318fae
29 изменённых файлов: 103 добавлений и 119 удалений

Просмотреть файл

@ -832,6 +832,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **playback**: mitmproxy-android
* **playback pageset manifest**: mitm4-pixel2-fennec-{subtest}.manifest
* **playback recordings**: mitm4-pixel2-fennec-{subtest}.mp
* **playback version**: 6.0.2
* **test url**: `<https://www.bbc.com/news/business-47245877>`__
* **type**: pageload
* **unit**: ms
@ -871,6 +872,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **playback**: mitmproxy-android
* **playback pageset manifest**: mitm4-pixel2-fennec-{subtest}.manifest
* **playback recordings**: mitm4-pixel2-fennec-{subtest}.mp
* **playback version**: 6.0.2
* **test url**: `<https://www.bing.com/search?q=restaurants>`__
* **type**: pageload
* **unit**: ms
@ -930,6 +932,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **playback**: mitmproxy-android
* **playback pageset manifest**: mitm4-pixel2-fennec-{subtest}.manifest
* **playback recordings**: mitm4-pixel2-fennec-{subtest}.mp
* **playback version**: 6.0.2
* **test url**: `<https://cnn.com/ampstories/us/why-hurricane-michael-is-a-monster-unlike-any-other>`__
* **type**: pageload
* **unit**: ms
@ -1003,12 +1006,14 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **apps**: geckoview, fenix, refbrow, chrome-m
* **browser cycles**: 15
* **expected**: pass
* **login**: true
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
* **playback**: mitmproxy-android
* **playback pageset manifest**: mitm4-pixel2-fennec-{subtest}.manifest
* **playback recordings**: mitm4-pixel2-fennec-{subtest}.mp
* **playback pageset manifest**: mitm6-g5-fenix-{subtest}.manifest
* **playback recordings**: mitm6-g5-fenix-{subtest}.mp
* **playback version**: 6.0.2
* **test url**: `<https://m.facebook.com>`__
* **type**: pageload
* **unit**: ms
@ -1042,12 +1047,14 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **apps**: geckoview, fenix, refbrow, chrome-m
* **browser cycles**: 15
* **expected**: pass
* **login**: true
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
* **playback**: mitmproxy-android
* **playback pageset manifest**: mitm4-pixel2-fennec-{subtest}.manifest
* **playback recordings**: mitm4-pixel2-fennec-{subtest}.mp
* **playback pageset manifest**: mitm6-g5-fenix-{subtest}.manifest
* **playback recordings**: mitm6-g5-fenix-{subtest}.mp
* **playback version**: 6.0.2
* **test url**: `<https://www.google.com>`__
* **type**: pageload
* **unit**: ms
@ -1081,12 +1088,14 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **apps**: geckoview, fenix, refbrow, chrome-m
* **browser cycles**: 15
* **expected**: pass
* **login**: true
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
* **playback**: mitmproxy-android
* **playback pageset manifest**: mitm4-pixel2-fennec-{subtest}.manifest
* **playback recordings**: mitm4-pixel2-fennec-{subtest}.mp
* **playback pageset manifest**: mitm6-g5-fenix-{subtest}.manifest
* **playback recordings**: mitm6-g5-fenix-{subtest}.mp
* **playback version**: 6.0.2
* **test url**: `<https://www.google.com/search?q=restaurants+near+me>`__
* **type**: pageload
* **unit**: ms
@ -1120,12 +1129,14 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **apps**: geckoview, fenix, refbrow, chrome-m
* **browser cycles**: 15
* **expected**: pass
* **login**: true
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
* **playback**: mitmproxy-android
* **playback pageset manifest**: mitm4-pixel2-fennec-{subtest}.manifest
* **playback recordings**: mitm4-pixel2-fennec-{subtest}.mp
* **playback pageset manifest**: mitm6-g5-fenix-{subtest}.manifest
* **playback recordings**: mitm6-g5-fenix-{subtest}.mp
* **playback version**: 6.0.2
* **test url**: `<https://www.instagram.com>`__
* **type**: pageload
* **unit**: ms
@ -1145,6 +1156,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **playback**: mitmproxy-android
* **playback pageset manifest**: mitm4-pixel2-fennec-{subtest}.manifest
* **playback recordings**: mitm4-pixel2-fennec-{subtest}.mp
* **playback version**: 6.0.2
* **test url**: `<https://www.jianshu.com/>`__
* **type**: pageload
* **unit**: ms
@ -1264,6 +1276,7 @@ Page-load performance test suite on Android. The links direct to the actual webs
* **playback**: mitmproxy-android
* **playback pageset manifest**: mitm4-pixel2-fennec-{subtest}.manifest
* **playback recordings**: mitm4-pixel2-fennec-{subtest}.mp
* **playback version**: 6.0.2
* **test url**: `<https://m.youtube.com>`__
* **type**: pageload
* **unit**: ms

Просмотреть файл

@ -13,8 +13,9 @@ lower_is_better = true
page_cycles = 25
page_timeout = 60000
playback = mitmproxy-android
playback_pageset_manifest = mitm4-pixel2-fennec-{subtest}.manifest
playback_recordings = mitm4-pixel2-fennec-{subtest}.mp
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
type = pageload
unit = ms
use_live_sites = false
@ -23,135 +24,105 @@ use_live_sites = false
[allrecipes]
test_url = https://www.allrecipes.com/
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
[amazon]
test_url = https://www.amazon.com
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
[amazon-search]
test_url = https://www.amazon.com/s/ref=nb_sb_noss_2/139-6317191-5622045?url=search-alias%3Daps&field-keywords=mobile+phone
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
[bbc]
test_url = https://www.bbc.com/news/business-47245877
playback_pageset_manifest = mitm4-pixel2-fennec-{subtest}.manifest
playback_recordings = mitm4-pixel2-fennec-{subtest}.mp
[bing]
test_url = https://www.bing.com/
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
[bing-search-restaurants]
test_url = https://www.bing.com/search?q=restaurants
playback_pageset_manifest = mitm4-pixel2-fennec-{subtest}.manifest
playback_recordings = mitm4-pixel2-fennec-{subtest}.mp
[booking]
test_url = https://www.booking.com/
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
[cnn]
test_url = https://cnn.com
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
[cnn-ampstories]
test_url = https://cnn.com/ampstories/us/why-hurricane-michael-is-a-monster-unlike-any-other
playback_pageset_manifest = mitm4-pixel2-fennec-{subtest}.manifest
playback_recordings = mitm4-pixel2-fennec-{subtest}.mp
[ebay-kleinanzeigen]
test_url = https://m.ebay-kleinanzeigen.de
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
[ebay-kleinanzeigen-search]
test_url = https://m.ebay-kleinanzeigen.de/s-anzeigen/auf-zeit-wg-berlin/zimmer/c199-l3331
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
[espn]
test_url = http://www.espn.com/nba/story/_/page/allstarweekend25788027/the-comparison-lebron-james-michael-jordan-their-own-words
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
[facebook]
test_url = https://m.facebook.com
login = true
playback_pageset_manifest = mitm6-g5-fenix-{subtest}.manifest
playback_recordings = mitm6-g5-fenix-{subtest}.mp
[facebook-cristiano]
test_url = https://m.facebook.com/Cristiano
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
[google]
test_url = https://www.google.com
playback_pageset_manifest = mitm6-g5-fenix-{subtest}.manifest
playback_recordings = mitm6-g5-fenix-{subtest}.mp
login = true
[google-maps]
test_url = https://www.google.com/maps?force=pwa
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
[google-search-restaurants]
test_url = https://www.google.com/search?q=restaurants+near+me
playback_pageset_manifest = mitm6-g5-fenix-{subtest}.manifest
playback_recordings = mitm6-g5-fenix-{subtest}.mp
playback_version = 6.0.2
login = true
[imdb]
test_url = https://m.imdb.com/
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
[instagram]
test_url = https://www.instagram.com
playback_pageset_manifest = mitm6-g5-fenix-{subtest}.manifest
playback_recordings = mitm6-g5-fenix-{subtest}.mp
playback_version = 6.0.2
login = true
[jianshu]
test_url = https://www.jianshu.com/
playback_pageset_manifest = mitm4-pixel2-fennec-{subtest}.manifest
playback_recordings = mitm4-pixel2-fennec-{subtest}.mp
[microsoft-support]
test_url = https://support.microsoft.com/en-us
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
[reddit]
test_url = https://www.reddit.com
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
[stackoverflow]
test_url = https://stackoverflow.com/
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
[web-de]
test_url = https://web.de/magazine/politik/politologe-glaubt-grossen-koalition-herbst-knallen-33563566
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
[wikipedia]
test_url = https://en.m.wikipedia.org/wiki/Main_Page
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2
[youtube]
test_url = https://m.youtube.com
playback_pageset_manifest = mitm4-pixel2-fennec-{subtest}.manifest
playback_recordings = mitm4-pixel2-fennec-{subtest}.mp
[youtube-watch]
test_url = https://www.youtube.com/watch?v=COU5T-Wafa4
playback_pageset_manifest = mitm6-android-fenix-{subtest}.manifest
playback_recordings = mitm6-android-fenix-{subtest}.mp
playback_version = 6.0.2

Просмотреть файл

@ -1,9 +0,0 @@
[
{
"algorithm": "sha512",
"visibility": "public",
"filename": "mitm4-pixel2-fennec-facebook.zip",
"digest": "21d0d69fb3d550a72e41859f9bba73cc95e9f02ff94af2ec934e3d3b38f6e976785cc9056731c8b887138ec1e33eca53379be88e3f2dee0d58e0855534107fcd",
"size": 4191442
}
]

Просмотреть файл

@ -1,9 +0,0 @@
[
{
"algorithm": "sha512",
"visibility": "public",
"filename": "mitm4-pixel2-fennec-google-search-restaurants.zip",
"digest": "0c7d3d29e0db81a8860a264768d4c79b22e7f09fe565d53ec0b98ae23b433fb82408719dbcadbc441818c1f17292e39d7669fc5a9e5338e84470ed135136a376",
"size": 4148631
}
]

Просмотреть файл

@ -1,9 +0,0 @@
[
{
"algorithm": "sha512",
"visibility": "public",
"filename": "mitm4-pixel2-fennec-google.zip",
"digest": "5bcc4e07d9226acf533bfc94de9e0eb15e7a5f279df6be706eab63f652d9eeec88c85cf6a9040321e40637c0385554a1ffefe5385068218f722eb594133391ea",
"size": 3653167
}
]

Просмотреть файл

@ -1,9 +0,0 @@
[
{
"algorithm": "sha512",
"visibility": "public",
"filename": "mitm4-pixel2-fennec-instagram.zip",
"digest": "e3c1870bc833e7a764dc96ba89d08a9800ae7f246c0a1a3851e568102faaf3628b059877d8db155fe872fa5be97119229353e43501e8074276f30685e7d016ff",
"size": 8882207
}
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 4825383,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 3334287,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 3199995,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 1283380,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 1584815,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 5185843,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 2027392,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 2452686,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 4359513,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 1026780,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 82227,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 3934494,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 2746707,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 2258353,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 1026600,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 1891502,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 763266,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 782446,
"visibility": "public"
}
]
]

Просмотреть файл

@ -6,4 +6,4 @@
"size": 772257,
"visibility": "public"
}
]
]

Просмотреть файл

@ -0,0 +1,9 @@
[
{
"size": 8922738,
"visibility": "public",
"digest": "f48caf821b8e2b2f1f6038a6936f397ccae212e20310545ed10302921a02b8d0f90ced2c2e6a2609e76e886d36a1e01c4049b2cbdd7d272fb5550f866e0d9b7b",
"algorithm": "sha512",
"filename": "mitm6-g5-fenix-facebook.zip"
}
]

Просмотреть файл

@ -0,0 +1,9 @@
[
{
"size": 7941483,
"visibility": "public",
"digest": "9c9ff8f2a4c78536f6c1f4405fe01422c8b110889d185b89161ff96a518702c2320186fb2961df7f187447b9a23e7cbf6f01b8079427784fb3af0dfbd63321c4",
"algorithm": "sha512",
"filename": "mitm6-g5-fenix-google-search-restaurants.zip"
}
]

Просмотреть файл

@ -0,0 +1,9 @@
[
{
"size": 8866092,
"visibility": "public",
"digest": "6ab38726ceda5212d34f83c6db97402eaed77bc3179355c51115d9b6350cbd5af398b955eb0562a489bb935deed51fb221c5097d5c48f0b99c23fc1f28df0f40",
"algorithm": "sha512",
"filename": "mitm6-g5-fenix-google.zip"
}
]

Просмотреть файл

@ -0,0 +1,9 @@
[
{
"size": 7599724,
"visibility": "public",
"digest": "5e19163c5877874d94ae110313169629d0d6d820a7b42e375cf5db46e544fe324edb8dde4b5295d7cac6791a487111dc96c63a15681727ecefffce9da7440b54",
"algorithm": "sha512",
"filename": "mitm6-g5-fenix-instagram.zip"
}
]