From 764028466e0000d9f10c845964d06fc293910155 Mon Sep 17 00:00:00 2001 From: Greg Mierzwinski Date: Wed, 17 Apr 2024 12:34:30 +0000 Subject: [PATCH] Bug 1890318 - Add missing metrics to Raptor documentation. r=perftest-reviewers,kshampur DONTBUILD This patch adds the final missing metrics that alert to the Raptor documentation. Differential Revision: https://phabricator.services.mozilla.com/D206952 --- testing/perfdocs/generated/raptor-metrics.rst | 94 ++++++++- testing/perfdocs/generated/raptor.rst | 180 +++++++++--------- testing/raptor/raptor/perfdocs/config.yml | 51 ++++- 3 files changed, 222 insertions(+), 103 deletions(-) diff --git a/testing/perfdocs/generated/raptor-metrics.rst b/testing/perfdocs/generated/raptor-metrics.rst index 61e2fe171117..aa0429aed74a 100644 --- a/testing/perfdocs/generated/raptor-metrics.rst +++ b/testing/perfdocs/generated/raptor-metrics.rst @@ -86,36 +86,114 @@ Metric Definitions The following documents all available metrics that current alert in Raptor Browsertime tests. +Contentful Speed Index +====================== +Similar to SpeedIndex, except that it uses the contentfulness of a frame to determine visual completeness instead of the histogram differences. The contentfulness is determined by calculating the number of edges found in the frame. A lower number of edges detected gives a smaller contentfulness value (and a smaller visually complete value). + + + * **Aliases**: ContentfulSpeedIndex + * **Tests using it**: + * **Custom**: `connect `__, `process-switch `__, `throttled `__, `welcome `__ + * **Desktop**: `amazon `__, `bing-search `__, `buzzfeed `__, `cnn `__, `docomo `__, `ebay `__, `espn `__, `expedia `__, `facebook `__, `fandom `__, `google-docs `__, `google-mail `__, `google-search `__, `google-slides `__, `imdb `__, `imgur `__, `instagram `__, `linkedin `__, `microsoft `__, `netflix `__, `nytimes `__, `office `__, `openai `__, `outlook `__, `paypal `__, `pinterest `__, `reddit `__, `samsung `__, `tiktok `__, `tumblr `__, `twitch `__, `twitter `__, `weather `__, `wikia `__, `wikipedia `__, `yahoo-mail `__, `youtube `__ + * **Interactive**: `cnn-nav `__, `facebook-nav `__, `reddit-billgates-ama `__, `reddit-billgates-post-1 `__, `reddit-billgates-post-2 `__ + * **Live**: `booking-sf `__, `discord `__, `fashionbeans `__, `google-accounts `__, `imdb-firefox `__, `medium-article `__, `people-article `__, `reddit-thread `__, `rumble-fox `__, `stackoverflow-question `__, `urbandictionary-define `__, `wikia-marvel `__ + * **Mobile**: `allrecipes `__, `amazon `__, `amazon-search `__, `bild-de `__, `bing `__, `bing-search-restaurants `__, `booking `__, `cnn `__, `cnn-ampstories `__, `dailymail `__, `ebay-kleinanzeigen `__, `ebay-kleinanzeigen-search `__, `espn `__, `facebook `__, `facebook-cristiano `__, `google `__, `google-maps `__, `google-search-restaurants `__, `imdb `__, `instagram `__, `microsoft-support `__, `reddit `__, `sina `__, `stackoverflow `__, `wikipedia `__, `youtube `__, `youtube-watch `__ + + First Paint =========== -Denotes the first time the browser performs a paint that has content in it. +Denotes the first time the browser performs a paint that has content in it (in ms). * **Aliases**: First Contentful Composite, First Contentful Paint, fcp * **Tests using it**: * **Custom**: `browsertime `__, `connect `__, `process-switch `__, `throttled `__, `welcome `__ - * **Desktop**: `amazon `__, `bing-search `__, `buzzfeed `__, `cnn `__, `ebay `__, `espn `__, `expedia `__, `facebook `__, `fandom `__, `google-docs `__, `google-mail `__, `google-search `__, `google-slides `__, `imdb `__, `imgur `__, `instagram `__, `linkedin `__, `microsoft `__, `netflix `__, `nytimes `__, `office `__, `outlook `__, `paypal `__, `pinterest `__, `reddit `__, `tumblr `__, `twitch `__, `twitter `__, `wikia `__, `wikipedia `__, `yahoo-mail `__, `youtube `__ + * **Desktop**: `amazon `__, `bing-search `__, `buzzfeed `__, `cnn `__, `docomo `__, `ebay `__, `espn `__, `expedia `__, `facebook `__, `fandom `__, `google-docs `__, `google-mail `__, `google-search `__, `google-slides `__, `imdb `__, `imgur `__, `instagram `__, `linkedin `__, `microsoft `__, `netflix `__, `nytimes `__, `office `__, `openai `__, `outlook `__, `paypal `__, `pinterest `__, `reddit `__, `samsung `__, `tiktok `__, `tumblr `__, `twitch `__, `twitter `__, `weather `__, `wikia `__, `wikipedia `__, `yahoo-mail `__, `youtube `__ * **Interactive**: `cnn-nav `__, `facebook-nav `__, `reddit-billgates-ama `__, `reddit-billgates-post-1 `__, `reddit-billgates-post-2 `__ * **Live**: `booking-sf `__, `discord `__, `fashionbeans `__, `google-accounts `__, `imdb-firefox `__, `medium-article `__, `people-article `__, `reddit-thread `__, `rumble-fox `__, `stackoverflow-question `__, `urbandictionary-define `__, `wikia-marvel `__ * **Mobile**: `allrecipes `__, `amazon `__, `amazon-search `__, `bild-de `__, `bing `__, `bing-search-restaurants `__, `booking `__, `cnn `__, `cnn-ampstories `__, `dailymail `__, `ebay-kleinanzeigen `__, `ebay-kleinanzeigen-search `__, `espn `__, `facebook `__, `facebook-cristiano `__, `google `__, `google-maps `__, `google-search-restaurants `__, `imdb `__, `instagram `__, `microsoft-support `__, `reddit `__, `sina `__, `stackoverflow `__, `wikipedia `__, `youtube `__, `youtube-watch `__ * **Unittests**: `test-page-1 `__, `test-page-2 `__, `test-page-3 `__, `test-page-4 `__ -In Progress -=========== -Many metrics have not been documented yet, this is a placeholder. +First Visual Change +=================== +The first visual change detected in the test (in ms). - * **Aliases**: + * **Aliases**: FirstVisualChange + * **Tests using it**: + * **Custom**: `connect `__, `process-switch `__, `throttled `__, `welcome `__ + * **Desktop**: `amazon `__, `bing-search `__, `buzzfeed `__, `cnn `__, `docomo `__, `ebay `__, `espn `__, `expedia `__, `facebook `__, `fandom `__, `google-docs `__, `google-mail `__, `google-search `__, `google-slides `__, `imdb `__, `imgur `__, `instagram `__, `linkedin `__, `microsoft `__, `netflix `__, `nytimes `__, `office `__, `openai `__, `outlook `__, `paypal `__, `pinterest `__, `reddit `__, `samsung `__, `tiktok `__, `tumblr `__, `twitch `__, `twitter `__, `weather `__, `wikia `__, `wikipedia `__, `yahoo-mail `__, `youtube `__ + * **Interactive**: `cnn-nav `__, `facebook-nav `__, `reddit-billgates-ama `__, `reddit-billgates-post-1 `__, `reddit-billgates-post-2 `__ + * **Live**: `booking-sf `__, `discord `__, `fashionbeans `__, `google-accounts `__, `imdb-firefox `__, `medium-article `__, `people-article `__, `reddit-thread `__, `rumble-fox `__, `stackoverflow-question `__, `urbandictionary-define `__, `wikia-marvel `__ + * **Mobile**: `allrecipes `__, `amazon `__, `amazon-search `__, `bild-de `__, `bing `__, `bing-search-restaurants `__, `booking `__, `cnn `__, `cnn-ampstories `__, `dailymail `__, `ebay-kleinanzeigen `__, `ebay-kleinanzeigen-search `__, `espn `__, `facebook `__, `facebook-cristiano `__, `google `__, `google-maps `__, `google-search-restaurants `__, `imdb `__, `instagram `__, `microsoft-support `__, `reddit `__, `sina `__, `stackoverflow `__, `wikipedia `__, `youtube `__, `youtube-watch `__ + + +Largest Contentful Paint +======================== +The time (in ms) at which the largest piece of content on the page was rendered/painted. + + + * **Aliases**: largestContentfulPaint, lcp + * **Tests using it**: + * **Desktop**: `amazon `__, `bing-search `__, `buzzfeed `__, `cnn `__, `docomo `__, `ebay `__, `espn `__, `expedia `__, `facebook `__, `fandom `__, `google-docs `__, `google-mail `__, `google-search `__, `google-slides `__, `imdb `__, `imgur `__, `instagram `__, `linkedin `__, `microsoft `__, `netflix `__, `nytimes `__, `office `__, `openai `__, `outlook `__, `paypal `__, `pinterest `__, `reddit `__, `samsung `__, `tiktok `__, `tumblr `__, `twitter `__, `weather `__, `wikia `__, `wikipedia `__, `yahoo-mail `__, `youtube `__ + * **Mobile**: `allrecipes `__, `amazon `__, `amazon-search `__, `bild-de `__, `bing `__, `bing-search-restaurants `__, `booking `__, `cnn `__, `cnn-ampstories `__, `dailymail `__, `ebay-kleinanzeigen `__, `ebay-kleinanzeigen-search `__, `espn `__, `facebook `__, `facebook-cristiano `__, `google `__, `google-maps `__, `google-search-restaurants `__, `imdb `__, `instagram `__, `microsoft-support `__, `reddit `__, `sina `__, `stackoverflow `__, `wikipedia `__, `youtube `__, `youtube-watch `__ + + +Last Visual Change +================== +The last visual change detected in the test (in ms). + + * **Aliases**: LastVisualChange + * **Tests using it**: + * **Custom**: `process-switch `__, `welcome `__ + * **Desktop**: `amazon `__, `bing-search `__, `buzzfeed `__, `cnn `__, `docomo `__, `ebay `__, `espn `__, `expedia `__, `facebook `__, `fandom `__, `google-docs `__, `google-mail `__, `google-search `__, `google-slides `__, `imdb `__, `imgur `__, `instagram `__, `linkedin `__, `microsoft `__, `netflix `__, `nytimes `__, `office `__, `openai `__, `outlook `__, `paypal `__, `pinterest `__, `reddit `__, `samsung `__, `tiktok `__, `tumblr `__, `twitch `__, `twitter `__, `weather `__, `wikia `__, `wikipedia `__, `yahoo-mail `__, `youtube `__ + * **Interactive**: `cnn-nav `__, `facebook-nav `__, `reddit-billgates-ama `__, `reddit-billgates-post-1 `__, `reddit-billgates-post-2 `__ + * **Live**: `booking-sf `__, `discord `__, `fashionbeans `__, `google-accounts `__, `imdb-firefox `__, `medium-article `__, `people-article `__, `reddit-thread `__, `rumble-fox `__, `stackoverflow-question `__, `urbandictionary-define `__, `wikia-marvel `__ + * **Mobile**: `allrecipes `__, `amazon `__, `amazon-search `__, `bild-de `__, `bing `__, `bing-search-restaurants `__, `booking `__, `cnn `__, `cnn-ampstories `__, `dailymail `__, `ebay-kleinanzeigen `__, `ebay-kleinanzeigen-search `__, `espn `__, `facebook `__, `facebook-cristiano `__, `google `__, `google-maps `__, `google-search-restaurants `__, `imdb `__, `instagram `__, `microsoft-support `__, `reddit `__, `sina `__, `stackoverflow `__, `wikipedia `__, `youtube `__, `youtube-watch `__ + + +Load Time +========= +The time it took for the page to complete loading (in ms). + + * **Aliases**: loadtime * **Tests using it**: - * **Benchmarks**: `youtube-playback `__, `youtube-playback-hfr `__ * **Custom**: `browsertime `__, `connect `__, `process-switch `__, `throttled `__, `welcome `__ - * **Desktop**: `amazon `__, `bing-search `__, `buzzfeed `__, `cnn `__, `ebay `__, `espn `__, `expedia `__, `facebook `__, `fandom `__, `google-docs `__, `google-mail `__, `google-search `__, `google-slides `__, `imdb `__, `imgur `__, `instagram `__, `linkedin `__, `microsoft `__, `netflix `__, `nytimes `__, `office `__, `outlook `__, `paypal `__, `pinterest `__, `reddit `__, `tumblr `__, `twitch `__, `twitter `__, `wikia `__, `wikipedia `__, `yahoo-mail `__, `youtube `__ + * **Desktop**: `amazon `__, `bing-search `__, `buzzfeed `__, `cnn `__, `docomo `__, `ebay `__, `espn `__, `expedia `__, `facebook `__, `fandom `__, `google-docs `__, `google-mail `__, `google-search `__, `google-slides `__, `imdb `__, `imgur `__, `instagram `__, `linkedin `__, `microsoft `__, `netflix `__, `nytimes `__, `office `__, `openai `__, `outlook `__, `paypal `__, `pinterest `__, `reddit `__, `samsung `__, `tiktok `__, `tumblr `__, `twitch `__, `twitter `__, `weather `__, `wikia `__, `wikipedia `__, `yahoo-mail `__, `youtube `__ * **Interactive**: `cnn-nav `__, `facebook-nav `__, `reddit-billgates-ama `__, `reddit-billgates-post-1 `__, `reddit-billgates-post-2 `__ * **Live**: `booking-sf `__, `discord `__, `fashionbeans `__, `google-accounts `__, `imdb-firefox `__, `medium-article `__, `people-article `__, `reddit-thread `__, `rumble-fox `__, `stackoverflow-question `__, `urbandictionary-define `__, `wikia-marvel `__ * **Mobile**: `allrecipes `__, `amazon `__, `amazon-search `__, `bild-de `__, `bing `__, `bing-search-restaurants `__, `booking `__, `cnn `__, `cnn-ampstories `__, `dailymail `__, `ebay-kleinanzeigen `__, `ebay-kleinanzeigen-search `__, `espn `__, `facebook `__, `facebook-cristiano `__, `google `__, `google-maps `__, `google-search-restaurants `__, `imdb `__, `instagram `__, `microsoft-support `__, `reddit `__, `sina `__, `stackoverflow `__, `wikipedia `__, `youtube `__, `youtube-watch `__ * **Unittests**: `test-page-1 `__, `test-page-2 `__, `test-page-3 `__, `test-page-4 `__ +Perceptual Speed Index +====================== +Similar to SpeedIndex, except that it uses the structural similarity index measure (ssim) to determine visual completeness. This technique compares the luminance, contrast, and structure of the frames (a given frame vs. a final frame) to determine the completeness. + + + * **Aliases**: PerceptualSpeedIndex + * **Tests using it**: + * **Custom**: `connect `__, `process-switch `__, `throttled `__, `welcome `__ + * **Desktop**: `amazon `__, `bing-search `__, `buzzfeed `__, `cnn `__, `docomo `__, `ebay `__, `espn `__, `expedia `__, `facebook `__, `fandom `__, `google-docs `__, `google-mail `__, `google-search `__, `google-slides `__, `imdb `__, `imgur `__, `instagram `__, `linkedin `__, `microsoft `__, `netflix `__, `nytimes `__, `office `__, `openai `__, `outlook `__, `paypal `__, `pinterest `__, `reddit `__, `samsung `__, `tiktok `__, `tumblr `__, `twitch `__, `twitter `__, `weather `__, `wikia `__, `wikipedia `__, `yahoo-mail `__, `youtube `__ + * **Interactive**: `cnn-nav `__, `facebook-nav `__, `reddit-billgates-ama `__, `reddit-billgates-post-1 `__, `reddit-billgates-post-2 `__ + * **Live**: `booking-sf `__, `discord `__, `fashionbeans `__, `google-accounts `__, `imdb-firefox `__, `medium-article `__, `people-article `__, `reddit-thread `__, `rumble-fox `__, `stackoverflow-question `__, `urbandictionary-define `__, `wikia-marvel `__ + * **Mobile**: `allrecipes `__, `amazon `__, `amazon-search `__, `bild-de `__, `bing `__, `bing-search-restaurants `__, `booking `__, `cnn `__, `cnn-ampstories `__, `dailymail `__, `ebay-kleinanzeigen `__, `ebay-kleinanzeigen-search `__, `espn `__, `facebook `__, `facebook-cristiano `__, `google `__, `google-maps `__, `google-search-restaurants `__, `imdb `__, `instagram `__, `microsoft-support `__, `reddit `__, `sina `__, `stackoverflow `__, `wikipedia `__, `youtube `__, `youtube-watch `__ + + +Speed Index +=========== +A metric used to denote the speed at which a page loaded. Lower values indicate faster pageloads. Units are in (Visually-Complete x Milliseconds). Calculated by using videos of the pageload which provide a measure of visual completeness. Visual completeness is calculated by comparing the histogram of a given frame to the final frame of the pageload. The SpeedIndex is calculated as the area between the curves of a constant line at y=1, and the graph of the visual completeness from 0ms to when visual completeness reaches 100% (or hits the y=1 line). + + + * **Aliases**: SpeedIndex + * **Tests using it**: + * **Custom**: `connect `__, `process-switch `__, `throttled `__, `welcome `__ + * **Desktop**: `amazon `__, `bing-search `__, `buzzfeed `__, `cnn `__, `docomo `__, `ebay `__, `espn `__, `expedia `__, `facebook `__, `fandom `__, `google-docs `__, `google-mail `__, `google-search `__, `google-slides `__, `imdb `__, `imgur `__, `instagram `__, `linkedin `__, `microsoft `__, `netflix `__, `nytimes `__, `office `__, `openai `__, `outlook `__, `paypal `__, `pinterest `__, `reddit `__, `samsung `__, `tiktok `__, `tumblr `__, `twitch `__, `twitter `__, `weather `__, `wikia `__, `wikipedia `__, `yahoo-mail `__, `youtube `__ + * **Interactive**: `cnn-nav `__, `facebook-nav `__, `reddit-billgates-ama `__, `reddit-billgates-post-1 `__, `reddit-billgates-post-2 `__ + * **Live**: `booking-sf `__, `discord `__, `fashionbeans `__, `google-accounts `__, `imdb-firefox `__, `medium-article `__, `people-article `__, `reddit-thread `__, `rumble-fox `__, `stackoverflow-question `__, `urbandictionary-define `__, `wikia-marvel `__ + * **Mobile**: `allrecipes `__, `amazon `__, `amazon-search `__, `bild-de `__, `bing `__, `bing-search-restaurants `__, `booking `__, `cnn `__, `cnn-ampstories `__, `dailymail `__, `ebay-kleinanzeigen `__, `ebay-kleinanzeigen-search `__, `espn `__, `facebook `__, `facebook-cristiano `__, `google `__, `google-maps `__, `google-search-restaurants `__, `imdb `__, `instagram `__, `microsoft-support `__, `reddit `__, `sina `__, `stackoverflow `__, `wikipedia `__, `youtube `__, `youtube-watch `__ + + Youtube Playback Metrics ======================== Metrics starting with VP9/H264 give the number of frames dropped, and painted. diff --git a/testing/perfdocs/generated/raptor.rst b/testing/perfdocs/generated/raptor.rst index 3a3d38be10b7..7a2f87165ec0 100644 --- a/testing/perfdocs/generated/raptor.rst +++ b/testing/perfdocs/generated/raptor.rst @@ -14999,7 +14999,7 @@ Browsertime tests that use a custom pageload test script. These use the pageload **Description**: Used to run vanilla browsertime tests through raptor. For example: `./mach raptor --browsertime -t browsertime --browsertime-arg url=https://www.sitespeed.io --browsertime-arg iterations=3` - * **alert on**: `fcp `__, `loadtime `__ + * **alert on**: `fcp `__, `loadtime `__ * **alert threshold**: 2.0 * **apps**: firefox * **browser cycles**: 1 @@ -15027,7 +15027,7 @@ Browsertime tests that use a custom pageload test script. These use the pageload **Description**: Verifies that connection time on a pageload is zero when a speculative connection has first been made * **alert change type**: absolute - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__ * **alert threshold**: 10.0 * **apps**: firefox * **browser cycles**: 3 @@ -15552,7 +15552,7 @@ Browsertime tests that use a custom pageload test script. These use the pageload **Description**: Measures process switch time * **accept zero vismet**: true - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome * **browser cycles**: 25 @@ -15789,7 +15789,7 @@ Browsertime tests that use a custom pageload test script. These use the pageload **Description**: Pageload test using a throttled network environment - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox * **browser cycles**: 3 @@ -16663,7 +16663,7 @@ Browsertime tests that use a custom pageload test script. These use the pageload **Description**: Measures pageload metrics for the first-install about:welcome page - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox * **browser cycles**: 25 @@ -16871,7 +16871,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false @@ -17447,7 +17447,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -17845,7 +17845,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false @@ -18084,7 +18084,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -18565,7 +18565,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome * **benchmark page**: false @@ -18788,7 +18788,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -19112,7 +19112,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false @@ -19423,7 +19423,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -19709,7 +19709,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -20075,7 +20075,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false @@ -20473,7 +20473,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -20798,7 +20798,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false @@ -21121,7 +21121,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -21444,7 +21444,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false @@ -21843,7 +21843,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -22274,7 +22274,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false @@ -22579,7 +22579,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -23080,7 +23080,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -23404,7 +23404,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -23728,7 +23728,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -24047,7 +24047,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -24333,7 +24333,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -24572,7 +24572,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome * **benchmark page**: false @@ -24795,7 +24795,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -25113,7 +25113,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -25436,7 +25436,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false @@ -25760,7 +25760,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false @@ -26191,7 +26191,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome * **benchmark page**: false @@ -26414,7 +26414,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome * **benchmark page**: false @@ -26637,7 +26637,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -26961,7 +26961,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -27287,7 +27287,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false @@ -27680,7 +27680,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome * **benchmark page**: false @@ -27903,7 +27903,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false @@ -28142,7 +28142,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -28648,7 +28648,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false @@ -29046,7 +29046,7 @@ Tests for page-load performance. The links direct to the actual websites that ar **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true @@ -29485,7 +29485,7 @@ Browsertime tests that interact with the webpage. Includes responsiveness tests **Description**: Navigates to cnn main page, then to the world sub-page. * **accept zero vismet**: true - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 10 @@ -29727,7 +29727,7 @@ Browsertime tests that interact with the webpage. Includes responsiveness tests **Description**: Navigates to facebook, then the sub-pages friends, marketplace, groups. * **accept zero vismet**: true - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 10 @@ -29969,7 +29969,7 @@ Browsertime tests that interact with the webpage. Includes responsiveness tests **Description**: Navigates from the Bill Gates AMA to the Reddit members section. * **accept zero vismet**: true - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 10 @@ -30211,7 +30211,7 @@ Browsertime tests that interact with the webpage. Includes responsiveness tests **Description**: Navigates the `thisisbillgates` user starting at the main user page, then to the posts, comments, hot, and top sections. * **accept zero vismet**: true - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 10 @@ -30453,7 +30453,7 @@ Browsertime tests that interact with the webpage. Includes responsiveness tests **Description**: Navigates the `thisisbillgates` user starting at the main user page, then to the posts, comments, hot, and top sections. * **accept zero vismet**: true - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 10 @@ -30697,7 +30697,7 @@ A set of test pages that are run as live sites instead of recorded versions. The **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 @@ -30765,7 +30765,7 @@ A set of test pages that are run as live sites instead of recorded versions. The **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 @@ -30833,7 +30833,7 @@ A set of test pages that are run as live sites instead of recorded versions. The **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 @@ -30901,7 +30901,7 @@ A set of test pages that are run as live sites instead of recorded versions. The **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 @@ -30969,7 +30969,7 @@ A set of test pages that are run as live sites instead of recorded versions. The **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 @@ -31037,7 +31037,7 @@ A set of test pages that are run as live sites instead of recorded versions. The **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 @@ -31105,7 +31105,7 @@ A set of test pages that are run as live sites instead of recorded versions. The **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 @@ -31173,7 +31173,7 @@ A set of test pages that are run as live sites instead of recorded versions. The **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 @@ -31241,7 +31241,7 @@ A set of test pages that are run as live sites instead of recorded versions. The **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 @@ -31309,7 +31309,7 @@ A set of test pages that are run as live sites instead of recorded versions. The **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 @@ -31377,7 +31377,7 @@ A set of test pages that are run as live sites instead of recorded versions. The **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 @@ -31445,7 +31445,7 @@ A set of test pages that are run as live sites instead of recorded versions. The **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 @@ -31518,7 +31518,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -31615,7 +31615,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -32189,7 +32189,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -32296,7 +32296,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -32428,7 +32428,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -32560,7 +32560,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -32692,7 +32692,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -32824,7 +32824,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -33303,7 +33303,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -33435,7 +33435,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -33567,7 +33567,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -33699,7 +33699,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -33831,7 +33831,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -34140,7 +34140,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -34505,7 +34505,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -34637,7 +34637,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -34735,7 +34735,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -34867,7 +34867,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -35000,7 +35000,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -35429,7 +35429,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -35929,7 +35929,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -36026,7 +36026,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -36455,7 +36455,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -36562,7 +36562,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -36694,7 +36694,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -37198,7 +37198,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -37627,7 +37627,7 @@ Page-load performance test suite on Android. The links direct to the actual webs **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ + * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m * **benchmark page**: true @@ -37771,7 +37771,7 @@ These tests aren't used in standard testing, they are only used in the Raptor un **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__ + * **alert on**: `fcp `__, `loadtime `__ * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass @@ -37793,7 +37793,7 @@ These tests aren't used in standard testing, they are only used in the Raptor un **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__ + * **alert on**: `fcp `__, `loadtime `__ * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass @@ -37815,7 +37815,7 @@ These tests aren't used in standard testing, they are only used in the Raptor un **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__ + * **alert on**: `fcp `__, `loadtime `__ * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass @@ -37837,7 +37837,7 @@ These tests aren't used in standard testing, they are only used in the Raptor un **Owner**: PerfTest Team - * **alert on**: `fcp `__, `loadtime `__ + * **alert on**: `fcp `__, `loadtime `__ * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass diff --git a/testing/raptor/raptor/perfdocs/config.yml b/testing/raptor/raptor/perfdocs/config.yml index 723da062877b..b4d61bd10a8a 100644 --- a/testing/raptor/raptor/perfdocs/config.yml +++ b/testing/raptor/raptor/perfdocs/config.yml @@ -12,7 +12,7 @@ metrics: - First Contentful Paint - First Contentful Composite description: > - Denotes the first time the browser performs a paint that has content in it. + Denotes the first time the browser performs a paint that has content in it (in ms). "Youtube Playback Metrics": aliases: - VP9 @@ -20,10 +20,51 @@ metrics: matcher: VP9.*|H264.* description: > Metrics starting with VP9/H264 give the number of frames dropped, and painted. - "In Progress": - aliases: [] - matcher: .* - description: Many metrics have not been documented yet, this is a placeholder. + "First Visual Change": + aliases: + - FirstVisualChange + description: The first visual change detected in the test (in ms). + "Last Visual Change": + aliases: + - LastVisualChange + description: The last visual change detected in the test (in ms). + "Load Time": + aliases: + - loadtime + description: The time it took for the page to complete loading (in ms). + "Largest Contentful Paint": + aliases: + - largestContentfulPaint + - lcp + description: > + The time (in ms) at which the largest piece of content on the page was rendered/painted. + "Speed Index": + aliases: + - SpeedIndex + description: > + A metric used to denote the speed at which a page loaded. Lower values indicate faster + pageloads. Units are in (Visually-Complete x Milliseconds). Calculated by using videos + of the pageload which provide a measure of visual completeness. Visual completeness is + calculated by comparing the histogram of a given frame to the final frame of the pageload. + The SpeedIndex is calculated as the area between the curves of a constant line at y=1, + and the graph of the visual completeness from 0ms to when visual completeness reaches + 100% (or hits the y=1 line). + "Contentful Speed Index": + aliases: + - ContentfulSpeedIndex + description: > + Similar to SpeedIndex, except that it uses the contentfulness of a frame to determine + visual completeness instead of the histogram differences. The contentfulness is determined + by calculating the number of edges found in the frame. A lower number of edges detected + gives a smaller contentfulness value (and a smaller visually complete value). + "Perceptual Speed Index": + aliases: + - PerceptualSpeedIndex + description: > + Similar to SpeedIndex, except that it uses the structural similarity index measure (ssim) + to determine visual completeness. This technique compares the luminance, contrast, and + structure of the frames (a given frame vs. a final frame) to determine the completeness. + suites: desktop: description: "Tests for page-load performance. The links direct to the actual websites that are being tested."