gecko-dev/layout/tools
Geoff Brown fc3f08846e Bug 1596567 - Normalize test ids for reftests, crashtests, and jsreftests; r=ahal,jmaher
Use test identifiers that look like posix-compliant relative file paths rather than URLs; identifier "paths" are relative to topsrcdir -- an intuitive, brief mapping from identifier to test file.

This patch adds (expands) a --topsrcdir option to runreftest.py and updates CI configuration to set it appropriately. runreftest.py calculates a manifest ID, a path relative to topsrcdir, for each requested manifest and passes those manifest IDs to manifest.jsm. In manifest.jsm, a new manifest ID is generated when a manifest is included from a new directory. Test identifiers are generated by adding the test file name to the manifest ID.

Examples (url -> identifier):

  - file:///builds/worker/workspace/build/tests/reftest/tests/dom/svg/crashtests/398926-fill.svg -> dom/svg/crashtests/398926-fill.svg
  - file:///Z:/task_1577755655/build/tests/reftest/tests/dom/svg/crashtests/398926-fill.svg -> dom/svg/crashtests/398926-fill.svg
  - http://10.7.205.207:8854/tests/dom/svg/crashtests/398926-fill.svg -> dom/svg/crashtests/398926-fill.svg
  - file:///builds/worker/workspace/build/tests/jsreftest/tests/js/src/tests/jsreftest.html?test=test262/built-ins/Array/prototype/indexOf/15.4.4.14-9-b-i-31.js -> js/src/tests/test262/built-ins/Array/prototype/indexOf/15.4.4.14-9-b-i-31.js
  - chrome://reftest/content/bugs/299837-2.xhtml -> layout/reftests/bugs/299837-2.xhtml
  - http://localhost:36067/1577754972876/1/289480.html#top -> layout/reftests/bugs/289480.html#top
  - about:blank -> about:blank
  - data:text/html,<body> -> data:text/html,<body>

Differential Revision: https://phabricator.services.mozilla.com/D58415

--HG--
extra : moz-landing-system : lando
2020-01-09 19:25:58 +00:00
..
layout-debug Bug 1602767 - Make layout debugger's paged mode use the same setup as reftest-paged. r=heycam 2019-12-11 03:46:58 +00:00
recording Bug 1596884, replace remaining .xul files in layout/tools with .xhtml r=dholbert 2019-11-20 20:40:32 +00:00
reftest Bug 1596567 - Normalize test ids for reftests, crashtests, and jsreftests; r=ahal,jmaher 2020-01-09 19:25:58 +00:00
tests