Sleeping a second and increasing the elapsed time by 1,
doesn't mean that exactly a second has been passed-by.
For a better timeout handling the end time has to be
calculated first, and then checked against.
Differential Revision: https://phabricator.services.mozilla.com/D72132
- changed test URL to match the dev server
- changed output.py in several places to fix new test names, dict keys, to cover all tests
- added amazonaws.com to manifest.json file to fix the loading issue for benchmark.js file
- added all raptor tests
- changed the constants for measure and alert_on
Differential Revision: https://phabricator.services.mozilla.com/D62546
This patch adds support for tests metadata. A test script parser is added as
well as a new "doc" flavor that can be used to display the script info in the
command line. This parser will be the basis for building automated docs and
scripts verifications if we want to do this.
Differential Revision: https://phabricator.services.mozilla.com/D72800
Instead of going through every commit, look for a "base_ref" which is
actually a base revision i.e. one that's on a remote head. Then look
for this commit on inbound or central. This should cover all cases except
for when a branch is based on something that was fetched from try in
such a way as to create a remote ref. However that's pretty rare and we
fall back to useful behaviour in that case.
Differential Revision: https://phabricator.services.mozilla.com/D71935
This patch changes how Google Chrome for Android is deployed. Rather than relying on automatic updates, we will use tooltool to download the APK and install it ourselves. Some changes were done in taskcluster to remove a hack that was put in place to disable interal tooltool downloads (the issue is resolved now).
A tooltool manifest is added for this, and to keep ourselves organized, all manifests (including the playback ones) are moved into a folder called `tooltool-manifests`.
Differential Revision: https://phabricator.services.mozilla.com/D72198
Because the web platform test harness doesn't recognize them and annotates them
with `CRITICAL`, which is disconcerting, even though those errors are typically
not harmful.
Differential Revision: https://phabricator.services.mozilla.com/D71485
This test is failing due to the rounding error described in bug 1627365.
As this is a web platform test, it seems inappropriate to modify the
test itself upstream to avoid a Firefox-specific rounding error.
Differential Revision: https://phabricator.services.mozilla.com/D69641
This change will permit the `TestResolver` to add web-platform-tests into the list of supported tests.
Changes:
- add web-platform-test test objects to the list of supported tests.
- adjust value of attributes name, manifest, manifest_relpath.
Differential Revision: https://phabricator.services.mozilla.com/D70727
Initial mach perftest for fenix, gve, fennec cold process applink.
Key metric is processLaunchToNavStart, although the standard navigation metrics are also captured.
Differential Revision: https://phabricator.services.mozilla.com/D72160
When Raptor moves Fennec into the background querying for
the active tab doesn't return any value. To fix that the
current tab id can be cached, which also doesn't require
us to always have to query for the current tab when updating
or closing it.
Differential Revision: https://phabricator.services.mozilla.com/D72033
Split out jsreftest and jittest files into their own packages, removing them
from the common package.
This speeds up extracting files from the common test archive for
non-jsreftest/jittest suites.
Also, remove some files from the web-platform test archive that are already
present in the common archive.
Differential Revision: https://phabricator.services.mozilla.com/D72192
This patch adds the new live site tests to the whitelist so that they can run. It also moves the playback settings back to where it was (before any test name changes) and adds some comments to make sure we're aware of this in the future.
Differential Revision: https://phabricator.services.mozilla.com/D72394
On a local Pixel 2 running Android 10, launching Geckoview test app via the
shell with the profile on external storage hangs and causes an ADBTimeoutError.
Using a profile in /data/local/tests does not exhibit this behavior.
In addition, attempting to push a directory tree directly to internal
storage can fail with "remote secure_mkdirs failed" errors when pushing
directories containing subdirectories to internal storage on /data.
The subdirectories were created with insufficient permissions for the
contents of the directories to be pushed. We can work around this problem
by catching the failure and falling back to using adb push to push the
source directory tree to a temporary location on the sdcard which does
not exhibit the error and then copying the temporary location to the
desired final destination.
These changes are necessary due to the change in Scoped Storage [1]
in Android 10 and later.
Since storing profiles on the sdcard is no longer supported the choices
for possible test roots has been reduced to using internal storage.
Since geckoview expects to be able to store content under /data/local/tmp
the default test root has been changed to /data/local/tmp/tests.
By default, the test root will be shared by all instances of ADBDevice
unless the share_test_root argument is set to False in the initializer.
This allows the test root to be defined globally with out requiring
each instance of ADBDevice to be modified.
The test_root default initial value should be None, not empty string.
The ADBDevice.test_root property is now read/write to support the new
shared test_root functionality.
Android emulators have exhibited an intermittent failure to clear logcat.
A ride-along change to retry the log clearing is included.
adb pull can fail if not all of the files have permission to be read.
This situation can appear when a profile is located on internal storage
and an app such as geckoview writes files to it. They will be readable
only by the app until the permissions are changed. Work around this
by calling chmod -R on any thing that is to be pulled from the device.
Bump mozdevice version to 3.1.2.
[1] https://developer.android.com/training/data-storage#scoped-storage
Differential Revision: https://phabricator.services.mozilla.com/D71722
Modify `writeruntimes` script to support the querying and writing of web-platform-test related runtimes. These are already stored on ActiveData, so it is simply a matter of querying them.
Changes:
- obtain the full list of web-platform-tests runtimes using ActiveData's destination/output clause.
- normalize the paths by prefixing `testing/web-platform` in front of the returned test paths and limiting the paths to depth of 1.
Differential Revision: https://phabricator.services.mozilla.com/D67554
Henrik Skupin
Myeongjun Go
Marian Raiciof
Tarek Ziadé
James Graham
Gregory Mierzwinski
Csoregi Natalia
Nicholas Nethercote
Joel Maher
Bob Clary
Botond Ballo
Florin Strugariu
Mats Palmgren
jayati
Andreea Pavel
Edwin Takahashi
Jan-Ivar Bruaroey
Byron Campen [:bwc]
Tooru Fujisawa
Andrew Creskey
Sylvestre Ledru
Razvan Maries
Bastien Orivel
Chris AtLee
Erik Nordin
sagudev