Граф коммитов

89 Коммитов

Автор SHA1 Сообщение Дата
Geoff Brown 839ad41abf Bug 1319196 - Call dumpsys less during Android tests; r=jmaher
Android tests use dumpsys to determine the current "top activity";
if Firefox is not in the foreground, tests are considered complete.
But dumpsys is heavy-weight and can fail, for reasons unknown. With
this patch, test harnesses continue to use dumpsys to determine the
top activity, but call it much less often: If the harness has just
received new test output, the harness assumes that tests are in
progress and does not check the top activity.
2017-01-06 16:35:29 -07:00
Geoff Brown d1584879a8 Bug 1319196 - Take screenshot when dumpsys fails; r=jmaher 2016-12-13 11:28:06 -07:00
Geoff Brown 094fe98143 Bug 1309436 - Add test name to java-exception failure messages; r=ted 2016-10-26 11:31:41 -06:00
Geoff Brown 306a94e967 Bug 1290114 - Make Android test logging more responsive; r=ahal 2016-07-29 08:29:53 -06:00
Michael Comella af565b6cbb Bug 1277214 - Move MOZ_DISABLE_* to single MOZ_IN_AUTOMATION env var. r=grisha
We hit an issue where adding a new env var, MOZ_DISABLE_TELEMETRY, added env10
and caused crashes. I suspect the issue is that there are is now a double-digit
number of env vars (bug 1277390). Here, we do the quick fix by removing
MOZ_DISABLE_TELEMETRY & repurposing MOZ_DISABLE_SWITCHBOARD to be generic.

While we're at it, we simplify the code by making the setDisabled methods a
strict getter without checking for how many times they're called.

MozReview-Commit-ID: 19DDbVYRZ2

--HG--
extra : rebase_source : 1590ae4f49bf725ab8a3bb26f10dab324903aa8c
2016-06-01 16:46:44 -07:00
Michael Comella 1e85dedec9 Bug 1270191 - Disable telemetry upload during tests. r=grisha
MozReview-Commit-ID: GoQQRfGRvd4

--HG--
extra : rebase_source : c2d56638e078012766e8f7c9b64de6d3988e6dbc
2016-05-31 17:04:40 -07:00
Andrew Halberstadt 6e6c1c8aae Bug 1245092 - Install reftest and specialpowers extensions at runtime via AddonManager.installTemporaryAddon, r=jgriffin
MozReview-Commit-ID: 5HSa3nFVTeF

--HG--
rename : layout/tools/reftest/reftest.js => layout/tools/reftest/reftest.jsm
extra : rebase_source : 924a3e937b47cac03674acdb56334882a2373f50
2016-03-09 14:38:13 -05:00
Margaret Leibovic e0825d6416 Bug 1247324 - Disable Switchboard in automation. r=gbrown,mfinkle
MozReview-Commit-ID: ItqHBIEdD0Q

--HG--
extra : rebase_source : 639eebe0ee5854beef82695729d73dc001af8fac
2016-02-18 12:03:51 -05:00
Andrew Halberstadt dee8b08ce5 Bug 1231784 - Install specialpowers and mochikit extensions at runtime via AddonManager.loadTemporaryAddon(), r=jgriffin
MozReview-Commit-ID: 9I56x6Vnbf7

--HG--
rename : testing/mochitest/b2g_start_script.js => testing/mochitest/start_b2g.js
extra : commitid : CrUflHO8tRa
extra : rebase_source : c50792dfe82e688b52aa07150ddab03e5d0d3f36
extra : amend_source : 1dcd8ae7d74b3397e965672b6dc05d431ab4a916
extra : source : edcbd7c0aa36be0846f2e8e989fb57c9e4449cc4
2016-01-25 09:55:57 -05:00
Andrew Halberstadt 97c3a77bc1 Bug 1247054 - Fix |mach reftest| on Android, r=gbrown
There is an ImportError on Android, as well as a log related
regression from the structured log patch once that is fixed.

MozReview-Commit-ID: KxSEotr38qO

--HG--
extra : rebase_source : 15d8421aab813d9e0dbf6d00611f921aaa779a49
2016-02-09 16:19:44 -05:00
Andrew Halberstadt f94d7e71d8 Bug 1034290 - Use structured log output for test results in reftest, r=jmaher
Structured logs bring many benefits. We can stop parsing the logs for magic strings, we
can modify the format without breaking things, and we can stream results into systems like
ActiveData. The structured logs originate primarily in reftest.js. StructuredLog.jsm is
used to generate the JSON-based log stream. Finally OutputHandler in the python harness
reads structured output from stdout, and formats it into human readable form.

MozReview-Commit-ID: G3ZLkMRl6p7

--HG--
extra : commitid : J3ui9XYWR3Q
extra : rebase_source : 77ed0ba842cc8e557141fb3494212b06868c728a
extra : amend_source : 735d48225a2e627e0fe45fc11b50b6c49a885a4b
extra : source : d1779fe421c3c7cd8e3d191816776390dc104f37
2016-02-05 15:44:20 -05:00
Phil Ringnalda 66e6da78e6 Back out d1779fe421c3 (bug 1034290) for UnicodeDecodeErrors in things run by the reftest harness
CLOSED TREE
2016-02-05 08:18:47 -08:00
Andrew Halberstadt 8a462fd84b Bug 1034290 - Use structured log output for test results in reftest, r=jmaher
Structured logs bring many benefits. We can stop parsing the logs for magic strings, we
can modify the format without breaking things, and we can stream results into systems like
ActiveData. The structured logs originate primarily in reftest.js. StructuredLog.jsm is
used to generate the JSON-based log stream. Finally OutputHandler in the python harness
reads structured output from stdout, and formats it into human readable form.

--HG--
extra : commitid : J3ui9XYWR3Q
extra : rebase_source : 6bae978126dbd5beddc39332c7cbce0c1354cd87
extra : amend_source : 735d48225a2e627e0fe45fc11b50b6c49a885a4b
2015-10-29 15:01:44 -04:00
Wes Kocher aaf89c475e Backed out 3 changesets (bug 1231784) for breaking 10.10 opt jetpack tests
Backed out changeset 653df21ca861 (bug 1231784)
Backed out changeset 0aac20bc3619 (bug 1231784)
Backed out changeset edcbd7c0aa36 (bug 1231784)

--HG--
rename : testing/mochitest/start_b2g.js => testing/mochitest/b2g_start_script.js
extra : commitid : DLurSs6PJ1G
2016-02-03 17:38:12 -08:00
Andrew Halberstadt ae410fb5a9 Bug 1231784 - Install specialpowers and mochikit extensions at runtime via AddonManager.loadTemporaryAddon(), r=jgriffin
--HG--
rename : testing/mochitest/b2g_start_script.js => testing/mochitest/start_b2g.js
extra : commitid : CrUflHO8tRa
extra : rebase_source : 0a041c36b59c79c1bea755b22fe07017cb3d0aa5
extra : amend_source : 1dcd8ae7d74b3397e965672b6dc05d431ab4a916
2016-01-25 09:55:57 -05:00
Geoff Brown b0a570ab95 Bug 1156425 - Allow Android test jobs to run for up to 90 minutes; r=RyanVM 2015-08-27 11:29:00 -06:00
Andrew Halberstadt 2be5ff0c10 Bug 1014760 - Move mozlog.structured to mozlog; Move mozlog to mozlog.unstructured, r=jgraham
Mozlog currently has two implementations. The top level package is based on the logging module and is
deprecated. The newer structured logging implementation lives in mozlog.structured. This patch swaps the
two, so the top level mozlog module contains the recommended implementation, while mozlog.unstructured
contains the old one.

--HG--
rename : testing/mozbase/docs/mozlog_structured.rst => testing/mozbase/docs/mozlog.rst
rename : testing/mozbase/mozlog/mozlog/structured/commandline.py => testing/mozbase/mozlog/mozlog/commandline.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/__init__.py => testing/mozbase/mozlog/mozlog/formatters/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/base.py => testing/mozbase/mozlog/mozlog/formatters/base.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/errorsummary.py => testing/mozbase/mozlog/mozlog/formatters/errorsummary.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/__init__.py => testing/mozbase/mozlog/mozlog/formatters/html/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/html.py => testing/mozbase/mozlog/mozlog/formatters/html/html.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/main.js => testing/mozbase/mozlog/mozlog/formatters/html/main.js
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/style.css => testing/mozbase/mozlog/mozlog/formatters/html/style.css
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/xmlgen.py => testing/mozbase/mozlog/mozlog/formatters/html/xmlgen.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/machformatter.py => testing/mozbase/mozlog/mozlog/formatters/machformatter.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/tbplformatter.py => testing/mozbase/mozlog/mozlog/formatters/tbplformatter.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/unittest.py => testing/mozbase/mozlog/mozlog/formatters/unittest.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/xunit.py => testing/mozbase/mozlog/mozlog/formatters/xunit.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/__init__.py => testing/mozbase/mozlog/mozlog/handlers/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/base.py => testing/mozbase/mozlog/mozlog/handlers/base.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/bufferhandler.py => testing/mozbase/mozlog/mozlog/handlers/bufferhandler.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/statushandler.py => testing/mozbase/mozlog/mozlog/handlers/statushandler.py
rename : testing/mozbase/mozlog/mozlog/structured/logtypes.py => testing/mozbase/mozlog/mozlog/logtypes.py
rename : testing/mozbase/mozlog/mozlog/structured/reader.py => testing/mozbase/mozlog/mozlog/reader.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/__init__.py => testing/mozbase/mozlog/mozlog/scripts/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/format.py => testing/mozbase/mozlog/mozlog/scripts/format.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/logmerge.py => testing/mozbase/mozlog/mozlog/scripts/logmerge.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/unstable.py => testing/mozbase/mozlog/mozlog/scripts/unstable.py
rename : testing/mozbase/mozlog/mozlog/structured/stdadapter.py => testing/mozbase/mozlog/mozlog/stdadapter.py
rename : testing/mozbase/mozlog/mozlog/structured/structuredlog.py => testing/mozbase/mozlog/mozlog/structuredlog.py
rename : testing/mozbase/mozlog/mozlog/logger.py => testing/mozbase/mozlog/mozlog/unstructured/logger.py
rename : testing/mozbase/mozlog/mozlog/loggingmixin.py => testing/mozbase/mozlog/mozlog/unstructured/loggingmixin.py
rename : testing/mozbase/mozlog/mozlog/loglistener.py => testing/mozbase/mozlog/mozlog/unstructured/loglistener.py
extra : commitid : 3JWk75JY4N0
extra : rebase_source : 229bad7a7bf8ead013ce62d128c0896a75cad393
2015-07-16 10:38:40 -04:00
Geoff Brown 65e4c8cee0 Bug 1179981 - A new test harness for robocop; r=jmaher 2015-07-09 12:30:01 -06:00
Geoff Brown a9b255a8eb Bug 1175540 - Reduce timeouts for many adb devicemanager calls; r=mcote 2015-06-21 13:58:34 -06:00
Nick Alexander 97786c5695 Bug 1169476 -- Implement |mach robocop --serve|. r=gbrown
This adds a flag to |mach robocop| that does everything to run a
Robocop test except launch the actual test.  Instead of launching the
test, it starts the mochi.test server and launches Fennec with a test
profile; then it sits and waits forever.

This allows regular Java IDEs (IntelliJ, but previously Eclipse) to
run Robocop tests like regular instrumentation tests, "injecting" them
into the prepared testing environment.  It's quite nice!

--HG--
extra : rebase_source : a5ab08222110a20291aebe70ef1fda0d340dbe7d
extra : source : e91ac9a35f86928fcd519911476ee7d68d06f921
2015-05-29 17:18:07 -07:00
Carsten "Tomcat" Book a723ed3ad7 Backed out changeset e91ac9a35f86 (bug 1169476) for android rc2 crashes 2015-06-01 09:38:42 +02:00
Nick Alexander f242708503 Bug 1169476 -- Implement |mach robocop --serve|. r=gbrown
This adds a flag to |mach robocop| that does everything to run a
Robocop test except launch the actual test.  Instead of launching the
test, it starts the mochi.test server and launches Fennec with a test
profile; then it sits and waits forever.

This allows regular Java IDEs (IntelliJ, but previously Eclipse) to
run Robocop tests like regular instrumentation tests, "injecting" them
into the prepared testing environment.  It's quite nice!

--HG--
extra : rebase_source : 15e9e8d5c311312e2eb317936e5d154237c1f9a3
extra : histedit_source : 050ac958ae8580f45e5011a0d353bf13e65d5ff3
2015-05-25 14:27:21 -07:00
Geoff Brown 51f4882b20 Bug 1156425 - Allow Android test jobs to run for up to 75 minutes; r=ryanvm 2015-05-04 10:32:46 -06:00
Geoff Brown baa77da218 Bug 1160393 - Enable webrtc logging for android; r=bwc 2015-05-01 16:34:36 -06:00
Geoff Brown 7d7b8dc617 Bug 1156422 - Improve robustness of logcat collection in checkForCrashes; r=bc
--HG--
extra : rebase_source : ab02b6f2c7007a42c4205ff5f1d41db4da7b134a
2015-04-21 16:44:42 -06:00
Nicholas Nethercote 98688c1a41 Bug 1100851 - Tweak DMD to account for the fact that $DMD can now be undefined. r=glandium.
Now that defining $DMD is no longer necessary to run DMD, this patch does the
following.
- Removes all the places where we set DMD=1 (test harnesses, etc.)
- Still handles DMD=1, for backwards compatibility.
- Prints "$DMD is undefined" at DMD start-up if appropriate.
- Writes a |null| value for |dmdEnvVar| in the JSON if $DMD is undefined. Bumps
  the DMD output version number accordingly.
- Changes a bunch of the test files accordingly, including changing the mode of
  script-ignore-alloc-fns.json in order to test a case where $DMD is undefined.

--HG--
extra : rebase_source : eb1ef5722410734ce6d7658465ff6f442ee4ed49
2014-11-27 21:04:46 -08:00
Chris Manchester 7a035febd4 Bug 1068429 - Log crashes with structured logging for those using structured logging.;r=ahal 2014-09-23 20:33:31 -04:00
Nils Ohlmeier [:drno] 7204b2e48f Bug 1049688 - Allow override of MOZ_DISABLE_NONLOCAL_CONNECTIONS. r=froydnj 2014-09-22 09:48:00 -04:00
Nick Alexander dd621202b1 Bug 874729 - Part 1: Swallow IOErrors when pulling ANR traces. r=jmaher
On my local testing devices, |adb pull| complains about not being able
to read /data/anr/traces.txt but the command succeeds.  The subsequent
local file read produces an IOError.  This ignores that exception.
2014-09-08 16:23:10 -07:00
Geoff Brown 8c277a965f Bug 1042097 - Upload Android tombstones to blobber; r=dminor 2014-08-11 11:55:28 -06:00
Ahmed Kachkach af98d35b3f Bug 1034267 - Structured Logging for robocop. r=gbrown 2014-07-29 14:11:00 +02:00
Ahmed Kachkach 4b03d2c025 Bug 886570 - Initial integration of structured logs in mochitest; r=ahal,Ms2ger 2014-07-17 09:02:00 +02:00
Carsten "Tomcat" Book ce57787693 Backed out changeset cf85693280c7 (bug 886570) frequent mochitest-3 errors on windows 2014-07-11 14:15:29 +02:00
Ahmed Kachkach 50db9012f6 Bug 886570 - Initial integration of structured logs in mochitest. r=ahal,Ms2ger 2014-07-10 13:33:00 +02:00
Geoff Brown b4e0468ee6 Bug 1027802 - Try to get ANR report and stack trace when Fennec hangs; r=jmaher 2014-07-03 22:11:41 -06:00
Andrew McCreight a7fbd0d3c2 Bug 988041 - Enable LeakSanitizer for Mochitests. r=jmaher 2014-06-20 09:08:30 -07:00
Nathan Froyd b6301f2928 Bug 995417 - part 2 - testing infrastructure changes to set MOZ_DISABLE_NONLOCAL_CONNECTIONS; r=jmaher 2014-06-17 10:49:57 -04:00
Jim Chen 123716de41 Bug 999071 - Empty ANR file during testing instead of deleting it; r=gbrown 2014-04-28 22:20:52 -04:00
Wes Kocher d477a31fd8 Backed out 3 changesets (bug 999071) for Android rc1 failures
Backed out changeset ddf970be0abd (bug 999071)
Backed out changeset 8d2738b22275 (bug 999071)
Backed out changeset b82a8c50aa90 (bug 999071)
2014-04-24 18:12:46 -07:00
Jim Chen 3d4010b681 Bug 999071 - Empty ANR file during testing instead of deleting it; r=gbrown 2014-04-24 17:49:02 -04:00
William Lachance d407cd825b Bug 996862 - Remove use of mozdevice's networktools. r=ahal 2014-04-21 11:03:51 -04:00
Geoff Brown 09985b3f13 Bug 960265 - Add no-output timeouts for Android tests; r=jmaher 2014-02-02 08:11:23 -07:00
Geoff Brown 24a1d2d443 Bug 963838 - Pass correct app name to automation in Android tests; r=jmaher 2014-02-02 08:11:22 -07:00
Nathan Froyd 0f8ca584d8 Bug 938289 - part 1 - add automation support for adding DMD environment variables; r=jmaher 2013-11-13 14:47:41 -05:00
Ted Mielczarek 0cf4101913 bug 914925 - fix --debugger for mochitest on OS X. r=jmaher 2013-09-16 14:44:25 -04:00
Geoff Brown 162d081060 Bug 892118 - Suppress annoying Android x86 emu logcat message; r=jmaher 2013-11-17 10:23:15 -07:00
Ed Morley f98bbcdd4c Bug 923513 - Make remoteautomation.py use the new mozcrash check_for_java_exception(); r=jmaher 2013-10-16 16:18:29 +01:00
Dan Minor (dminor@mozilla.com) 43e5e1cb99 Bug 881897: Reduce frequency of polling in remoteautomation.py; r=jmaher 2013-06-28 07:49:53 -04:00
Ed Morley e50a23d3d6 Bug 872507 - Tweak logcat java-exception regex to strip more whitespace; r=jmaher 2013-05-17 12:42:02 +01:00
Geoff Brown 79a1c821af Bug 872244 - Dump ANR stack traces after Android tests; r=jmaher 2013-05-16 14:32:52 -06:00