f94d7e71d8
Bug 1034290 - Use structured log output for test results in reftest, r=jmaher
...
Structured logs bring many benefits. We can stop parsing the logs for magic strings, we
can modify the format without breaking things, and we can stream results into systems like
ActiveData. The structured logs originate primarily in reftest.js. StructuredLog.jsm is
used to generate the JSON-based log stream. Finally OutputHandler in the python harness
reads structured output from stdout, and formats it into human readable form.
MozReview-Commit-ID: G3ZLkMRl6p7
--HG--
extra : commitid : J3ui9XYWR3Q
extra : rebase_source : 77ed0ba842cc8e557141fb3494212b06868c728a
extra : amend_source : 735d48225a2e627e0fe45fc11b50b6c49a885a4b
extra : source : d1779fe421c3c7cd8e3d191816776390dc104f37
2016-02-05 15:44:20 -05:00
66e6da78e6
Back out d1779fe421c3 (bug 1034290) for UnicodeDecodeErrors in things run by the reftest harness
...
CLOSED TREE
2016-02-05 08:18:47 -08:00
8a462fd84b
Bug 1034290 - Use structured log output for test results in reftest, r=jmaher
...
Structured logs bring many benefits. We can stop parsing the logs for magic strings, we
can modify the format without breaking things, and we can stream results into systems like
ActiveData. The structured logs originate primarily in reftest.js. StructuredLog.jsm is
used to generate the JSON-based log stream. Finally OutputHandler in the python harness
reads structured output from stdout, and formats it into human readable form.
--HG--
extra : commitid : J3ui9XYWR3Q
extra : rebase_source : 6bae978126dbd5beddc39332c7cbce0c1354cd87
extra : amend_source : 735d48225a2e627e0fe45fc11b50b6c49a885a4b
2015-10-29 15:01:44 -04:00
88a3456247
Bug 1226554 - [mozlog] bump version to 3.1. r=jgraham
...
--HG--
extra : commitid : IxovQzi5gyE
extra : rebase_source : ae3cf006bba8676cf66edaecd01b30de03bd3c0a
2015-11-20 13:40:24 +01:00
dfdc7dc7de
Bug 1226554 - [mozlog] add a ProxyLogger concept. r=jgraham
...
--HG--
extra : commitid : Ez3CFCMZVYb
extra : rebase_source : f2515b3bf0fc813a3f10613fb8d1bc94878a6e60
2015-11-20 12:42:51 +01:00
e7029d44aa
Bug 1219870 - [mozlog] ensure correct suite state when logging suite_start/suite_end via StructuredLogger.log_raw, r=chmanchester
...
--HG--
extra : commitid : L5aVgE5euqR
extra : rebase_source : 3b7f3b105503a7cc3e0ba8d8c15a85b18a06ce30
2015-10-29 15:11:25 -04:00
0ce48c0f5e
Bug 1185244 - Improve mach support for running mochitests on Valgrind. r=jgraham, njn.
2015-09-28 12:01:42 +02:00
d4897fa1ef
Backed out changeset feceb41f1c3c (bug 1185244) for breaking running tests locally CLOSED TREE a=backout
2015-09-22 17:08:37 -07:00
b3bc139b1e
Bug 1185244 - Improve mach support for running mochitests on Valgrind. r=jgraham, njn.
2015-09-22 12:00:57 +02:00
20cae47299
Bug 1193522 - [mozlog] Use ultrajson instead of stdlib json if available for performance, r=jgraham
...
--HG--
extra : commitid : IQGf0ENQujg
extra : rebase_source : 1d29af9a7871d595952b776998f66bc7c9b41735
2015-08-13 13:37:07 -04:00
6ad9fb9172
Bug 1192024 - Remove the word status from the human readable string of a process exit code in mozlog on Windows. r=jgraham
2015-08-12 00:43:00 -04:00
3cc0515703
Bug 1191267 - Fix mozlog log buffering command line option, r=chmanchester
2015-08-06 11:52:20 +01:00
78ef1c279b
Bug 1186551 - [mozlog] add structured action process_start/process_exit. r=jgraham
...
--HG--
extra : transplant_source : %23%B9%0D%23%93Kf%8F%3F%1A%F5%8DP%97%AA%81%8D%1C%8D%7E
2015-07-22 21:00:25 +02:00
2b977b797d
Bug 1186888 - [mozlog] Ability to use a pre-existing logger with commandline.setup_logging(), r=jgraham
...
--HG--
extra : commitid : 786tOojSwTl
extra : rebase_source : 3df091de3afee6838a40c0c858da97fd04b32739
extra : amend_source : 5a5ea71fd9a8ede744d281cb0b2dae190575230d
2015-07-22 15:27:31 -04:00
2be5ff0c10
Bug 1014760 - Move mozlog.structured to mozlog; Move mozlog to mozlog.unstructured, r=jgraham
...
Mozlog currently has two implementations. The top level package is based on the logging module and is
deprecated. The newer structured logging implementation lives in mozlog.structured. This patch swaps the
two, so the top level mozlog module contains the recommended implementation, while mozlog.unstructured
contains the old one.
--HG--
rename : testing/mozbase/docs/mozlog_structured.rst => testing/mozbase/docs/mozlog.rst
rename : testing/mozbase/mozlog/mozlog/structured/commandline.py => testing/mozbase/mozlog/mozlog/commandline.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/__init__.py => testing/mozbase/mozlog/mozlog/formatters/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/base.py => testing/mozbase/mozlog/mozlog/formatters/base.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/errorsummary.py => testing/mozbase/mozlog/mozlog/formatters/errorsummary.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/__init__.py => testing/mozbase/mozlog/mozlog/formatters/html/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/html.py => testing/mozbase/mozlog/mozlog/formatters/html/html.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/main.js => testing/mozbase/mozlog/mozlog/formatters/html/main.js
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/style.css => testing/mozbase/mozlog/mozlog/formatters/html/style.css
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/xmlgen.py => testing/mozbase/mozlog/mozlog/formatters/html/xmlgen.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/machformatter.py => testing/mozbase/mozlog/mozlog/formatters/machformatter.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/tbplformatter.py => testing/mozbase/mozlog/mozlog/formatters/tbplformatter.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/unittest.py => testing/mozbase/mozlog/mozlog/formatters/unittest.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/xunit.py => testing/mozbase/mozlog/mozlog/formatters/xunit.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/__init__.py => testing/mozbase/mozlog/mozlog/handlers/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/base.py => testing/mozbase/mozlog/mozlog/handlers/base.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/bufferhandler.py => testing/mozbase/mozlog/mozlog/handlers/bufferhandler.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/statushandler.py => testing/mozbase/mozlog/mozlog/handlers/statushandler.py
rename : testing/mozbase/mozlog/mozlog/structured/logtypes.py => testing/mozbase/mozlog/mozlog/logtypes.py
rename : testing/mozbase/mozlog/mozlog/structured/reader.py => testing/mozbase/mozlog/mozlog/reader.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/__init__.py => testing/mozbase/mozlog/mozlog/scripts/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/format.py => testing/mozbase/mozlog/mozlog/scripts/format.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/logmerge.py => testing/mozbase/mozlog/mozlog/scripts/logmerge.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/unstable.py => testing/mozbase/mozlog/mozlog/scripts/unstable.py
rename : testing/mozbase/mozlog/mozlog/structured/stdadapter.py => testing/mozbase/mozlog/mozlog/stdadapter.py
rename : testing/mozbase/mozlog/mozlog/structured/structuredlog.py => testing/mozbase/mozlog/mozlog/structuredlog.py
rename : testing/mozbase/mozlog/mozlog/logger.py => testing/mozbase/mozlog/mozlog/unstructured/logger.py
rename : testing/mozbase/mozlog/mozlog/loggingmixin.py => testing/mozbase/mozlog/mozlog/unstructured/loggingmixin.py
rename : testing/mozbase/mozlog/mozlog/loglistener.py => testing/mozbase/mozlog/mozlog/unstructured/loglistener.py
extra : commitid : 3JWk75JY4N0
extra : rebase_source : 229bad7a7bf8ead013ce62d128c0896a75cad393
2015-07-16 10:38:40 -04:00
0b0e2d0aaf
Bug 1177630 - Add formatter to mozlog for producing a machine readable error summary, r=chmanchester
...
--HG--
extra : commitid : FeIqwyCNz06
extra : rebase_source : 32141de7decef684b241e674d02a709b5f87f09f
2015-07-08 11:32:57 +01:00
43a3f73c63
Bug 1171849 Let consumers override mozlog default formatter options, r=chmanchester
2015-06-05 17:48:06 +01:00
e07b9de9bf
Bug 1171032 - Log raw messages at debug level by default, r=chmanchester
...
Also add --log-raw-level option to control this.
--HG--
extra : rebase_source : 9cb319c94b3f6b5e88bdc514dd0e22dc56277d85
2015-06-03 15:55:00 +01:00
f10df76074
Bug 1170591 - Remove trailing whitespace in mozlog. r=jdm
2015-06-02 11:30:00 -04:00
c1f14290e2
Bug 1160324 - Handle missing robocopApk files in runtestsremote.py. r=gbrown
...
--HG--
extra : source : 7d8043298e133ab903b55ba9c8530b2ea28a3180
2015-04-30 14:28:14 -07:00
66b928b10a
Bug 1154111 - Colorize SKIP in test logs. r=jgraham
...
--HG--
extra : rebase_source : ca0862950be526bda05711c369cef38b0d2a516c
2015-04-13 23:18:00 +02:00
729813836c
Bug 1146292 - [mozlog] Bump version to 2.11. r=jgraham
2015-03-23 11:00:58 +00:00
5bf31af53c
Bug 1132409 - [mozlog] Create directories for log specified on the command line if not present. r=jgraham
...
--HG--
extra : rebase_source : f895f820c97796573a665ecc28358931700b0c43
2015-03-06 06:17:00 -05:00
2756b8c420
Bug 1066643 - [mozlog] Allow users of mozlog's command line options to exclude inappropriate log types. r=jgraham
2015-02-24 14:01:00 -05:00
ecf2ab744f
Bug 1132076 - [mozlog] Incorrect skip count in HTML log summary. r=davehunt
2015-02-11 09:19:00 -05:00
bc64a1699e
Bug 1129495 - [mozlog] Add optional 'path' attribute to test_start, r=jgraham
...
--HG--
extra : rebase_source : d26387e9674a97c4571d29ee80e0e00609ed2a72
2015-02-10 17:11:35 -05:00
9cb2cd3d6f
Bug 1130358 - [mozlog] Bump version to 2.10. r=jgraham
2015-02-06 04:47:00 -05:00
337d9012ea
Bug 1016929 - [mozlog] html formatter imports py.xml, doesn't declare it as a dependency. r=jgraham
...
--HG--
extra : rebase_source : 249b6ee7f576ce466f77fc063fef4c7fddffa9ec
2015-02-04 09:54:00 +01:00
2d6f742885
Bug 1103945 - Add command line tool to merge multiple raw structured logs, r=jgraham
...
--HG--
extra : rebase_source : e2e07270a584c61bc01d6e68d7bf4e3ff9a451e2
2015-02-02 20:13:50 +01:00
7c60600fd9
Bug 1118738 - Fix HTML report colours for expected skips and unexpected errors. r=jgraham
2015-01-07 06:36:00 -05:00
ae85f164f2
Bug 1065406 - [mozlog] Split test class and name for XUnit formatter. r=jgraham
2014-12-16 16:02:00 +01:00
f2b16bc10f
No bug - Bump the mozlog package version; rs=jgraham
2014-12-19 11:27:28 +01:00
de702b2126
Bug 1113095 - Handle failing reftests in machformatter's summarizing code; r=jgraham
2014-12-19 11:25:51 +01:00
11a1ff5261
Bug 1055765 - Implement log buffering as a handler in mozlog.;r=jgraham
2014-12-12 12:08:31 -05:00
e93266931a
Bug 1065390 - [mozlog] various minor improvements of XUnit structured formatter; r=jgraham
2014-10-20 14:35:00 +02:00
26505efb5a
Bug 1103905 - Bump version number of mozlog, r=davehunt
2014-11-24 12:56:32 +00:00
9526da9ec9
Bug 1098404 - Implement per-component filters for mozlog, r=chmanchester
...
This allows individual component loggers to e.g. discard all messages below a
set level, or rewrite messages from one level to another.
--HG--
extra : rebase_source : 9b37981368edb099ac555a2dacfafd486f8fcd2d
extra : histedit_source : 144d17f582944703b07529e31bf13b845d5f9695%2C706e2b7db06a1217d0e956614f0232c153a6a3d0
2014-11-21 11:43:54 +00:00
6ae8df7d8d
Bug 1073093 - [mozlog] make sure formatter wasn't removed from defaults before adding commandline option for it, r=chmanchester
...
--HG--
extra : rebase_source : 3357bbf0ea607a07111b6aa5258d0476c782f824
2014-11-14 09:23:22 -05:00
807b164e44
Bug 1097901 - Improve structured log example + docs;r=jgraham DONTBUILD
2014-11-13 16:45:43 -05:00
bbdbda2391
Bug 1090485 - Fix mozlog's commandline to accept file arguments for a formatter that is also the stdout default.;r=jgraham
2014-10-28 17:03:20 -04:00
cbf6fb7b78
Bug 1087250 - [mozlog] Bump version number to 0.27. r=wlachance
2014-11-06 08:57:26 +00:00
ac79da7488
Bug 1090148 - [mozlog] Remove test class from HTML formatter. r=cmanchester
2014-11-05 10:44:19 +00:00
1438f1530b
Bug 945706 - [mozlog] logger.exception() calls do not add exception information to the output; r=wlach
2014-11-03 11:26:11 -05:00
f361b4e1ec
Bug 1091413 - Refrain from printing the command args with each call to process_output in mozlog's machformatter;r=jgraham
2014-10-30 11:37:22 -04:00
52453853a0
Bug 1090733 - xpcshell tests fail if no terminal configured. r=chmanchester
2014-10-30 12:13:34 +11:00
706c1d8dec
Bug 1087248 - [mozlog] Fix encoding for debug in HTML formatter such as page source. r=jgraham
2014-10-27 05:55:00 +01:00
4baf8b2325
Bug 1087244 - [mozlog] Fix screenshot links in the HTML formatter. r=jgraham
2014-10-22 07:02:00 +02:00
39c02cf75c
Bug 1065402 - Include environment details in HTML formatter. r=jgraham
2014-10-22 06:01:00 -04:00
b7b2dc40de
Bug 1079635 - Implement a verbose option for the machformatter for those debugging tests locally.;r=jgraham
2014-10-17 11:59:15 -04:00
a0be7e74a4
Bug 1066785 - Log a summary of expected and unexpected statuses in the mozlog StatusHandler summary.;r=jgraham
2014-10-17 11:59:02 -04:00
Andrew Halberstadt
Phil Ringnalda
Julien Pagès
Julian Seward
Wes Kocher
James Graham
Manish Goregaokar
Nick Alexander
Hiroyuki Ikezoe
Dave Hunt
Maciek
Ms2ger
Chris Manchester
William Lachance
Mark Hammond
Dave Hunt