gecko-dev/testing/marionette
Andrew Halberstadt f79b06a32a Bug 1339178 - Use pytest to run python-tests, r=davehunt
This switches most tests over to use pytest as the runner instead of unittest (taking
advantage of the fact that pytest can run unittest based tests).

There were a couple tests that had failures when swithing to pytest:
config/tests/unit-expandlibs.py
xpcom/idl-parser/xpidl/runtests.py

For these tests, I added a runwith='unittest' argument so that they still run the
same way as before. Once we fix them to use pytest, the unittest logic in mozunit.py
can be deleted.

MozReview-Commit-ID: Gcsz6z8MeOi

--HG--
extra : rebase_source : 3c762422ce0af54cbbe7d9fc20085a2d1ebe7057
2017-08-29 14:50:33 -04:00
..
chrome
client Bug 1395126 - Support cascading configuration for flake8, r=bc 2017-08-29 17:32:31 -04:00
components Bug 1391952 - Disable camel case lint for input and output. r=automatedtester 2017-08-19 14:21:43 +01:00
doc Bug 1385484 - Ensure that login reputation checks are disabled in tests. r=hchang 2017-08-22 17:56:20 -07:00
harness Bug 1339178 - Use pytest to run python-tests, r=davehunt 2017-08-29 14:50:33 -04:00
prefs Bug 1376128 - Expose unrecognised eslint globals; r=automatedtester 2017-06-28 11:04:14 -07:00
puppeteer Bug 1395126 - Support cascading configuration for flake8, r=bc 2017-08-29 17:32:31 -04:00
.eslintrc.js Bug 1395176 - Add eslint rule that forbids use of var. r=automatedtester 2017-08-30 17:36:56 +01:00
.jsdoc.js Bug 1384517 - Provide jsdoc rules for testing/marionette; r=automatedtester 2017-07-26 13:09:15 +01:00
README.html Bug 1384517 - Render Marionette README as HTML; r=automatedtester 2017-07-26 13:08:17 +01:00
accessibility.js Bug 1384517 - Fix testing/marionette API docs; r=automatedtester 2017-07-26 13:11:53 +01:00
action.js Bug 1394849 - Export pprint separately. r=automatedtester 2017-08-29 17:33:38 +01:00
addon.js Bug 1384517 - Fix testing/marionette API docs; r=automatedtester 2017-07-26 13:11:53 +01:00
assert.js Bug 1394849 - Export pprint separately. r=automatedtester 2017-08-29 17:33:38 +01:00
atom.js Bug 1384517 - Fix testing/marionette API docs; r=automatedtester 2017-07-26 13:11:53 +01:00
browser.js Bug 1392339 - Fix misuse of nsIDOMWindow in API docs. r=automatedtester 2017-08-21 18:52:18 +01:00
capture.js Bug 1384517 - Fix testing/marionette API docs; r=automatedtester 2017-07-26 13:11:53 +01:00
cert.js Bug 1384517 - Fix testing/marionette API docs; r=automatedtester 2017-07-26 13:11:53 +01:00
cookie.js Bug 1394849 - Export pprint separately. r=automatedtester 2017-08-29 17:33:38 +01:00
driver.js Bug 1395176 - Lint testing/marionette for var usage. r=automatedtester 2017-08-30 17:38:23 +01:00
element.js Bug 1394849 - Export pprint separately. r=automatedtester 2017-08-29 17:33:38 +01:00
error.js Bug 1394849 - Add error.stack to create stacktraces. r=automatedtester 2017-08-29 17:34:37 +01:00
evaluate.js Bug 1394881 - Use Node.isConnected for web element staleness check. r=automatedtester 2017-08-30 14:22:39 +01:00
event.js Bug 1395176 - Lint testing/marionette for var usage. r=automatedtester 2017-08-30 17:38:23 +01:00
frame.js Bug 1395176 - Use scoped remoteFrames instead of global. r=automatedtester 2017-08-30 17:37:33 +01:00
interaction.js Bug 1394849 - Export pprint separately. r=automatedtester 2017-08-29 17:33:38 +01:00
jar.mn Bug 1363428 - Add reftest-specific endpoints to Marionette, r=ato 2017-06-24 12:03:11 +01:00
l10n.js Bug 1385547 - Lint testing/marionette. r=automatedtester 2017-07-31 16:01:12 +01:00
legacyaction.js Bug 1394881 - Use Node.isConnected for web element staleness check. r=automatedtester 2017-08-30 14:22:39 +01:00
listener.js Bug 1395176 - Lint testing/marionette for var usage. r=automatedtester 2017-08-30 17:38:23 +01:00
mach_commands.py Bug 1390595 - Exit with jsdoc return code from "mach marionette doc". r=whimboo 2017-08-15 20:00:42 +01:00
mach_test_package_commands.py
message.js Bug 1395176 - Lint testing/marionette for var usage. r=automatedtester 2017-08-30 17:38:23 +01:00
modal.js Bug 1384517 - Fix testing/marionette API docs; r=automatedtester 2017-07-26 13:11:53 +01:00
moz.build
navigate.js Bug 1384517 - Fix testing/marionette API docs; r=automatedtester 2017-07-26 13:11:53 +01:00
packets.js Bug 1385547 - Lint testing/marionette. r=automatedtester 2017-07-31 16:01:12 +01:00
proxy.js Bug 1395176 - Lint testing/marionette for var usage. r=automatedtester 2017-08-30 17:38:23 +01:00
reftest.js Bug 1391952 - Lint testing/marionette. r=automatedtester 2017-08-19 14:22:17 +01:00
reftest.xul Bug 1363428 - Add reftest-specific endpoints to Marionette, r=ato 2017-06-24 12:03:11 +01:00
server.js Bug 1385484 - Ensure that login reputation checks are disabled in tests. r=hchang 2017-08-22 17:56:20 -07:00
session.js Bug 1369827 - Fix socksVersion key in proxy capabilities. r=ato 2017-08-23 11:47:01 +02:00
stream-utils.js Bug 1385547 - Lint testing/marionette. r=automatedtester 2017-07-31 16:01:12 +01:00
test_action.js Bug 1392318 - Use fromJSON convention in action module. r=automatedtester 2017-08-21 18:00:31 +01:00
test_assert.js Bug 1387559 - Drop session_id fallback for WebDriver:NewSession. r=automatedtester 2017-08-05 17:35:54 +01:00
test_cookie.js Bug 1371733 - Move cookie service to chrome space; r=whimboo 2017-06-12 18:05:22 +01:00
test_element.js
test_error.js Bug 1394849 - Add error.stack to create stacktraces. r=automatedtester 2017-08-29 17:34:37 +01:00
test_message.js
test_navigate.js Bug 1374672 - Don't wait for page load events for identical hash parameters. r=automatedtester 2017-07-07 17:34:27 +02:00
test_session.js Bug 1369827 - Fix socksVersion key in proxy capabilities. r=ato 2017-08-23 11:47:01 +02:00
test_wait.js Bug 1388082 - Use async/await in wait module xpcshell tests. r=automatedtester 2017-08-07 18:58:09 +01:00
transport.js Bug 1385547 - Lint testing/marionette. r=automatedtester 2017-07-31 16:01:12 +01:00
unit.ini Bug 1371733 - Move cookie service to chrome space; r=whimboo 2017-06-12 18:05:22 +01:00
wait.js Bug 1381876 - Introduce TimedPromise. r=automatedtester 2017-08-01 18:28:13 +01:00

README.html

Этот файл содержит неоднозначные символы Юникода!

Этот файл содержит неоднозначные символы Юникода, которые могут быть перепутаны с другими в текущей локали. Если это намеренно, можете спокойно проигнорировать это предупреждение. Используйте кнопку Экранировать, чтобы подсветить эти символы.

<h1>Marionette</h1>

<p>Marionette is the remote protocol that lets OOP programs
 communicate with, instrument, and control Gecko.


<h2>Description</h2>

<p>Marionette is an automation driver for Mozillas Gecko engine.
 It can remotely control either the UI
 or the internal JavaScript of the Gecko platform, such as Firefox.
 It can control both the chrome and the content document,
 giving a high level of control and ability to replicate user interaction.
 In addition to performing actions on the browser,
 Marionette can also read properties and attributes of the DOM.


<h2>Usage</h2>

<p>Marionette can be activated by passing the -marionette flag.
 To start Firefox with the remote protocol turned on:

<pre>
% firefox -marionette
…
1491228343089	Marionette	INFO	Listening on port 2828
</pre>

<p>This binds to a TCP socket, over which <a href=#clients>clients</a>
 can communicate with Marionette using the <a href=#protocol>protocol</a>.


<h2 id=protocol>Protocol</h2>

<p>Marionette provides an asynchronous,
 parallel pipelining user-facing interface.
 Message sequencing limits chances of payload race conditions
 and provides a uniform way in which payloads are serialised.

<p>Clients that deliver a blocking WebDriver interface
 are still expected to not send further command requests
 before the response from the last command has come back,
 but if they still happen to do so because of programming error,
 no harm will be done.
 This guards against <a href=https://bugzil.la/1207125>mixing up responses</a>.

<p>Schematic flow of messages:

<pre>
               client      server
                 |            |
      msgid=1    |----------->|
                 |  command   |
                 |            |
      msgid=2    |<-----------|
                 |  command   |
                 |            |
      msgid=2    |----------->|
                 |  response  |
                 |            |
      msgid=1    |<-----------|
                 |  response  |
                 |            |
</pre>

<p>The protocol consists of a <a href=#command>command</a> message
 and the corresponding <a href=#response>response</a> message.
 A <a href=#response>response</a> message must always be sent
 in reply to a <a href=#command>command</a> message.

<p>This means that the server implementation does not need to send
 the reply precisely in the order of the received commands:
 if it receives multiple messages, the server may even reply in random order.
 It is therefore strongly adviced that clients take this into account
 when implementing the client end of this wire protocol.

<p>This is required for pipelining messages.
 On the server side, some functions are fast, and some less so.
 If the server must reply in order, the slow functions delay the other replies
 even if its execution is already completed.


<h2 id=command>Command</h2>

<p>The request, or command message,
 is a four element JSON array as shown below,
 that may originate from either the client- or server remote ends:

<pre>[type, message ID, command, parameters]</pre>

<dl>
 <dt>type
 <dd><p>Must be 0 (integer).
  This indicates that the message
  is the <a href=#command>command</a> message.

 <dt>message ID
 <dd><p>A 32-bit unsigned integer.
  This number is used as sequencing number
  that uniquely identifies a pair of <a href=#command>command</a>
  and <a href=#response>response</a> messages.
  The other remote part will reply
  with a corresponding <a href=#response>response</a>
  with the same message ID.

 <dt>command
 <dd><p>A string identifying the RPC method or command to execute.

 <dt>parameters
 <dd><p>An arbitrary JSON serialisable object.
</dl>

<h2 id=response>Response</h2>

<p>The response message is also a four element array as shown below,
 and must always be sent after receiving a <a href=#command>command</a>:

<pre>[type, message ID, error, result]</pre>

<dl>
 <dt>type
 <dd><p>Must be 1 (integer).
  This indicates that the message is
  the <a href=#response>response</a> message.

 <dt>message ID
 <dd><p>A 32-bit unsigned integer.
  This corresponds to the <a href=#command>command</a> messages
  message ID.

 <dt>error
 <dd><p>If the command executed correctly, this field is null.
  If the error occurred on the server-side,
  then this field is an <a href=#error>error</a> object.

 <dt>result
 <dd><p>The result object associated with the <a href=#command>command</a>,
  if it executed correctly.
  If an error occurred on the server-side, this field is null.

  <p>The structure of the result entry can vary,
   but is documented individually for each command.
</dl>


<h3 id=error>Error object</h3>

<p>An error object is a serialisation of JavaScript error types,
 and is structured like this:

<pre>
{
	"error": "invalid session id",
	"message": "No active session with ID 1234",
	"stacktrace": ""
}
</pre>

<p>All the fields of the error object are required,
 so the stacktrace and message fields may be empty strings.
 The error field is on the other hand guaranteed
 to be one of the JSON error codes
 as laid out by the <a href=https://w3c.github.io/webdriver/webdriver-spec.html#handling-errors>WebDriver standard</a>.


<h2 id=clients>Clients</h2>

<p>Clients may be implemented in any language
 that is capable of writing and receiving data over TCP socket.
 A <a href=https://searchfox.org/mozilla-central/source/testing/marionette/client>reference client is provided</a>.
 Clients may be implemented both synchronously and asynchronously,
 although the latter is impossible in protocol levels 2 and earlier
 due to the lack of message indexing.


<h2 id=bugs>Bugs</h2>

<p>Bugs are tracked
 in various <a href=https://bugzilla.mozilla.org/>Bugzilla</a> components:

<dl>
 <dt>Marionette server
 <dt>Marionette reference client
 <dt>Marionette test harness
 <dd><a href="https://bugzilla.mozilla.org/buglist.cgi?product=Testing&component=Marionette">Testing :: Marionette</a>

 <dt>geckodriver
 <dd><a href="https://bugzilla.mozilla.org/buglist.cgi?product=Testing&component=geckodriver">Testing :: geckodriver</a>
</dl>