Граф коммитов

68 Коммитов

Автор SHA1 Сообщение Дата
Agi Sferro a5bf648b7d Bug 1692058 - Open temporary file in w mode when running multiple junit tests. r=droeh,mhentges
We're trying to store a string in a file open in binary mode which doesn't work :)

I'm guessing this was allowed in Python2 or some older 3 version.

Differential Revision: https://phabricator.services.mozilla.com/D104751
2021-02-24 17:03:32 +00:00
Agi Sferro 816cdb938f Bug 1609198 - Print logcat on junit test failure. r=droeh,nalexander
This also adds a --verbose flag to |mach geckoview-junit| which always prints
the logcat for every test.

Differential Revision: https://phabricator.services.mozilla.com/D104769
2021-02-24 17:02:54 +00:00
Makoto Kato 2f7bcc8337 Bug 1688521 - Allow mochitest and geckoview-junit on Windows if it has multiple IP address. r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D102895
2021-02-01 09:01:52 +00:00
Bob Clary 1584100fb2 Bug 1681096 - python3 - pylint --py3k - W1618: from __future__ import absolute_import r=perftest-reviewers,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D98939
2020-12-14 17:50:17 +00:00
Bryce Seager van Dyk 9a4fa928ac Bug 1674483 - Only use websocketprocessbridge when running tests tagged with 'webrtc'. r=bwc,gbrown
Differential Revision: https://phabricator.services.mozilla.com/D95409
2020-11-06 22:47:42 +00:00
Agi Sferro 0308170ebf Bug 1673100 - Add version of gv-junit that runs with fission. r=esawin,ahal
Differential Revision: https://phabricator.services.mozilla.com/D95062
2020-11-02 19:39:38 +00:00
Aaron Klotz c592bffdfb Bug 1650118: Part 6 - Update test harnesses; r=bc,sparky,perftest-reviewers,jgraham
e10s is no longer a GeckoView option, so I'd like to remove it from test
harnesses when possible.

Depends on D90934

Differential Revision: https://phabricator.services.mozilla.com/D91640
2020-10-27 18:16:30 +00:00
Razvan Maries f3f6721caa Backed out 8 changesets (bug 1650118) for wpt failures on inside-dedicated-worker.html. CLOSED TREE
Backed out changeset ab6218dd84f5 (bug 1650118)
Backed out changeset a99d1aae6e2e (bug 1650118)
Backed out changeset ed357b8bb07e (bug 1650118)
Backed out changeset cd5155e732d9 (bug 1650118)
Backed out changeset 63cc752924f2 (bug 1650118)
Backed out changeset 7f0a281a399e (bug 1650118)
Backed out changeset 0fd77fef3c95 (bug 1650118)
Backed out changeset f397e86fd61e (bug 1650118)
2020-10-27 18:39:11 +02:00
Aaron Klotz b7a9856e97 Bug 1650118: Part 6 - Update test harnesses; r=bc,sparky,perftest-reviewers,jgraham
e10s is no longer a GeckoView option, so I'd like to remove it from test
harnesses when possible.

Depends on D90934

Differential Revision: https://phabricator.services.mozilla.com/D91640
2020-10-27 11:41:28 +00:00
Ricky Stewart 02a7b4ebdf Bug 1654103: Standardize on Black for Python code in `mozilla-central`.
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-26 18:34:53 +00:00
Bogdan Tara da1098d4aa Backed out 10 changesets (bug 1654103, bug 1672023, bug 1518999) for PanZoomControllerTest.touchEventForResult gv-junit failures CLOSED TREE
Backed out changeset ff3fb0b4a512 (bug 1672023)
Backed out changeset e7834b600201 (bug 1654103)
Backed out changeset 807893ca8069 (bug 1518999)
Backed out changeset 13e6b92440e9 (bug 1518999)
Backed out changeset 8b2ac5a6c98a (bug 1518999)
Backed out changeset 575748295752 (bug 1518999)
Backed out changeset 65f07ce7b39b (bug 1518999)
Backed out changeset 4bb80556158d (bug 1518999)
Backed out changeset 8ac8461d7bd7 (bug 1518999)
Backed out changeset e8ba13ee17f5 (bug 1518999)
2020-10-24 03:36:18 +03:00
Ricky Stewart c0cea3b0fa Bug 1654103: Standardize on Black for Python code in `mozilla-central`. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-23 20:40:42 +00:00
Dorel Luca 1ff59cb7a3 Backed out changeset 7558c8821a07 (bug 1654103) for multiple failures. CLOSED TREE 2020-10-22 03:51:06 +03:00
Ricky Stewart 50762dacab Bug 1654103: Standardize on Black for Python code in `mozilla-central`. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-21 21:27:27 +00:00
Razvan Maries 5e0d52e2cc Backed out 6 changesets (bug 1650118) as per Aaron's request. CLOSED TREE
Backed out changeset 4a7fc6398ad6 (bug 1650118)
Backed out changeset b9fa3dd9c05d (bug 1650118)
Backed out changeset 2cb9109dee0a (bug 1650118)
Backed out changeset a6ca38804021 (bug 1650118)
Backed out changeset 66b9527aecad (bug 1650118)
Backed out changeset 74fd3eb970a6 (bug 1650118)
2020-10-21 07:32:57 +03:00
Aaron Klotz 1876a00d8b Bug 1650118: Part 6 - Update test harnesses; r=bc,sparky,perftest-reviewers
e10s is no longer a GeckoView option, so I'd like to remove it from test
harnesses when possible.

Differential Revision: https://phabricator.services.mozilla.com/D91640
2020-10-19 18:17:16 +00:00
Ricky Stewart 2323e14fb8 Bug 1655529 - Port some exceptions thrown in `geckoview-junit` over to the new `UserError` exception class r=geckoview-reviewers,agi
These exceptions shouldn't be reported to Sentry.

Differential Revision: https://phabricator.services.mozilla.com/D85027
2020-07-30 19:21:34 +00:00
Csoregi Natalia b0e102995f Backed out 2 changesets (bug 1646406, bug 1655529) for geckoview failures. CLOSED TREE
Backed out changeset 0630f4154c62 (bug 1655529)
Backed out changeset 18d42084d135 (bug 1646406)
2020-07-30 00:28:59 +03:00
Ricky Stewart 361aaceef7 Bug 1655529 - Port some exceptions thrown in `geckoview-junit` over to the new `UserError` exception class r=geckoview-reviewers,agi
These exceptions shouldn't be reported to Sentry.

Differential Revision: https://phabricator.services.mozilla.com/D85027
2020-07-29 19:57:52 +00:00
Geoff Brown 8731a1e19e Bug 1638963 - Run 'mach geckoview-junit' with py3; r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D84560
2020-07-22 18:08:02 +00:00
Bob Clary ff94966627 Bug 1486004 - Part 10 - Update mochitest to support unrooted android devices using mozdevice 4.0.0, ? r=ahal
Depends on D82752

Differential Revision: https://phabricator.services.mozilla.com/D82753
2020-07-17 20:48:26 +00:00
Narcis Beleuzu b1faa2872a Backed out 17 changesets (bug 1486004) for wrench bustage on android.py . CLOSED TREE
Backed out changeset cae730f105d7 (bug 1486004)
Backed out changeset e0094d50a315 (bug 1486004)
Backed out changeset 424425ed98c6 (bug 1486004)
Backed out changeset 551232749abe (bug 1486004)
Backed out changeset 505747095def (bug 1486004)
Backed out changeset 5b1c62c4a4d5 (bug 1486004)
Backed out changeset 0a1c8d50ee69 (bug 1486004)
Backed out changeset 6ef81c676859 (bug 1486004)
Backed out changeset 234e55153fb6 (bug 1486004)
Backed out changeset 2f33b309d746 (bug 1486004)
Backed out changeset 48947692c176 (bug 1486004)
Backed out changeset 473bac8eedd9 (bug 1486004)
Backed out changeset af6afed0a04a (bug 1486004)
Backed out changeset a0e2f91eb4d4 (bug 1486004)
Backed out changeset 138c987440c7 (bug 1486004)
Backed out changeset 6d2e305f4722 (bug 1486004)
Backed out changeset 1181ff03bb05 (bug 1486004)
2020-07-17 23:43:57 +03:00
Bob Clary 5c852eaa2f Bug 1486004 - Part 10 - Update mochitest to support unrooted android devices using mozdevice 4.0.0, ? r=ahal
Depends on D82752

Differential Revision: https://phabricator.services.mozilla.com/D82753
2020-07-16 21:32:54 +00:00
Narcis Beleuzu 1eb115035d Backed out 20 changesets (bug 1486004, bug 1653094) for wrench bustages. CLOSED TREE
Backed out changeset 120c64ebdea3 (bug 1486004)
Backed out changeset b10f105b1c36 (bug 1486004)
Backed out changeset 7f186e6bcccc (bug 1486004)
Backed out changeset cdda7b349cd8 (bug 1486004)
Backed out changeset 650c47e81402 (bug 1486004)
Backed out changeset 2bcca7cf3f1b (bug 1486004)
Backed out changeset e1df276f8a8d (bug 1486004)
Backed out changeset f6f5e7f2bd0a (bug 1486004)
Backed out changeset 1c56cb03ce53 (bug 1486004)
Backed out changeset 582cd190f174 (bug 1486004)
Backed out changeset 7c162e1b3a79 (bug 1486004)
Backed out changeset d1088e178216 (bug 1486004)
Backed out changeset 40763f4afd26 (bug 1486004)
Backed out changeset f20eb5b5a670 (bug 1486004)
Backed out changeset 6349ee0bd63f (bug 1486004)
Backed out changeset 7c23729053f6 (bug 1486004)
Backed out changeset 49586014bd29 (bug 1486004)
Backed out changeset 07971e82ae85 (bug 1653094)
Backed out changeset 47e7295e9c19 (bug 1653094)
Backed out changeset 57a25bbeec37 (bug 1653094)
2020-07-16 17:58:09 +03:00
Bob Clary 61125f6978 Bug 1486004 - Part 10 - Update mochitest to support unrooted android devices using mozdevice 4.0.0, ? r=ahal
Depends on D82752

Differential Revision: https://phabricator.services.mozilla.com/D82753
2020-07-15 20:59:47 +00:00
Mihai Alexandru Michis a1d49fb98d Backed out 17 changesets (bug 1486004) for causing bustages in AccessCheck.h
CLOSED TREE

Backed out changeset 86a0855e1e45 (bug 1486004)
Backed out changeset 4fc98067edc5 (bug 1486004)
Backed out changeset 8ab3f1597fde (bug 1486004)
Backed out changeset b487e98320fb (bug 1486004)
Backed out changeset 4cba8e6bc515 (bug 1486004)
Backed out changeset d0db5eef2343 (bug 1486004)
Backed out changeset 50285a87de6b (bug 1486004)
Backed out changeset 9730c0303810 (bug 1486004)
Backed out changeset 140a9d2362f3 (bug 1486004)
Backed out changeset 9d1ce06f6039 (bug 1486004)
Backed out changeset 88a5a4ab39fa (bug 1486004)
Backed out changeset eb186c92232d (bug 1486004)
Backed out changeset 677f2129750e (bug 1486004)
Backed out changeset 81427a5f2103 (bug 1486004)
Backed out changeset 38d7def3d425 (bug 1486004)
Backed out changeset a9e73221c471 (bug 1486004)
Backed out changeset ebe8c2d5432e (bug 1486004)
2020-07-16 15:29:29 +03:00
Bob Clary 9534a42ba4 Bug 1486004 - Part 10 - Update mochitest to support unrooted android devices using mozdevice 4.0.0, ? r=ahal
Depends on D82752

Differential Revision: https://phabricator.services.mozilla.com/D82753
2020-07-15 20:59:47 +00:00
Agi Sferro ad8f58b686 Bug 1646508 - Add --setenv to |mach geckoview-junit|. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D80077
2020-06-18 19:42:00 +00:00
Coroiu Cristina d84bb71c40 Backed out changeset 8b56bdf1ba13 (bug 1646508) for gv-junit failures on a CLOSED TREE 2020-06-18 21:06:41 +03:00
Agi Sferro 41a329b57f Bug 1646508 - Add --setenv to |mach geckoview-junit|. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D80077
2020-06-18 16:22:04 +00:00
Aaron Klotz 637ed6291c Bug 1640757: Use "-e testFile" to specify a junit test filter; r=gbrown
* We add a new command line option, `test-filter-file`, which allows the user
  to specify a line-delimited list of tests to run;
* When there multiple `test_filters` specified, we accumulate them into a
  temporary test filter file in the line-delimited format;
* We push that file to the device and specify it to `am instrument`;
* A single `test_filter` is still passed directly on the command line.

Differential Revision: https://phabricator.services.mozilla.com/D76873
2020-05-26 19:34:10 +00:00
Bob Clary 80ab483d5d Bug 1633302 - Remote android tests must use root=True appropriately when dealing with app created files, r=gbrown.
Depends on D72576

Differential Revision: https://phabricator.services.mozilla.com/D72577
2020-04-27 15:45:59 +00:00
Gijs Kruitbosch c58b8f6ff2 Bug 1631358 - remove CPOW support in the message manager, r=mccr8
This commit:

- removes sendRpcMessage, which was unused;
- removes the CPOW argument to sendAsyncMessage, broadcastAsyncMessage, and
  sendSyncMessage;
- removes the aIsSync argument used internally to distinguish sendRpcMessage
  and sendSyncMessage;
- removes CPOW tests;
- updates the few remaining callsites that use more than 2 arguments in
  sendAsyncMessage for the removal of the cpows argument.

Differential Revision: https://phabricator.services.mozilla.com/D71514
2020-04-21 14:07:57 +00:00
Geoff Brown 2fe7254f67 Bug 1612345 - Support --setpref in geckoview-junit; r=bc
Add a --setpref option to geckoview-junit with the same meaning and
help description as used in mochitest.

Differential Revision: https://phabricator.services.mozilla.com/D65619

--HG--
extra : moz-landing-system : lando
2020-03-06 15:21:10 +00:00
Geoff Brown 3161788df7 Bug 1603499 - Report java exceptions from minidump .extra files; r=bc
Stop using mozcrash.check_for_java_exception(), which scans logcat for uncaught
exceptions. Instead, check for java_stack in the extra dump information during
normal crash reporting; if java_stack is present, display the java exception and
stack instead of dumping a full native crash report.

Differential Revision: https://phabricator.services.mozilla.com/D61836

--HG--
extra : moz-landing-system : lando
2020-02-07 16:05:52 +00:00
James Willcox cdbb518fb1 Bug 1608560 - Use androidx.test instead of android-support r=geckoview-reviewers,aklotz,nalexander
Differential Revision: https://phabricator.services.mozilla.com/D59575

--HG--
extra : moz-landing-system : lando
2020-01-13 21:36:22 +00:00
Geoff Brown ce17265e96 Bug 1608831 - Use a distinct profile category for geckoview-junit tests; r=snorp
Historically, mochitest and geckoview-junit tests have used the same profile.
This patch splits out a separate profile type for geckoview-junit, with exactly
the same content for now; the geckoview team can follow-up with whatever
profile changes are required for junit.

Differential Revision: https://phabricator.services.mozilla.com/D59775

--HG--
extra : moz-landing-system : lando
2020-01-13 20:22:02 +00:00
Agi Sferro 95e45a637b Bug 1581345 - Add TEST-UNEXPECTED-FAIL to TestHarnessException. r=gbrown
This is so that treeherder can pick up the failure line.

Differential Revision: https://phabricator.services.mozilla.com/D59069

--HG--
extra : moz-landing-system : lando
2020-01-08 04:05:43 +00:00
Agi Sferro 969a457a69 Bug 1605256 - Add exception type to message. r=snorp
This commit does two things:

- It exposes the error that caused the test to fail in our logs, so it would
  appear like so:

```
TEST-UNEXPECTED-FAIL | org.mozilla.geckoview.test.ExtensionActionTest.setIconSvg[#pageAction] | java.lang.AssertionError: We shouldn't get here
```

- It catches exceptions that are raised before any test code is run and outputs
  a different message (since those failures do not depend on the test at all),
  like so:

```
ERROR runjunit.py | The previous test failed because of an error in the test harness | org.mozilla.geckoview.test.rule.TestHarnessException: java.lang.RuntimeException: We shouldn't get here
```

This will hopefully help with spurious intermittents and understand when a
failure changes.

Differential Revision: https://phabricator.services.mozilla.com/D58022

--HG--
extra : moz-landing-system : lando
2020-01-06 22:48:03 +00:00
Aaron Klotz 665493fd6a Bug 1600658: Part 1 - Remove setting of MOZ_CRASHREPORTER_NO_REPORT from runjunit.py; r=gbrown
We now need the junit crash handler to see crash reports.

Differential Revision: https://phabricator.services.mozilla.com/D56853

--HG--
extra : moz-landing-system : lando
2019-12-16 20:15:11 +00:00
Geoff Brown 7375da64fd Bug 1564920 - In geckoview-junit tests, do not push profile to existing directory; r=bc
As in bug 1596967, I found that, on the emulator, the check for directory existence
infrequently indicates that a recently created directory does not exist. The following
push() will then adjust its destination directory and push to the wrong location;
without a properly installed profile, geckoview crashes. Let's simplify this sequence
by not creating the directory beforehand and letting the push() create it. The profile
directory is a direct child of the test directory -- no need to create parents either.

Differential Revision: https://phabricator.services.mozilla.com/D56789

--HG--
extra : moz-landing-system : lando
2019-12-11 21:02:18 +00:00
Geoff Brown 4286faeb7b Bug 1590354 - Remove checks for remote minidumps directory; r=jmaher
Whereas:
 - desktop tests don't make this check;
 - the check for directory existence has been troublesome and almost never useful;
 - bug classification of this condition has been troublesome;
 - if a startup crash actually did occur before crashreporter init, there would still be an indication in logcat and possibly a tombstone, and the "No test summary found" check would definitely be triggered;
Let's stop checking for minidumps directory creation.

Differential Revision: https://phabricator.services.mozilla.com/D54755

--HG--
extra : moz-landing-system : lando
2019-11-26 16:38:44 +00:00
Geoff Brown 57dbb44533 Bug 1588969 - Add --run-until-failure and --repeat options for |mach geckoview-junit|; r=bc,hiro
Added a loop for repeating the requested test(s).
With --run-until-failure, loop until a test fails.
With --repeat=N, repeat N times. eg, --repeat=1 implies 2 runs total (same as mochitest).
(Incidentally moved code for --enable-webrender since it was not in the appropriate section.)

Differential Revision: https://phabricator.services.mozilla.com/D50299

--HG--
extra : moz-landing-system : lando
2019-10-23 22:45:49 +00:00
Edwin Gao 5d0a507d0c Bug 1559975 - convert testing/mochitest to python3 r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D37096

--HG--
extra : moz-landing-system : lando
2019-08-02 19:44:34 +00:00
Gurzau Raul 9866332964 Backed out 3 changesets (bug 1559975) for linting failure at WebIDL.py on a CLOSED TREE.
Backed out changeset a7154744a5d7 (bug 1559975)
Backed out changeset 4005ac274170 (bug 1559975)
Backed out changeset 68ed1ccb5921 (bug 1559975)
2019-07-19 18:25:10 +03:00
Edwin Gao 8cc5b421aa Bug 1559975 - convert testing/mochitest to python3 r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D37096

--HG--
extra : moz-landing-system : lando
2019-07-19 14:04:54 +00:00
Kartikaya Gupta 92b3588b88 Bug 1558598 - Force WebRender on or off in the junit harness. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D35850

--HG--
extra : moz-landing-system : lando
2019-06-29 09:48:02 +00:00
Bob Clary 0bffbb3592 Bug 1544089 - [mochitest] - Configure ssltunnel to listen on loopback address for Desktop and any public address for Remote tests, r=gbrown.
Depends on D27722

Differential Revision: https://phabricator.services.mozilla.com/D27723

--HG--
extra : moz-landing-system : lando
2019-04-23 00:36:52 +00:00
Geoff Brown eea10fc31e Bug 1533445 - Make android tests shutdown faster when device unresponsive; r=bc
Differential Revision: https://phabricator.services.mozilla.com/D22610

--HG--
extra : moz-landing-system : lando
2019-03-07 22:45:13 +00:00
Geoff Brown 7c8f4e8f58 Bug 1522689 - Update command line help for several android test commands; r=bc 2019-02-01 07:18:05 -07:00