Граф коммитов

1343 Коммитов

Автор SHA1 Сообщение Дата
James Graham c32b272c7a Bug 1496452 - Don't log wpt manifest update when resolving tests r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D7732

--HG--
extra : moz-landing-system : lando
2018-10-05 16:46:52 +00:00
Csoregi Natalia 9d55d83f31 Merge inbound to mozilla-central. a=merge 2018-10-05 01:29:38 +03:00
Henrik Skupin 6156b8d1f5 Bug 1433905 - [mozprocess] poll() always returns None for stopped process until wait() is called. r=gbrown
If the process quits externally (shutdown by itself or via kill),
the poll method still returns None, even with the process not
existent anymore.

To fix that, the poll method should at least try to join the reader
thread once before checking if it is still alive. Otherwise it will
continue to run, and never stop.

Also the attribute existence check for "returncode" on the process
instance has to be removed because this property always exists.
Instead a check for the "returncode" property of the ProcessHandler
class is necessary.

Depends on D7396

Differential Revision: https://phabricator.services.mozilla.com/D7398

--HG--
extra : moz-landing-system : lando
2018-10-04 14:51:32 +00:00
Henrik Skupin 0b6b3e94da Bug 1433905 - [mozprocess] Existence of _handle on Windows doesn't mean the process is still alive. r=gbrown
The assumption that when a handle is present for the process handler
on Windows doesn't mean that the process is still alive. It could
have already been externally killed, crashed, or closed itself.

The patch makes sure to check the process exit code, and run
clean-up steps if the process is already gone.

Depends on D7395

Differential Revision: https://phabricator.services.mozilla.com/D7396

--HG--
extra : moz-landing-system : lando
2018-10-04 14:52:47 +00:00
Henrik Skupin 4a1ba8961f Bug 1433905 - [mozprocess] Fix broken path to process script for test_process_output_nonewline. r=gbrown
Depends on D7394

Differential Revision: https://phabricator.services.mozilla.com/D7395

--HG--
extra : moz-landing-system : lando
2018-10-04 10:49:52 +00:00
Henrik Skupin dc3840d283 Bug 1433905 - [mozprocess] "check_for_detached()" has to raise RuntimeError if process hasn't been started yet. r=gbrown
Calling "check_for_detached()" doesn't make sense if the process
hasn't been started yet, and as such has to raise a RuntimeError.

Depends on D7393

Differential Revision: https://phabricator.services.mozilla.com/D7394

--HG--
extra : moz-landing-system : lando
2018-10-04 10:49:24 +00:00
Henrik Skupin 8744982dbc Bug 1433905 - [mozprocess] Retrieving pid has to fail with RuntimeError if process hasn't been started yet. r=gbrown
Instead of an AttributeError a RuntimeError has to be thrown if
the underlying process hasn't been created yet.

Depends on D7392

Differential Revision: https://phabricator.services.mozilla.com/D7393

--HG--
extra : moz-landing-system : lando
2018-10-04 10:48:50 +00:00
Cosmin Sabou f34bdc7e4b Backed out changeset 8660ad891a23 (bug 1495372) for causing win2012 bustages. a=backout 2018-10-04 02:25:45 +03:00
Cosmin Sabou 7244d89e06 Backed out changeset dcba2a476ccf (bug 1305743) on request from jgraham for causing issues with mozinfo.json. a=backout 2018-10-04 01:05:44 +03:00
Edwin Gao ee7107754b Bug 1190701 - make ADBAndroidMixin.is_app_installed() unambiguous r=bc,gbrown
Behavior changes:
- ADBAndroidMixin.is_app_installed() will now perform a strict check on `app_name` provided. Previously, the behavior was to do a fuzzy match, where as long as the provided `app_name` matched some item on the list it would return True. Now, the exact string as shown when user calls `adb shell > pm list packages` will be required in order to generate a True return value.

Other changes:
- bumped mozdevice version to 1.1.2 reflecting minor behavior change.
- addition of unit tests for ADBAndroidMixin.is_app_installed() method call and surrounding helper methods such as mocked fixtures, manifest changes.

Differential Revision: https://phabricator.services.mozilla.com/D7322

--HG--
extra : moz-landing-system : lando
2018-10-02 18:39:38 +00:00
James Graham 57c945674a Bug 1495372 - Unify wpt manifest download and update r=ato
The previous code split a lot of logic between the update and download
parts, and exposed two different mach commands. In order to simplify
things it's better to have a single entry point for manifest download
and update, and ensure that's called consistently.

Differential Revision: https://phabricator.services.mozilla.com/D7497

--HG--
extra : moz-landing-system : lando
2018-10-03 15:43:44 +00:00
Geoff Brown 0b2be11c56 Bug 1495863 - Pass mozrunner adb path when creating ADBHost; r=bc 2018-10-02 16:55:10 -06:00
James Graham 8df230bb58 Bug 1495372 - Unify wpt manifest download and update, r=ato
The previous code split a lot of logic between the update and download
parts, and exposed two different mach commands. In order to simplify
things it's better to have a single entry point for manifest download
and update, and ensure that's called consistently.

Differential Revision: https://phabricator.services.mozilla.com/D7497
2018-10-04 14:19:38 +01:00
Andreas Tolfsen 4b95006f04 bug 1494613: mozprofile: add docs for Pref::new and ::new_sticky r=whimboo 2018-09-29 15:45:30 +01:00
James Graham 04f21f657a Bug 1494963 - Expose mozdebug's DebuggerInfo type r=ahal
Otherwise it doesn't work with multiprocessing, which breaks debugging wpt on Windows.

Differential Revision: https://phabricator.services.mozilla.com/D7173

--HG--
extra : moz-landing-system : lando
2018-09-28 15:55:18 +00:00
Andrew Halberstadt 9e9fc55acc Bug 1470266 - [moztest.resolve] Make task regexes more resilient to change, r=jmaher
These regexes are used for things like determining which tasks to run given a
"path" int |mach try|. Previously, we used patterns like:

mochitest-chrome-(?:e10s)?(?:-1)?$

This would match both e10s and non-e10s versions of a task with either no
chunks, or only selecting chunk 1. But we keep adding other configurations, e.g
-gpu, -no-accel, -sw, etc.  Each time we create a new possibility we need to
remember to update these task regexes (or else lose test coverage when using
paths with |mach try|).

Instead of individually listing every possibility, let's use a pattern like
this:

mochitest-chrome($|.*(-1|[^0-9])$)

This also selects tasks that are either chunk 1 or don't have any chunks.  But
it allows for arbitrary strings in-between. This regex doesn't need to be
updated when we add configurations like -sw.

Depends on D7119

Differential Revision: https://phabricator.services.mozilla.com/D7120

--HG--
extra : moz-landing-system : lando
2018-09-28 07:15:36 +00:00
Andrew Halberstadt aebcf45519 Bug 1470266 - [moztest.resolve] Create a unittest for the task regexes, r=jmaher
I almost forgot to update the regexes in moztest.resolve when creating the -sw
variant of task. This adds a test to make sure we don't forget more things in
the future.

Differential Revision: https://phabricator.services.mozilla.com/D7119

--HG--
extra : moz-landing-system : lando
2018-09-28 06:59:39 +00:00
Gurzau Raul 00b3974ac0 Backed out 5 changesets (bug 1494613) for failing at testing/geckodriver/src/marionette.rs
Backed out changeset 09e9cefc19ca (bug 1494613)
Backed out changeset f9f4e7c55d61 (bug 1494613)
Backed out changeset 457da8a172be (bug 1494613)
Backed out changeset 8d26a58f754e (bug 1494613)
Backed out changeset 729d8f3e1341 (bug 1494613)
2018-09-27 18:49:58 +03:00
Andreas Tolfsen ed28f66567 bug 1494613: mozprofile: add docs for Pref::new and ::new_sticky r=whimboo
Depends on D7076

Differential Revision: https://phabricator.services.mozilla.com/D7077

--HG--
extra : moz-landing-system : lando
2018-09-27 13:17:56 +00:00
Aaron Klotz acee6df4f4 Bug 1494398: Bump mozrunner version to 7.1.0 to reflect wait-for-browser changes; r=wlach
Differential Revision: https://phabricator.services.mozilla.com/D6997

--HG--
extra : moz-landing-system : lando
2018-09-26 21:19:40 +00:00
Edwin Gao f18ceae200 Bug 715884 - replace optparse usage with argparse r=jmaher
- changed argument parser to use ArgumentParser in compliance with Python 2.7.

Differential Revision: https://phabricator.services.mozilla.com/D6438

--HG--
extra : moz-landing-system : lando
2018-09-26 13:57:53 +00:00
Edwin Gao b8a91d1cf9 Bug 1305743 - Make failure to find mozinfo.json a fatal error r=gbrown,ahal
- moved placement of the raise_exception computation to be after the initial objdir path computation.
- original implementation was missing detection for cases where user may pass in a False flag to explicitly suppress errors.
- added unit tests to check for scenarios where raise_exception flag is passed in as part of positional argument.
- changed argument to include a **kwargs argument for caller to modify default exception behavior.
- default behavior is to raise exceptions if mozinfo.json cannot be found.
- disabled TreeMetadataEmitter from calling mozinfo.find_and_update_from_json and setting the self.info variable since it was not referenced anywhere else after the initial setup.

Depends on D6859

Differential Revision: https://phabricator.services.mozilla.com/D6860

--HG--
extra : moz-landing-system : lando
2018-09-26 20:07:25 +00:00
Aaron Klotz ad8a283d23 Bug 1488554: Part 4 - Make FirefoxRunner pass --wait-for-browser on Windows; r=ahal
Depends on D4972

Differential Revision: https://phabricator.services.mozilla.com/D6702

--HG--
extra : moz-landing-system : lando
2018-09-26 19:11:55 +00:00
arthur.iakab ec46826255 Merge inbound to mozilla-central. a=merge 2018-09-26 15:54:41 +03:00
James Graham 4c0e8cd2e6 Bug 1438975 - Sort logging options by formatter and support negative options r=ahal
Depends on D6819

Depends on D6819

Differential Revision: https://phabricator.services.mozilla.com/D6820

--HG--
extra : moz-landing-system : lando
2018-09-25 19:45:27 +00:00
James Graham cc7b5832aa Bug 1438975 - Add tbpl-like output for failing refests to the mach formatter r=ahal
This allows the output to be used in the reftest anaylzer directly.

Differential Revision: https://phabricator.services.mozilla.com/D6819

--HG--
extra : moz-landing-system : lando
2018-09-25 19:42:46 +00:00
James Graham caad927e35 Bug 1493674 - Fix up test resolver with out of tree manifest r=ahal
mach try fuzzy has some stronger requirements compared to mach test.

Depends on D6673

Differential Revision: https://phabricator.services.mozilla.com/D6674

--HG--
extra : moz-landing-system : lando
2018-09-25 09:40:56 +00:00
Ciure Andrei 6760739b90 Merge mozilla-central to mozilla-inbound. a=merge CLOSED TREE 2018-09-26 00:53:40 +03:00
Henrik Skupin eb04193509 Bug 1438830 - [mozprocess] Track and kill detached processes on Windows. r=gbrown
Allow mozprocess to track and kill processes on Windows,
even when they got restarted.

Such processes are still part of the job object, but unless
the "JOB_OBJECT_LIMIT_KILL_ON_JOB_CLOSE" flag is set, they
aren't getting closed.

Since our sandbox also creates jobs, we preferably want to
nest the sandbox's job inside the job as created by mozprocess.
Specifying "JOB_OBJECT_LIMIT_BREAKAWAY_OK" would allow
sandboxed processes within the job to break off and form their
own, separate job. This is actually necessary for sandboxing
to work on older versions of Windows without nested job support,
but on newer versions, we don't want them breaking away.

--HG--
extra : rebase_source : a485adc370127dfec86329f775df089b3b71eb47
2018-09-20 09:05:22 +02:00
Bob Clary 0b522a50c1 Bug 1485638 - [mozsystemmonitor] wrap Multiprocessing.Pipe.poll in _collect as well as in SystemResourceMonitor.stop, r=ahal. 2018-09-23 15:08:56 -07:00
Bob Clary 57cca45e9a Bug 1485638 - [mozsystemmonitor] Multiprocessing.Process should always be called with keyword arguments, r=ahal. 2018-09-23 15:08:56 -07:00
Dave Hunt e0f982a753 Bug 1492341 - Bump mozrunner version to 7.0.2; r=tcsc
TPS is currently depending on mozrunner v7.0.1, which depends on an earlier version of mozprofile. For TPS to be able to use the latest version of mozprofile we need to release a new version of mozrunner with the recent mozprofile version identifier update.

Differential Revision: https://phabricator.services.mozilla.com/D6406

--HG--
extra : moz-landing-system : lando
2018-09-20 16:33:56 +00:00
Ahilya Sinha 8f5e322404 Bug 1473915 - Set up infra so we can move the wpt-manifest out of tree r=gps
Changes the wpt manifest path to the topobjdir instead so it can be moved out of tree.
Other changes so that the manifest download and update, and |mach wpt| and |mach test <wpt-test>| work with the new path.
The manifest is also downloaded and updated when creating the tests-archive to ensure that it exists when we run tests on TC.

MozReview-Commit-ID: Fp6UsKJjhTU

Differential Revision: https://phabricator.services.mozilla.com/D5312

--HG--
extra : moz-landing-system : lando
2018-09-20 12:07:58 +00:00
Bogdan Tara 9f17cab93a Merge mozilla-central to autoland. a=merge CLOSED TREE 2018-09-20 01:03:35 +03:00
Raphael Pierzina 7cdbeffeb6 mozfile: Fix Python 3 compat issue in mozfile test_load.py (Bug 1492401) r=davehunt
This patch updates mozfile tests to use `wptserve` instead of `mozhttpd` and enables test_load.py for Python 3.5.

Differential Revision: https://phabricator.services.mozilla.com/D6251

--HG--
extra : moz-landing-system : lando
2018-09-19 17:53:35 +00:00
Raphael Pierzina 15087ce7c2 mozfile: Fix Python 3 compat issue in mozfile test_move_remove.py (Bug 1471622) r=ahal
This patch updates mozfile test_move_remove.py to use `open` instead of `file`
and enables the according test module for Python 3.5.

Differential Revision: https://phabricator.services.mozilla.com/D6245

--HG--
extra : moz-landing-system : lando
2018-09-19 20:25:39 +00:00
shindli d8f561f92f Backed out changeset dd80de19f142 (bug 1473915) for mb failures in testing/mozbase/moztest/tests/test_resolve.py CLOSED TREE 2018-09-19 18:13:48 +03:00
Ahilya Sinha 67be437f68 Bug 1473915 - Set up infra so we can move the wpt-manifest out of tree r=gps
Changes the wpt manifest path to the topobjdir instead so it can be moved out of tree.
Other changes so that the manifest download and update, and |mach wpt| and |mach test <wpt-test>| work with the new path.
The manifest is also downloaded and updated when creating the tests-archive to ensure that it exists when we run tests on TC.

MozReview-Commit-ID: Fp6UsKJjhTU

Differential Revision: https://phabricator.services.mozilla.com/D5312

--HG--
extra : moz-landing-system : lando
2018-09-19 06:57:50 +00:00
Bob Clary 60e22167a6 Bug 1491424 - Define AndroidMixin as new class Mixin with proper initialization, r=gbrown.
As defined initially, AndroidMixin was an old-style class not inheriting from object. This
prevents it from being properly called via super() which requires it be a new style class
and also requires that its __init__ method's signature conform to the signatures of the other
mixin's __init_methods.

AndroidMixin originally detected the adb_path using BaseScript's query_exe which required that
the previous initializers complete prior to the call which is not possible. To work around the
problem, adb_path was turned into a property whose value was not looked up until requested.
The intent was to defer the need to reference attributes which had not yet been initialized.

BaseScript's __init__ iterates over the attributes of its object determining if listeners should
be attached for the methods. This can cause problems in mixins which define properties which
require a fully initialized object since accessing the property will invoke the method before it
is ready.

This is worked around in this patch by catching AttributeError in adb_path and ignoring it. The
proper fix however might be to do this catch in BaseScript's __init__ where item = getattr(self, k)
is called.

These changes are not sufficient in of themselves. The additional followup patch to CoverCoverageMixin
and SingleTestMixin are also required for AndroidMixin to be properly initialized.

Since Raptor currently initializes AndroidMix without explicitly giving a device serial number,
mozrunner's android_device.py is modified to export the detected device serial number into the
environment as DEVICE_SERIAL. This allows AndroidMixin to obtain the device's serial number.
2018-09-19 10:35:39 -07:00
arthur.iakab 1ee75a928a Merge inbound to mozilla-central a=merge 2018-09-19 05:18:50 +03:00
Edwin Gao 2514b44cdb Bug 1488590 - Add tests to mozdevice::adb.py r=ahal
Created tests/ subdirectory under mozdevice.
Added conftest.py and populated with wrappers for the methods under test.
Added test_socket_connections.py with basic tests for new methods and some coverage of legacy/deprecated methods.

Differential Revision: https://phabricator.services.mozilla.com/D5165

--HG--
extra : moz-landing-system : lando
2018-09-18 19:35:40 +00:00
Aaron Klotz 9e357d1cf3 Bug 1489277: Skip mozrunner tests if running under automation; r=ahal!
Differential Revision: https://phabricator.services.mozilla.com/D5922
2018-09-14 16:26:57 -06:00
Aaron Klotz 8ff40206fc Bug 1491489: Add automation property to mozinfo.info; r=ahal!
When MOZ_AUTOMATION is set, then automation = true

Differential Revision: https://phabricator.services.mozilla.com/D5921
2018-09-14 17:42:13 -06:00
Andreas Tolfsen 3d48e987b5 bug 1466818: mozrunner: release 0.8.0; r=me 2018-09-16 00:32:18 +01:00
Andreas Tolfsen a90e90dac3 no bug: mozprofile: release 0.4.0; r=me 2018-09-16 00:24:46 +01:00
Pavel Slepushkin 21f7f10fe9 Bug 1471888 - [mozprofile] Add support for Python 3. r=davehunt
Bug 1471888 - [mozprofile] Add support for Python 3.

Differential Revision: https://phabricator.services.mozilla.com/D5187

--HG--
extra : moz-landing-system : lando
2018-09-11 18:58:05 +00:00
Henrik Skupin 281acf7f9c Bug 905404 - [mozprofile] Remove all default testing related preferences. r=ahal
All preferences which were previously set for test harnesses are
part of testing/profiles now. As such they can all be removed.

--HG--
extra : rebase_source : 3feaac102f7b8a63ec4f07d84e121f26c49ce3c0
extra : histedit_source : e5b474e75d9f2c372c6439502fa1b30c8727e133
2018-09-05 17:01:17 +02:00
Cosmin Sabou 80e58fff22 Backed out changeset 30ec08a53991 (bug 1471888) for awsy test failures. CLOSED TREE 2018-09-11 15:12:53 +03:00
Pavel Slepushkin 05853e660a Bug 1471888 - [mozprofile] Add support for Python 3. r=davehunt
Bug 1471888 - [mozprofile] Add support for Python 3.

Differential Revision: https://phabricator.services.mozilla.com/D5187

--HG--
extra : moz-landing-system : lando
2018-09-11 11:34:50 +00:00
Xidorn Quan 044a4b8c2c Bug 1489017 - Locate devenv.exe via vswhere on Windows. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D5117

--HG--
extra : moz-landing-system : lando
2018-09-07 14:59:55 +00:00