Граф коммитов

1913 Коммитов

Автор SHA1 Сообщение Дата
Bob Clary c457eaa29c Bug 1642672 - [mozdevice 3.2.3] Ensure content of files and process output is converted to str for Python 3, r=gbrown.
Differential Revision: https://phabricator.services.mozilla.com/D77844
2020-06-02 20:43:45 +00:00
Bob Clary 98df40a194 Bug 1642313 - mozbase manifestparser chunk_by_manifest should not use dicts in key comparison during sort, r=ahal.
Differential Revision: https://phabricator.services.mozilla.com/D77817
2020-06-02 18:55:37 +00:00
Narcis Beleuzu 4836af4aff Backed out changeset ab0fcba34420 (bug 1642662) for causing Bug 1642773. CLOSED TREE 2020-06-03 00:49:42 +03:00
Bob Clary 1927befd10 Bug 1642662 - [mozcrash] Convert output of minidump_stackwalk from bytes to str in _process_dump_file in Python3, r=gbrown.
Differential Revision: https://phabricator.services.mozilla.com/D77840
2020-06-02 17:19:13 +00:00
Chris AtLee 57114676ed Bug 1638990: Allow manifest expression parsing to work with py3 r=egao
In Py2, None compares as less than all strings and numbers.
In Py3, None isn't comparable with < to strings or numbers.

For unset variables, use "" as the value for the purposes of parsing manifest expressions.

Differential Revision: https://phabricator.services.mozilla.com/D76134
2020-06-02 16:01:50 +00:00
Ricky Stewart 99c97f553a Bug 1642385 - Add foolproof error message to mozprocess when write errors occur r=froydnj
When people do Python 3 work and encounter an exception on this line, their first instinct is to do a `blame` and then NI me on the bug (which, fair enough). However when this particular issue is encountered it's usually that the `ProcessHandler` API is being invoked incorrectly and the process isn't being opened in the correct mode. Here we dump an error message to the screen immediately before the exception is thrown to hopefully point people working on dependencies of bug 1577599 on the right path.

Differential Revision: https://phabricator.services.mozilla.com/D77684
2020-06-01 19:41:10 +00:00
Nils Ohlmeier [:drno] 18ef0cb66a Bug 1641289: Bye, bye Steeplechase. r=dminor,froydnj
Differential Revision: https://phabricator.services.mozilla.com/D77114
2020-05-29 03:19:27 +00:00
egao 45a93dd0b7 Bug 1637011 - refactor web-platform-tests chunking process in chunking.py r=ahal
Changes:

  - for web-platform-tests codepath, no longer perform filtering of the runtimes information to a list of key:value.
  - for web-platform-tests codepath, load runtimes information into an OrderedDict in order from highest to lowest runtime.
  - if any test paths remain after initial chunking by runtime information, distribute such paths across all chunks.

Differential Revision: https://phabricator.services.mozilla.com/D76538
2020-05-27 20:21:48 +00:00
Sylvestre Ledru de03967deb Bug 1640532 - docs - fix some typos DONTBUILD r=webdriver-reviewers,whimboo
Depends on D76636

Differential Revision: https://phabricator.services.mozilla.com/D76637
2020-05-25 11:30:05 +00:00
egao a8d0e51833 Bug 1637463 - writeruntimes script to output runtime information into nested dictionary r=ahal
Changes:

Update `writeruntimes` script so that each suite is in its own nested dictionary and add the ability to query `web-platform-tests-reftest`.

Differential Revision: https://phabricator.services.mozilla.com/D75229
2020-05-23 01:46:42 +00:00
Mihai Alexandru Michis 74ff68a9a5 Backed out 3 changesets (bug 1637463) for causing bc jobs to timeout.
CLOSED TREE

Backed out changeset 93efb53380c2 (bug 1637463)
Backed out changeset 5c8ccda5f1b1 (bug 1637463)
Backed out changeset a5fc1b604238 (bug 1637463)
2020-05-23 02:35:26 +03:00
Ricky Stewart e2fe57521b Bug 1638060 - Standardize interface of `mozfile` classes as `bytes`-based streams r=glandium
At the beginning of the Python 3 migration (circa bug 1602540), we made an update to the interface of `mozpack/files.py` in the direction of aligning with Python 3's built-in `file` support; namely, that opening a file in text mode returns a stream of `str` (text), and that opening a file in binary mode returns a stream of `bytes`. This was deemed to be more trouble than it was worth. This patch undoes all of those changes to the interface in favor of moving back to the Python 2 style, where all files are bytestreams.

Differential Revision: https://phabricator.services.mozilla.com/D75424
2020-05-22 01:11:29 +00:00
Geoff Brown f39c1aeb51 Bug 1428718 - [moztest] Support python 3; r=egao
I noticed one more moztest issue in bug 1638993: sorting an array of dict is
poorly defined on py2 and not tolerated on py3; adding the lambda clarifies
the behavior. With this resolved, I think we can bump the moztest version and
close this bug.

Differential Revision: https://phabricator.services.mozilla.com/D76486
2020-05-22 16:12:05 +00:00
egao cf9f527a4f Bug 1637463 - writeruntimes script to output runtime information into nested dictionary r=ahal
Changes:

Update `writeruntimes` script so that each suite is in its own nested dictionary and add the ability to query `web-platform-tests-reftest`.

Differential Revision: https://phabricator.services.mozilla.com/D75229
2020-05-20 22:01:47 +00:00
Geoff Brown 7e002b7daf Bug 1599261 - [moztest] Enable test_resolve.py on py3; r=egao
This test is passing now on python 3, both locally and on try.

Differential Revision: https://phabricator.services.mozilla.com/D76370
2020-05-22 16:17:47 +00:00
Geoff Brown 2bd1ea09d5 Bug 1558667 - Try to make test_resource_monitor.py more robust; r=ahal
This test has been failing, infrequently, mostly on osx/py2, for many months.
Increasing the time interval between events appears to reduce failure frequency.

Differential Revision: https://phabricator.services.mozilla.com/D76402
2020-05-22 15:08:54 +00:00
Greg Tatum 861a2adda1 Bug 1628073 - Add python 3 support to mozgeckoprofiler; r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D75579
2020-05-22 13:21:09 +00:00
Greg Tatum 5d3c780295 Bug 1628073 - Run black autoformatting on mozgeckoprofiler; r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D75578
2020-05-22 13:20:51 +00:00
Greg Tatum bce099a26d Bug 1628073 - Add a test for the view gecko profile tool; r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D74295
2020-05-22 13:20:10 +00:00
Greg Tatum af96a9bd04 Bug 1628073 - Add documentation to mozgeckoprofiler; r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D74292
2020-05-22 13:19:40 +00:00
Greg Tatum c5ee06d110 Bug 1628073 - Use mozlog in the mozgeckoprofiler; r=gbrown
This patch changes over all of the logging to use the structured mozlog package.
I also ensured that the messages were logged in a way to be useful for end users
of mochitests. This means there were a few small changes in methods in order to
accommodate the logging. The behavior outside of logging should be the same.

Differential Revision: https://phabricator.services.mozilla.com/D74291
2020-05-22 13:19:27 +00:00
Greg Tatum ced168b874 Bug 1628073 - Hook up symbolication to mochitests; r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D74290
2020-05-22 13:19:04 +00:00
Greg Tatum 593ab0604f Bug 1628073 - Move gecko profiler testing files to mozgeckoprofiler; r=sparky,perftest-reviewers,gbrown
I need to add symbolication support for the mochitest Gecko Profiler command line
option. These profiles also need to be symbolicated. Unfortunately, there is not
a common place where I could use these files. Talos and Raptor each had their
own copy of the snappy symbolication server.

This commit consolidates these packages into a re-usable mozbase package that can
be used in mochitests, and eventually in other places like xpcshell tests.

I stubbed out a test file, but it doesn't do anything quite yet. This commit makes
it so that the tests still work in Raptor and Talos, but doesn't add any features.
It also doesn't try too hard to make the files look like a mozbase package.

Differential Revision: https://phabricator.services.mozilla.com/D74289
2020-05-22 13:18:44 +00:00
Andrew Halberstadt 5ad7af589e Bug 1633866 - [taskgraph] Refactor logic around manifest chunking, r=egao
This sets things up to be a little bit easier and cleaner to modify going
forward. The taskgraph before/after this change is identical.

Differential Revision: https://phabricator.services.mozilla.com/D74452
2020-05-21 15:58:24 +00:00
Andrew Halberstadt a87fdb1bdb Bug 1634551 - [taskgraph] Move WPT group assignment into the TestResolver, r=egao
This moves the creation of WPT groups into the TestResolver, where all kinds of
other consumers will be able to access them.

Differential Revision: https://phabricator.services.mozilla.com/D76085
2020-05-20 17:51:20 +00:00
Marco Castelluccio 540b5cef71 Bug 1632242 - Mention results for groups in errorsummary even when the group passed or was skipped. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D74131
2020-05-19 20:51:10 +00:00
Cosmin Sabou 58c18a33bc Backed out changeset 04bda73f9d19 (bug 1628627) as requested by bebe. 2020-05-19 13:19:39 +03:00
Makoto Kato 780e5861e7 Bug 1638759 - Make android_device.py Python3 compatible. r=froydnj
`./mach run` or `./mach install` for GekcoView uses `android_device.py`, but
`android_device.py` isn't compatible with Python 3.

So, wWhen checking kvm (-accel-check), the following warning occurs.
```
WARNING: sequence item 0: expected str instance, int found
```

Also, when verifying emulator using telnet, the following exception occurs.
```
WARNING: Trying again after unexpected exception
```

Differential Revision: https://phabricator.services.mozilla.com/D75743
2020-05-18 20:06:54 +00:00
Geoff Brown d69ecc19e1 Bug 1637608 - Use adb instead of psutil to check for running emulator; r=bc
Differential Revision: https://phabricator.services.mozilla.com/D75427
2020-05-15 13:14:38 +00:00
Bob Clary 72989a3433 Bug 1634768 - [mozdevice] no longer wait for dev.bootcomplete property during initialization, r=gbrown.
Differential Revision: https://phabricator.services.mozilla.com/D75146
2020-05-14 14:35:17 +00:00
Dzmitry Malyshau ea310127f1 Bug 1637092 - Change WR capture path to point to the home folder r=Bert,webdriver-reviewers,whimboo
Point the captures to the home folder at all times.

Differential Revision: https://phabricator.services.mozilla.com/D74747
2020-05-12 13:41:31 +00:00
Andrew Halberstadt 07b4a29672 Bug 1633866 - [manifestparser] Modify 'chunk_by_runtime.get_chunked_manifests' to accept a list of manifests, r=egao
This is instead of tests and will make it easier to re-use in the taskgraph.
This commit is a straight refactor and results in zero differences in the
taskgraph.

Depends on D74448

Differential Revision: https://phabricator.services.mozilla.com/D74449
2020-05-08 21:25:18 +00:00
James Graham 88cdbbdcc1 Bug 1631819 - Allow disabling lsan entirely for directories, r=mccr8,maja_zf
This adds a new property lsan-disabled to wpt metadata files, which takes
a boolean to determine if lsan should be entirely disabled for that directory.

Differential Revision: https://phabricator.services.mozilla.com/D73918
2020-05-06 14:04:34 +00:00
Gregory Mierzwinski 5b6deb14a0 Bug 1625203 - Remove redundancy from mozproxy perfherder data names. r=perftest-reviewers,AlexandruIonescu,Bebe,davehunt
This patch reduces the redundancy in the mozproxy perfherder data names. It removes the `replay` suffix since it's already clear it's related to replay/not-replayed. The subtest names have the `mozproxy-replay` prefix removed through the addition of a new way of specifying supporting measurement values. Instead of only being able to submit the values with a `{measurement: values}` format, we can now submit it as `{measurement: {values: [], <SUBTEST-OPTIONS>}}`. The subtest options include perfherder-specific options, and some settings that change how the names are built. Furthermore, the full supporting data dictionary also includes two new fields: `summarize-values`, and `suffix-type`. The former dictates whether or not a summary value is produced, and the latter determines if the name should be suffixed with the data type.

Differential Revision: https://phabricator.services.mozilla.com/D72695
2020-05-05 19:54:46 +00:00
Ricky Stewart f13098f481 Bug 1634495 - Ensure that the debugger path is a str (instead of bytes) when running mach run debug r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D73338
2020-05-04 12:17:32 +00:00
Geoff Brown bd594817af Bug 1635300 - [mozdevice] Create parent directories to avoid intermittent mkdir failure; r=bc
Differential Revision: https://phabricator.services.mozilla.com/D73908
2020-05-05 16:22:16 +00:00
Geoff Brown 086057c9bf Bug 1634717 - Reduce scope of import of psutil in android_device.py; r=jmaher
Trivial change to reduce import dependencies for most callers.

Differential Revision: https://phabricator.services.mozilla.com/D73468
2020-05-01 18:24:48 +00:00
Nicholas Nethercote 95f587d624 Bug 1629789 - Suppress `fix-stacks` errors on web platform tests. r=erahm,jgraham
Because the web platform test harness doesn't recognize them and annotates them
with `CRITICAL`, which is disconcerting, even though those errors are typically
not harmful.

Differential Revision: https://phabricator.services.mozilla.com/D71485
2020-04-29 21:58:10 +00:00
Edwin Takahashi d70822c675 Bug 1608837 - change the name attribute of web-platform-test test object to use test.id from the manifest r=ahal
Changes:

Use the value from `test.id` instead of `test.path_parts[-1]` for the test object attribute `name`.

In effect, this will change the value as follows:

`about-blank-cannot-host.html` -> `/portals/about-blank-cannot-host.html`

Differential Revision: https://phabricator.services.mozilla.com/D73141
2020-04-30 17:08:29 +00:00
Edwin Takahashi ac3143d26d Bug 1633782 - disable manifestupdate logger so it does not pollute taskgraph generation output r=ahal
Changes:

The patch at D70727 is now triggering the resolving of web-platform-test suites when `cram(try)` was being run.

It appears the easiest way to ensure green runs for `cram(try)` is to simply suppress the log output from `manifestupdate`. It can be argued that those log outputs were not providing any useful information for taskgraph generation.

Differential Revision: https://phabricator.services.mozilla.com/D73152
2020-04-30 13:11:50 +00:00
Bob Clary 2b28bc95ba Bug 1634196 - [mozdevice 3.2.2] - relax root requirement during initialization, r=gbrown.
Differential Revision: https://phabricator.services.mozilla.com/D73244
2020-04-30 13:22:56 +00:00
Florin Strugariu 31cfde3fdb Bug 1628627 - [mozproxy] Mitmproxy is ignoring 301 requests r=perftest-reviewers,tarek,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D72338
2020-04-30 07:39:32 +00:00
Geoff Brown d014b03ba8 Bug 1633894 - [mozdevice] Use /system instead of /sdcard for ls test; r=bc
Differential Revision: https://phabricator.services.mozilla.com/D72971
2020-04-29 06:41:55 +00:00
Csoregi Natalia 1b3a4cf0fe Backed out changeset 9f796abfd8ca (bug 1629789) for causing issues on fixSymbols. CLOSED TREE 2020-04-28 14:47:30 +03:00
Nicholas Nethercote 9d10f25a39 Bug 1629789 - Suppress `fix-stacks` errors on web platform tests. r=erahm,jgraham
Because the web platform test harness doesn't recognize them and annotates them
with `CRITICAL`, which is disconcerting, even though those errors are typically
not harmful.

Differential Revision: https://phabricator.services.mozilla.com/D71485
2020-04-28 09:28:15 +00:00
Bob Clary 1559eee282 Bug 1633301 - [mozdevice] ADBDevice.rm should raise an error if the target was not deleted, r=gbrown.
Depends on D72575

Differential Revision: https://phabricator.services.mozilla.com/D72576
2020-04-27 15:47:04 +00:00
Edwin Takahashi 9804646f41 Bug 1608837 - add tests from web-platform-tests manifests into list of supported tests r=ahal
This change will permit the `TestResolver` to add web-platform-tests into the list of supported tests.

Changes:
  - add web-platform-test test objects to the list of supported tests.
  - adjust value of attributes name, manifest, manifest_relpath.

Differential Revision: https://phabricator.services.mozilla.com/D70727
2020-04-27 20:33:45 +00:00
Joel Maher 18ac0dd2f1 Bug 1632822 - create webrender list of crashtests to have focused tests on android phones. r=bc
create webrender list of crashtests to have focused tests on android phones

Differential Revision: https://phabricator.services.mozilla.com/D72570
2020-04-27 18:06:47 +00:00
Sylvestre Ledru 7f26dcf1b6 Bug 1617369 - Reformat recent rust changes with rustfmt r=emilio
Done with:
./mach lint -l rustfmt --fix
with
rustfmt 1.4.12-stable (a828ffe 2020-03-11)

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D72527
2020-04-25 21:21:32 +00:00
Joel Maher f8875234b3 Bug 1621095 - add reftest-qr to run focused webrender reftests on android phones. r=bc
add reftest-qr to run focused webrender reftests on android phones.

Differential Revision: https://phabricator.services.mozilla.com/D72312
2020-04-24 18:54:51 +00:00