Граф коммитов

2935 Коммитов

Автор SHA1 Сообщение Дата
Ionut Goldan ee1e094b81 Bug 1587398 - Provide schema support for tags r=perftest-reviewers,octavian_negru,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D53973

--HG--
extra : moz-landing-system : lando
2019-11-22 07:51:07 +00:00
Edwin Takahashi d7dd37c96e Bug 1595982 - fix incorrect import in python3 codepath inside mozharness/base/python.py r=aki
I mistakenly attempted to `import urllib.urlparse` instead of `urllib.parse`, which caused a bunch of tests running under python3.5 tox to be blocked on this.

This correction allows tox on python3.5 to run all 167 tests, allowing me to cross-check further python3 conversion work.

Differential Revision: https://phabricator.services.mozilla.com/D54041

--HG--
extra : moz-landing-system : lando
2019-11-20 22:44:27 +00:00
Emily Toop eed50278ff Bug 1597940 - Add missing comma causing gv-docs task to fail r=geckoview-reviewers,esawin
An error in updating the 64_geckoview_docs.py file (missing comma) caused perma fail of gv-docs task.

Differential Revision: https://phabricator.services.mozilla.com/D53942

--HG--
extra : moz-landing-system : lando
2019-11-20 15:42:44 +00:00
Ionut Goldan 6b860bc491 Bug 1597633 - Provide schema support for public suite & test names r=octavian_negru
Differential Revision: https://phabricator.services.mozilla.com/D53795

--HG--
extra : moz-landing-system : lando
2019-11-19 12:12:53 +00:00
Edwin Takahashi 11a563f214 Bug 1595982 - make mozharness::base::config.py and diskutils.py python3 compatible r=aki
Changes:

Replace `execfile` with python2/3 compatible equivalent `exec(compile(open))`.

Wrap `keys()` method with `list()` to enforce a list.

Compare to `six.string_types` instead of `unicode`.

The usual import and code formatting.


Fixes to `configure.py` should in particular fix a lot of the issues with tests running in tox-py35, since a lot of the tests get hung upon the `urllib2` import in `config.py`.

Differential Revision: https://phabricator.services.mozilla.com/D53895

--HG--
extra : moz-landing-system : lando
2019-11-20 00:49:27 +00:00
Edwin Takahashi 3ff09148df Bug 1597616 - make mozharness::lib python3 compatible r=aki
Changes:

Use the appropriate input method depending on the version.

As usual, sort the imports and auto format.

Differential Revision: https://phabricator.services.mozilla.com/D53853

--HG--
extra : moz-landing-system : lando
2019-11-19 20:13:46 +00:00
Christian Holler 8d974e5d12 Bug 1590162 - Add TSan builds to TaskCluster. r=catlee
Differential Revision: https://phabricator.services.mozilla.com/D50925

--HG--
extra : moz-landing-system : lando
2019-11-19 15:27:13 +00:00
Emily Toop 64fd791361 Bug 1585661 - Update mach geckoview-docs command to upload markdown as well as javadoc. r=agi
Slightly reorganize file structure to make copying files over easier. Needs to land in conjunction with https://github.com/mozilla/geckoview/pull/94, which should land first.

Differential Revision: https://phabricator.services.mozilla.com/D48564

--HG--
rename : mobile/android/docs/geckoview/Gemfile => mobile/android/docs/Gemfile
rename : mobile/android/docs/geckoview/_config.yml => mobile/android/docs/_config.yml
extra : moz-landing-system : lando
2019-11-14 15:53:53 +00:00
Edwin Takahashi 8f54e7437e Bug 1595982 - make mozharness::base::log.py and errors.py python3 compatible r=aki
Changes:

Reorder imports and general code style fixes.

Change reference to `basestring` to `six.string_types`.

Explicitly cast potential view object.

Depends on D52791

Differential Revision: https://phabricator.services.mozilla.com/D53119

--HG--
extra : moz-landing-system : lando
2019-11-18 18:20:16 +00:00
Edwin Takahashi 025bfd59a8 Bug 1595982 - make mozharness::base::vcs python3 compatible r=aki
Changes:

Run `isort` and `autopep8` to fix formatting mistakes.

Replace deprecated imports with `try/except` block to make it compatible with Python2 and 3.

Differential Revision: https://phabricator.services.mozilla.com/D53727

--HG--
extra : moz-landing-system : lando
2019-11-19 00:30:19 +00:00
Edwin Takahashi 533e9bdb87 Bug 1595982 - make mozharness::base::transfer.py python3 compatible r=aki
Changes:

Run `isort` to fix the import ordering.
Change import of `urllib2` module to import just `urlopen` which eliminates the need for an `if/else` or `try/except ` block in the main code section.

Depends on D52791

Differential Revision: https://phabricator.services.mozilla.com/D53097

--HG--
extra : moz-landing-system : lando
2019-11-18 18:17:55 +00:00
Edwin Takahashi 0eb0b823c2 Bug 1595982 - make mozharness::base::python.py python3 compatible r=aki
Changes:

Run `isort` to fix the import ordering.

Run `autopep8` to fix code formatting issues.

Import `six.string_types` to replace the `basestring` comparison.

Depends on D52791

Differential Revision: https://phabricator.services.mozilla.com/D53093

--HG--
extra : moz-landing-system : lando
2019-11-18 19:16:04 +00:00
Edwin Takahashi 8b53684fdc Bug 1596590 - remove unnecessary psutil 5.4.3 specification from desktop_unittest.py r=gbrown
Changes:

Remove the unnecessary psutil == 5.4.3 specifier in `desktop_unittest.py`.

This should be a safe change. Prior to this patch, in a given test task the virtrualenv initialization will first install `psutil==5.6.3`, then proceed to invoke `desktop_unittest.py` where the `psutil==5.4.3` version forces the uninstallation of the newer version to install the older version.

Differential Revision: https://phabricator.services.mozilla.com/D53302

--HG--
extra : moz-landing-system : lando
2019-11-16 04:58:02 +00:00
Edwin Takahashi 8c43d6096b Bug 1596982 - remove functools32 from the list of explicitly specified pip packages in python.py r=gbrown
Changes:

Do not explicitly specify `functools32` for installation, since pip is good at resolving dependencies.

Differential Revision: https://phabricator.services.mozilla.com/D53309

--HG--
extra : moz-landing-system : lando
2019-11-16 07:11:56 +00:00
Edwin Takahashi b3f2bda812 Bug 1595982 - make mozharness::base::script.py python3 compatible r=aki
Changes:

Run `isort` and `autopep8` for automatic fixes of import and code formatting.

Replace deprecated imports with updated imports for python3 and wrap the attempt in a `try/except` clause for backwards compatibility.

Wherever possible, directly import the object with same name between python2/python3 versions to simplify the main code (eg. HTTPError).

Differential Revision: https://phabricator.services.mozilla.com/D52791

--HG--
extra : moz-landing-system : lando
2019-11-15 23:52:04 +00:00
Geoff Brown aec6f7f22d Bug 1594982 - Initialize tbpl_status and worst_log_level in RaptorOutputParser; r=perftest-reviewers,sparky
Avoid intermittent failures: "AttributeError: 'RaptorOutputParser' object has no attribute 'tbpl_status'".
All mozharness OutputParser-derived classes normally initialize these variables; I neglected to do
so in bug 1592681.

Differential Revision: https://phabricator.services.mozilla.com/D52675

--HG--
extra : moz-landing-system : lando
2019-11-15 14:51:11 +00:00
Stephen Donner 264606fba7 Bug 1537944. Add conditioned-profile support for desktop Firefox in Raptor. r=perftest-reviewers,tarek,sparky, ?tarek
Differential Revision: https://phabricator.services.mozilla.com/D49970

--HG--
extra : moz-landing-system : lando
2019-11-15 14:59:21 +00:00
Geoff Brown 8bf96dc04c Bug 1595245 - Translate remaining uncaught mozharness ADBErrors into task retries; r=bc
Most mozdevice access in mozharness was already encapsulated in try blocks, with only the
shell_output() case neglected, consistent with the observed intermittent failures.

Differential Revision: https://phabricator.services.mozilla.com/D52879

--HG--
extra : moz-landing-system : lando
2019-11-14 15:45:45 +00:00
Mihai Alexandru Michis 82b9b5ee82 Backed out 2 changesets (bug 1585661) for causing lint failures. CLOSED TREE
Backed out changeset 915910348bce (bug 1585661)
Backed out changeset 126b37477819 (bug 1585661)

--HG--
rename : mobile/android/docs/Gemfile => mobile/android/docs/geckoview/Gemfile
rename : mobile/android/docs/_config.yml => mobile/android/docs/geckoview/_config.yml
2019-11-14 17:50:28 +02:00
Emily Toop 24c2ec00cd Bug 1585661 - Update mach geckoview-docs command to upload markdown as well as javadoc. r=agi
Slightly reorganize file structure to make copying files over easier. Needs to land in conjunction with https://github.com/mozilla/geckoview/pull/94, which should land first.

Differential Revision: https://phabricator.services.mozilla.com/D48564

--HG--
rename : mobile/android/docs/geckoview/Gemfile => mobile/android/docs/Gemfile
rename : mobile/android/docs/geckoview/_config.yml => mobile/android/docs/_config.yml
extra : moz-landing-system : lando
2019-11-14 14:23:46 +00:00
Mihai Alexandru Michis 64a0fd0a54 Backed out 2 changesets (bug 1585661) for causing lint failures.
Backed out changeset c1e90bf96e14 (bug 1585661)
Backed out changeset 1f2c6dc5a14e (bug 1585661)

--HG--
rename : mobile/android/docs/Gemfile => mobile/android/docs/geckoview/Gemfile
rename : mobile/android/docs/_config.yml => mobile/android/docs/geckoview/_config.yml
extra : histedit_source : dbb04b7ddd7036853b5f714e4b61f542903698f5
2019-11-14 15:35:02 +02:00
Emily Toop 4bce142d85 Bug 1585661 - Update mach geckoview-docs command to upload markdown as well as javadoc. r=agi
Slightly reorganize file structure to make copying files over easier. Needs to land in conjunction with https://github.com/mozilla/geckoview/pull/94, which should land first.

Differential Revision: https://phabricator.services.mozilla.com/D48564

--HG--
rename : mobile/android/docs/geckoview/Gemfile => mobile/android/docs/Gemfile
rename : mobile/android/docs/geckoview/_config.yml => mobile/android/docs/_config.yml
extra : moz-landing-system : lando
2019-11-14 12:21:29 +00:00
Geoff Brown 8c26b2ef56 Bug 1594735 - Upgrade android emulator used for x86_64 xpcshell tests; r=aerickson
Upgrade the emulator used by xpcshell tests to 29.2.1, the same version used
by all other android tests.
We have delayed this upgrade because of intermittent failures seen on the new
emulator not seen previously - bug 1568063. After the packet.net upgrade to
Ubuntu 18.04, try runs with the new emulator show that bug 1568063 persists
but has less impact than the intermittent failures it resolves: More tests
pass consistently with the new emulator than with the old.

Differential Revision: https://phabricator.services.mozilla.com/D52851

--HG--
extra : moz-landing-system : lando
2019-11-13 17:46:02 +00:00
Andreea Pavel 03ff4d65f1 Backed out changeset 776dc76ec598 (bug 1567122) for landing without proper peer review on a CLOSED TREE 2019-11-12 18:46:03 +02:00
Marian Raiciof 548d1181f8 Bug 1567122 - Enable Fission for AWSY r=perftest-reviewers,stephendonner,sparky
Differential Revision: https://phabricator.services.mozilla.com/D48660

--HG--
extra : moz-landing-system : lando
2019-11-12 14:07:17 +00:00
Tom Prince 069263ab46 Bug 1595368: [firefox-ci] Use consitent logic to determine tooltool url; r=sfraser a=task-fix
Differential Revision: https://phabricator.services.mozilla.com/D52498

Depends on D52497

--HG--
extra : histedit_source : 4b7e40193155303d8757f08aabe670e4dd127924
2019-11-11 05:50:11 +01:00
Andreea Pavel d13f63b931 Backed out changeset 69049d8a2c4b (bug 1594530) on tomprince's request. CLOSED TREE 2019-11-10 05:33:35 +02:00
Dorel Luca a194206e3c Backed out changeset ac63c8962183 (bug 1594530) on tomprince's request. CLOSED TREE 2019-11-10 05:13:38 +02:00
octavian.negru f59cfa05b9 Bug 1593694 - Mirror bigger item max on mozilla-central r=perftest-reviewers,igoldan
Differential Revision: https://phabricator.services.mozilla.com/D52136

--HG--
extra : moz-landing-system : lando
2019-11-08 08:12:54 +00:00
Tom Prince 57fdb2bbe4 Bug 1594530: [firefox-ci] Fix staging tooltool URL; r=Callek a=tomrpince CLOSED TREE
MANUAL PUSH: Firefox-CI migration testing

Differential Revision: https://phabricator.services.mozilla.com/D52125

--HG--
extra : rebase_source : 56663925c5461fc5fcd51a0ce5da8a3d9940b0d4
extra : histedit_source : 783da1f32b91e1377868d21b1b879c6276e25035
2019-11-07 16:07:45 -07:00
Geoff Brown 727dbab951 Bug 1592754 - Improve TV handling of modified reftest reference files; r=ahal
Replace the existing regex-based hack for recognizing reftest reference files
with a reliable method based on the reftest manifest.

Differential Revision: https://phabricator.services.mozilla.com/D51172

--HG--
extra : moz-landing-system : lando
2019-11-06 22:42:59 +00:00
Justin Wood 14d300d137 Bug 1594530 Make tooltool via the taskcluster proxy work on both legacy and firefox-ci clusters at the same time. r=tomprince a=Aryx
MANUAL PUSH: (a) This patch will cause a ton of toolchain rebuilds, and might as well do that on central right now rather than autoland, and (b) We want to test the new Taskcluster instance today, and will be testing THAT on m-c, so we'll need this patch on m-c before we can test the new cluster as well.

tooltool at present needs to support production (legacy cluster) but its auth system is tied to that cluster.

Which means that using tooltool in the new cluster ahead of TCW is harder. We have swapped the credentials for the tooltool staging deployment to use the new tc cluster, so when we're using the taskcluster proxy we need to have it swap between legacy and new tooltool url's depending on which cluster (ROOT_URL) we're using.

This patch is intended to be ok to land on production code today, and could be backed out after the TCW when production tooltool will be configured to work with the firefox-ci cluster itself.

Differential Revision: https://phabricator.services.mozilla.com/D52089
2019-11-06 16:37:22 -07:00
Mihai Alexandru Michis 831cece345 Backed out changeset 4db47986ccce (bug 1592754) for causing TV failures. CLOSED TREE 2019-11-06 10:47:08 +02:00
Geoff Brown 0f2ca103da Bug 1592754 - Improve TV handling of modified reftest reference files; r=ahal
Replace the existing regex-based hack for recognizing reftest reference files
with a reliable method based on the reftest manifest.

Differential Revision: https://phabricator.services.mozilla.com/D51172

--HG--
extra : moz-landing-system : lando
2019-11-04 21:49:51 +00:00
Gregory Mierzwinski 9c2e769ec2 Bug 1587576 - Part 1: Add ability to get browser version. r=perftest-reviewers,rwood
This is the first part of a patch that adds chrome support to raptor-browsertime.

In this patch, a get_browser_meta function is added which returns the name and version of the browser being tested. This version will then be used (in part 3) in the variable passed in through --browsertime-chromedriver (only when running not locally, or if we find {} in the string).

Differential Revision: https://phabricator.services.mozilla.com/D48895

--HG--
extra : moz-landing-system : lando
2019-11-04 19:52:36 +00:00
Ionut Goldan 352a1a928c Bug 1593192 - Add schema validation for name & version of application under test r=perftest-reviewers,sparky,octavian_negru
Differential Revision: https://phabricator.services.mozilla.com/D51410

--HG--
extra : moz-landing-system : lando
2019-11-05 09:47:34 +00:00
Geoff Brown 38dd21ea87 Bug 1593779 - Bail out of test-verify tasks faster when there is no work to do; r=bc
This minor optimization is easily implemented: If there are no tests to verify, call fatal(0).
However, I encountered a minor obstacle: If the task exits before creating the upload directory,
the task fails, regardless of exit value; the remaining changes overcome this by creating the
upload directory earlier.

Differential Revision: https://phabricator.services.mozilla.com/D51684

--HG--
extra : moz-landing-system : lando
2019-11-04 21:46:57 +00:00
Geoff Brown fa9b5dc0f3 Bug 1592681 - Update raptor mozharness output parser to respect retry regex; r=perftest-reviewers,rwood
When certain strings are logged - "ADBTimeoutError", "INFRA-ERROR", etc - mozharness tasks
usually retry: The task exits with TBPL_RETRY (4), is reported as "blue" in treeherder, and
a new task is automatically started. This patch implements missing retry logic for raptor
tasks, copying the logic from
https://searchfox.org/mozilla-central/rev/59de675101da711520c0bb6e34a1ea2372e7ddbb/testing/mozharness/mozharness/mozilla/testing/unittest.py#169-174

Differential Revision: https://phabricator.services.mozilla.com/D51432

--HG--
extra : moz-landing-system : lando
2019-11-04 16:41:12 +00:00
Ionut Goldan f03003f819 Bug 1590346 - Provide json schema support for measurement units r=octavian_negru,perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D50044

--HG--
extra : moz-landing-system : lando
2019-11-04 14:56:10 +00:00
Andrew Halberstadt 0b1bb56b96 Bug 1583353 - [mozharness] Remove '-chunked' mochitest and jittest suite definitions, r=gbrown
Having a distinction between -chunked and not adds unnecessary complexity. It's
possible to simply remove them because:

1. The mozharness definitions for 'jittest' and 'jittest-chunked' are
identical, so it is literally not serving any purpose.

2. The definitions for 'mochitest' only add either '--chunk-by-dir' or
'--chunk-by-runtime'. Both of these are no-ops in the mochitest harness
unless '--total-chunks' is also supplied. Therefore, if we ever use these
suites without chunking (which I don't think we do anyway), then it'll
still work fine as those options won't have any affect.

Differential Revision: https://phabricator.services.mozilla.com/D51173

--HG--
extra : moz-landing-system : lando
2019-10-30 21:41:24 +00:00
Sebastian Hengst 3dc3a1599d Bug 1591678 - add process name to regexps for harness errors to let their occurrences trigger the task to fail. r=jlund
Differential Revision: https://phabricator.services.mozilla.com/D50700

--HG--
extra : moz-landing-system : lando
2019-11-01 00:29:23 +00:00
Edwin Takahashi 128ef1e636 Bug 1212502 - Switch mozinfo to using the 'distro' package to get linux distribution info r=ahal,KWierso
Differential Revision: https://phabricator.services.mozilla.com/D49366

--HG--
extra : moz-landing-system : lando
2019-10-30 20:42:50 +00:00
Tarek Ziadé 63ab3346a0 Bug 1578862 - Feed --browsertime Raptor task videos into new visual metrics task type r=rwood,sparky,jlorenzo,barret
Feed --browsertime Raptor task videos into new visual metrics task type

Differential Revision: https://phabricator.services.mozilla.com/D48656

--HG--
extra : moz-landing-system : lando
2019-10-29 19:31:23 +00:00
Geoff Brown 8852ffec71 Bug 1592385 - Update test-verify android defaults; r=bc
Android TV has appropriate configuration, so updating these defaults makes
no practical difference, but I think it looks a little more modern.

Differential Revision: https://phabricator.services.mozilla.com/D50986

--HG--
extra : moz-landing-system : lando
2019-10-29 20:08:38 +00:00
Sylvestre Ledru ba7c03e388 Bug 1590310 - Hide the copyright section by default r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D50028

--HG--
extra : moz-landing-system : lando
2019-10-22 17:37:38 +00:00
Geoff Brown 2db26769a3 Bug 1589691 - For android-hw tests, ensure test app is uninstalled before trying to install; r=bc
On android-hw, if it looks like the app to be installed is already installed, uninstall it
first. I don't think this is a possibility on android-em, so I am only changing the hardware
script.

Differential Revision: https://phabricator.services.mozilla.com/D50224

--HG--
extra : moz-landing-system : lando
2019-10-23 14:10:53 +00:00
Edwin Takahashi 89d92ba2fe Bug 1590399 - do not attempt to call pulseaudio initialization (linux only) on other platforms r=gbrown
Differential Revision: https://phabricator.services.mozilla.com/D50112

--HG--
extra : moz-landing-system : lando
2019-10-22 18:54:46 +00:00
Dorel Luca 3d43b20c77 Backed out changeset ca117d13ca06 (bug 1212502) for Windows 2012 build bustage. CLOSED TREE 2019-10-22 20:53:27 +03:00
Wes Kocher 49fba76f39 Bug 1212502 - Switch mozinfo to using the 'distro' package to get linux distribution info r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D49366

--HG--
extra : moz-landing-system : lando
2019-10-22 17:33:13 +00:00
Edwin Takahashi 962dd7ee27 Bug 1565332 - change how pulseaudio is initialized for Debian 10 test image without affecting existing Ubuntu 16.04 process r=jlund,dustin
Changes:
- for Debian platforms, do not initialize pulseaudio in `test-linux.sh`; instead initialize pulseaudio if required in the `desktop_unittest.py` mozharness script

Differential Revision: https://phabricator.services.mozilla.com/D45768

--HG--
extra : moz-landing-system : lando
2019-10-21 16:34:43 +00:00