Граф коммитов

181 Коммитов

Автор SHA1 Сообщение Дата
Chris Manchester 4aaad1ce55 Bug 1313716 - Don't provide a blank subsuite as a default in the manifestparser. r=ahal
This causes consumers managing defaults themselves to fail to find a default
subsuite for tests, because the manifestparser will have provided a blank
default value by the time they incorporate defaults into a test definition.
This patch removes the provided defaults and updates a number of places assuming
the 'subsuite' field is always present.

MozReview-Commit-ID: 1jPy52VmEPr
2016-10-31 10:04:42 -07:00
Kris Maglione 3a59c31923 Backed out changeset 425c0602ccb4 (bug 1313716) for breaking mach mochitest. r=backout
MozReview-Commit-ID: pTW1acQYLV
2016-10-30 19:17:13 -07:00
Chris Manchester 2de89e603a Bug 1313716 - Don't provide a blank subsuite as a default in the manifestparser. r=ahal
This causes consumers managing defaults themselves to fail to find a default
subsuite for tests, because the manifestparser will have provided a blank
default value by the time they incorporate defaults into a test definition.
This patch removes the provided defaults and updates a number of places assuming
the 'subsuite' field is always present.

MozReview-Commit-ID: 1jPy52VmEPr

--HG--
extra : rebase_source : be7a2504af6853abb1bc532a058738f33d8dcbee
2016-10-28 11:07:21 -07:00
Andrew Halberstadt 5ca5caf353 Bug 1308202 - Remove all b2g and mulet related code from testing/mochitest, r=jmaher
MozReview-Commit-ID: BfIJLp6oGHO

--HG--
extra : rebase_source : 7202f2a6026a4082f0561045dd8e2f4da0baa424
2016-10-06 10:05:27 -04:00
Dan Minor b6a69257fd Bug 1306717 - Mach command for mochitests ignores --manifest option; r=ahal
MozReview-Commit-ID: E97QUfdG3sY

--HG--
extra : rebase_source : 15751667fa2d19e6d6bcd0b94aad96a6d1861740
2016-10-03 08:23:14 -04:00
Prabhjyot Singh Sodhi ebb9f983f1 Bug 1280571 - Add testing/mochitest to the flake8 linter, r=ahal
MozReview-Commit-ID: INBZaZzcPmF

--HG--
extra : rebase_source : c0ba416f110b2768fc744de0fbee21c765081400
2016-09-28 08:28:04 -04:00
Wes Kocher 765926408d Backed out changeset e1d144423657 (bug 1280571) for making leaks hard to diagnose a=backout CLOSED TREE 2016-09-21 16:56:50 -07:00
Prabhjyot Singh Sodhi 58b6130e52 Bug 1280571 - Add testing/mochitest to the flake8 linter, r=ahal
This also adds E402 (no imports at top of file) to the global ignore list. The
other error codes added were previously ignored by default, but now that we
have started a custom ignore list, need to be listed explicitly.

MozReview-Commit-ID: RtMuVEX6i5

--HG--
extra : rebase_source : 939bc9354f5891c680513d7e9068d0438e169132
2016-09-21 08:49:46 -04:00
Andrew Halberstadt e0d54aa2ed Bug 1294099 - Fix 'Namespace object has no attribute 'flavor'' error when running |mach mochitest|, r=jgriffin
MozReview-Commit-ID: Du2fvVCNeHU

--HG--
extra : rebase_source : 75b16326d4529a0ad34cf4a382303c7e9c06611f
2016-08-10 11:50:29 -04:00
Andrew Halberstadt 795728d89d Bug 1293295 - Replace all mochitest 'flavor' options with a single --flavor argument, r=jmaher
This accomplishes three things:

1) Easier to use CLI when running without the benefit of testing/mochitest/mach_commands.py
2) Guarantees these arguments are mutually exclusive
3) Simplifies a bunch of logic in the test harness

The primary motivation for this change is to slightly improve the UX when running mochitest
from a taskcluster interactive loaner. However, this is more of a bandaid solution that was
easy to implement before the proper fix in bug 1293259 can be landed.

MozReview-Commit-ID: IeHBGrJ0Sji

--HG--
extra : rebase_source : ba1b7e437881e363fe0051dccd3d732221311c59
2016-08-08 11:48:49 -04:00
Andrew Halberstadt 16c7acfe05 Bug 1292660 - Fix |mach mochitest| kwargs['app'] is None error on android, r=gbrown
This fixes a regression from bug 1288827. It happened because I moved the logic that finds
the application path a little later on in the test harness. But there was an instance where
it was being used in the android mach command before that point.

As it turned out, we don't really *need* that value there. This patch grabs the same value
from build_obj.substs which is already an argument to the function.

MozReview-Commit-ID: 3IsI4VzEIIF

--HG--
extra : rebase_source : ceb718b265c7886b831e0378436baebf2b4e7598
2016-08-05 16:40:08 -04:00
Andrew Halberstadt e920337e70 Bug 1288827 - Allow running mochitest from test-package without specifying --appname, r=armenzg
Because it is now possible for options.app to get set after 'parse_args' time, we need to make sure
the argument validation happens later. To accomplish this we pass in the parser instance to
'run_test_harness' and do parser.validate there. This unfortunately requires some minor uses of
global to accomplish easily due to how mach handles parsers.

MozReview-Commit-ID: s3Js1aZlSE

--HG--
extra : rebase_source : 3a94debda3dbed839074094707cadf32e7f7337c
2016-07-20 11:13:30 -04:00
Carsten "Tomcat" Book e7b290ff7c Backed out changeset 6dcb52d270c7 (bug 1288827) for breaking mochitests 2016-07-28 17:04:42 +02:00
Andrew Halberstadt 142c93927d Bug 1288827 - Allow running mochitest from test-package without specifying --appname, r=armenzg
Because it is now possible for options.app to get set after 'parse_args' time, we need to make sure
the argument validation happens later. To accomplish this we pass in the parser instance to
'run_test_harness' and do parser.validate there. This unfortunately requires some minor uses of
global to accomplish easily due to how mach handles parsers.

MozReview-Commit-ID: s3Js1aZlSE

--HG--
extra : rebase_source : d5aa12dbdb8acd116a27f768eb8ce7f10293504b
2016-07-20 11:13:30 -04:00
Wes Kocher 20598f44f6 Backed out changesets baa6c68ec413,5b8583070c9e,2942bb31152c,dd2ad6863f53,c68772362633,c8db6695b991 (bug 1231981) a=backout
MozReview-Commit-ID: EoGyz071RoN

--HG--
extra : amend_source : 69d6593ae0a946ed6366513a2e186b43c7435440
extra : histedit_source : cdce5a0698d6e7996ae731cff56263abc202ae65%2Ca62e94bdb37fc3e9266884f283d732e61e0f4715
2016-04-27 10:24:37 -07:00
Byron Campen [:bwc] a4e2b3e713 Bug 1231981 - Part 5: Install python packages we need in the virtualenv if not present. r=gps
MozReview-Commit-ID: 9PUHLMxHhQP

--HG--
extra : rebase_source : 5e863a5cf5d60c698d97c0f65070b89b2d8295bd
extra : source : 6848d362c947bf306b650cac7bb6a89981af474b
2016-03-16 15:40:17 -05:00
Carsten "Tomcat" Book e9599aa66e Backed out changeset 5a0d061f7548 (bug 1231981) 2016-04-25 16:28:50 +02:00
Byron Campen [:bwc] c87769deb2 Bug 1231981 - Part 5: Install python packages we need in the virtualenv if not present. r=gps
MozReview-Commit-ID: 9PUHLMxHhQP

--HG--
extra : rebase_source : f7a4bcff98f436242167dac03cf58973be0e26e6
2016-03-16 15:40:17 -05:00
Chris Manchester a7138cfc10 Bug 1242051 - Install test files to the objdir lazily rather than with each invocation of mach. r=gps
This moves test installation for test files out of the monolithic install
manifest for $objdir/_tests, and determines the test and support files
to install based on the object derived from all-tests.json. Additionally,
the files resulting from TEST_HARNESS_FILES are installed, as some tests
will depend on them.

As a result, the time to install tests when invoking the test runner will
scale with the number of tests requested to run rather than the entire set
of tests in the tree, resulting in significantly less overhead.

MozReview-Commit-ID: LeIrUVh1yD4
2016-04-04 14:56:52 -07:00
Myk Melez db9a40ca42 Bug 1238079 - remove the desktop web runtime; r=fabrice,mossop,gps,jryans,jmaher,marco 2016-03-07 13:33:12 -08:00
Geoff Brown 6fe30ec610 Bug 1241907 - Grant runtime permissions before running browser tests; r=jmaher 2016-02-01 15:52:34 -07:00
Geoff Brown aa39bdf6ec Bug 1240767 - Handle incorrect test paths in 'mach robocop'; r=jmaher 2016-01-21 16:59:44 -07:00
Simon Gareste f2c7f460ab Bug 1231806 - Fix abnormal blank lines quantity. r=ted 2015-12-28 03:23:37 -05:00
Simon Gareste c648b1b357 Bug 1231806 - Fix continuation line under-indented for visual indent. r=ted 2015-12-21 14:22:06 -05:00
Simon Gareste 60fb6a6b49 Bug 1231806 - Useless import. r=ted 2015-12-21 14:21:51 -05:00
Andrew Halberstadt 629335ccca Bug 1225903 - Drop support for b2g desktop in mochitest, r=jgriffin
Mochitests on b2g desktop are no longer being run on any trunk branches, including
b2g-inbound. Dropping support for it significantly reduces complexity
in the mochitest harness.

--HG--
extra : commitid : jAe5IJxAQp
extra : rebase_source : 5f163aea70fb99a95667fdafeb7b3361bed1f82d
2015-11-18 13:35:38 -05:00
Wes Kocher 480b4c994e Backed out changeset 6ab228593820 (bug 1225903) for android robocop bustage CLOSED TREE
--HG--
extra : commitid : Jt9KCML2G2Y
2015-11-19 11:54:17 -08:00
Andrew Halberstadt 60681c7eb8 Bug 1225903 - Drop support for b2g desktop in mochitest, r=jgriffin
Mochitests on b2g desktop are no longer being run on any trunk branches, including
b2g-inbound. Dropping support for it significantly reduces complexity
in the mochitest harness.

--HG--
extra : commitid : 6wYdpJe0jU0
extra : rebase_source : 69d997a523551210b156e09de339fd6bc8cf2504
extra : amend_source : aed1da36f41210339ab91d53cb34ac2e7b0d770c
2015-11-18 13:35:38 -05:00
Nick Alexander ade40baf2d Bug 938994 - Move build/mobile/robocop into mobile/android/tests/browser/robocop. r=gbrown
This builds the Robocop tests with |mach build mobile/android|, making
it easier for developers to build Fennec and the tests at the same
time.

--HG--
rename : build/mobile/robocop/AndroidManifest.xml.in => mobile/android/tests/browser/robocop/AndroidManifest.xml.in
rename : build/mobile/robocop/Makefile.in => mobile/android/tests/browser/robocop/Makefile.in
rename : build/mobile/robocop/README => mobile/android/tests/browser/robocop/README
rename : build/mobile/robocop/moz.build => mobile/android/tests/browser/robocop/moz.build
rename : build/mobile/robocop/res/values/strings.xml => mobile/android/tests/browser/robocop/res/values/strings.xml
rename : build/mobile/robocop/robotium-solo-4.3.1.jar => mobile/android/tests/browser/robocop/robotium-solo-4.3.1.jar
extra : commitid : BuNBjgXdm1d
extra : rebase_source : c36b8bf0183d8f5821b7f7839668ca963065d894
extra : histedit_source : a86fef3b834420ea496a9c2644ca72786a2d7da9
2015-11-09 12:55:38 -08:00
Edgar Chen e0ac6671b5 Bug 1211407 - Make |mach mochitest| use the adb under `out/host/*/bin` if no --adbpath specified. r=ahal
--HG--
extra : transplant_source : %E8%EF%D5%B0%BF%EA6%AA%A1Y%07%8C%DC%82%8B%D6%E0%FE%0F%21
2015-10-05 19:11:52 +08:00
Xidorn Quan c13216ec53 Bug 1205144 - Remove 'REMOVED' commands from output of mach-commands and mach-debug-commands. r=gps DONTBUILD
--HG--
extra : source : 7d40827d58f699b57668ad80573e93b3b0a8d0b0
extra : amend_source : 98c5b7adbd1a330528d70a8f41096cd26fe49bdd
2015-09-21 11:32:03 +10:00
Geoff Brown 0fd7fa94c8 Bug 1199377 - Fetch host-utils for Android tests when needed; r=jmaher 2015-09-16 16:58:52 -06:00
Geoff Brown 2015a6ea72 Bug 1164596 - Add mach android-emulator command; r=ahal 2015-09-01 15:07:53 -06:00
Vaibhav Agrawal 1bd565d6df Bug 999450 - Add find-test-chunk command in mach to discover the chunk for a mochitest on a platform. r=chmanchester
--HG--
extra : rebase_source : 1bf71ba005dd9f6d63167b9e6e0f074b1489215c
2015-08-26 16:51:15 -07:00
Andrew Halberstadt e318244a76 Bug 1185761 - [mochitest] Allow boolean values to --keep-open for overriding the default, r=ted
Most of the time the default is to close the browser after tests run. And that can be overridden with
--keep-open. But in some corner cases, the default is to leave the browser open after tests have run.
In these cases, it is not currently possible to override.

This patch allows the syntax --keep-open or --keep-open=false, the latter overrides the edge case
default.

--HG--
extra : commitid : 52IHmZFn1uj
extra : rebase_source : 50ce300ccb08f87e5c9337b945d538c0a17ac04d
2015-08-06 17:40:54 -04:00
Myk Melez 64b1765466 Bug 1181867 - move -runtime flag to runtests.py so it gets set in automation; r=jland,ahalberstadt 2015-07-20 09:38:49 -07:00
Geoff Brown 65e4c8cee0 Bug 1179981 - A new test harness for robocop; r=jmaher 2015-07-09 12:30:01 -06:00
Myk Melez 445032c4c3 Bug 1168737 - specify runtime with command-line arg on Mac for tests; r=jmaher,marco 2015-06-26 09:22:40 -07:00
Gregory Szorc 3e949ee8fe Bug 1176642 - Use absolute_import in mach_commands.py files; r=glandium
This removes ambiguity as to which modules are being imported, making
import slightly faster as Python doesn't need to test so many
directories for file presence.

All files should already be using absolute imports because mach command
modules aren't imported to the package they belong to: they instead
belong to the "mach" package. So relative imports shouldn't have been
used.

--HG--
extra : commitid : 6tFME1KKfTD
extra : rebase_source : 78728f82f5487281620e00c2a8004cd5e1968087
2015-06-21 17:39:09 -07:00
Andrew Halberstadt 42888ae5f5 Bug 1171971 - Move test_paths argument out of mach and into mochitest; remove --test-path, r=chmanchester
--HG--
extra : commitid : KbQllMAJdfl
extra : rebase_source : 2069e41c760e4993b1d6d0ddd70799e426a19089
2015-06-05 13:28:29 -04:00
Nick Alexander 97786c5695 Bug 1169476 -- Implement |mach robocop --serve|. r=gbrown
This adds a flag to |mach robocop| that does everything to run a
Robocop test except launch the actual test.  Instead of launching the
test, it starts the mochi.test server and launches Fennec with a test
profile; then it sits and waits forever.

This allows regular Java IDEs (IntelliJ, but previously Eclipse) to
run Robocop tests like regular instrumentation tests, "injecting" them
into the prepared testing environment.  It's quite nice!

--HG--
extra : rebase_source : a5ab08222110a20291aebe70ef1fda0d340dbe7d
extra : source : e91ac9a35f86928fcd519911476ee7d68d06f921
2015-05-29 17:18:07 -07:00
Wes Kocher d80ffbf1c9 Merge inbound to central, a=merge 2015-06-02 18:20:12 -07:00
Nick Alexander 380f58055f Bug 1170332 - Fix |mach robocop SINGLE_TEST|. r=ahal,gbrown
This patch declares robocop.ini an instrumentation manifest.  It's not
currently possible to declare tests that don't correspond to files, so
we include the .java extension.  (This could be revisited.)

In |mach robocop|, we use the generic test resolving infrastructure to
select the 'instrumentation'/'robocop' flavor/subsuite tests.  In
|runtestsremote.py|, we fall back to robocop.ini, as we always have.

--HG--
extra : rebase_source : b84246ab327c7ec576d82cc4b516e729978600c7
extra : histedit_source : 9b23a6f66e6422e5f334f31cea2a21036be45543
2015-06-01 14:45:48 -07:00
Andrew Halberstadt 66850078f4 Bug 1122590 - Make |mach mochitest| properly detect devtools tests (and other subsuites), r=chmanchester, DONTBUILD, a=NPOTB
--HG--
extra : commitid : F1JLpseHkrE
extra : rebase_source : 95a5f0516e286a1f9752c39ebc23ebb6349b33c6
extra : amend_source : 90c4fe59dc89dfce41d616326ce8e20e44c04e9a
2015-06-02 11:03:55 -04:00
Andrew Halberstadt 7aa80fb529 Bug 1164597 - Consolidate all mochitest mach commands into single |mach mochitest|, r=chmanchester
--HG--
extra : rebase_source : 0a0d8a454df10ae9df9678c98e11b5eaf8249f51
2015-05-05 16:41:59 -04:00
Myk Melez 4a89e36100 bug 1125394 - launch runtime executable stub from test app bundle on Mac; r=jmaher,marco 2015-05-06 16:27:33 -07:00
Andrew Halberstadt 457f496287 Bug 1155338 - Move mach command arguments into mochitest harness, r=chmanchester,gbrown
--HG--
extra : rebase_source : 60275814c319afd866de426cb8b2937a3adbcb34
extra : source : f4f4e2be37652cb1dc23f066725a0f8868bb411b
2015-04-30 13:47:01 -04:00
Phil Ringnalda c805f510d5 Back out f4f4e2be3765 (bug 1155338) for Android 4.0/debug mochitest bustage
CLOSED TREE
2015-05-04 18:28:16 -07:00
Andrew Halberstadt a0e4007522 Bug 1155338 - Move mach command arguments into mochitest harness, r=chmanchester,gbrown
--HG--
extra : rebase_source : 68cc709ec5a9ab9bec563e555d6fc25cf149dd38
2015-04-30 13:47:01 -04:00
Nick Alexander 8daa51d1dc Bug 1160662 - Refer to robocop.ini in $OBJDIR/_tests, not $OBJDIR. r=margaret
--HG--
extra : rebase_source : 4b2f24feb33db1109d178d833cd59a7b7812167a
2015-05-01 14:51:27 -07:00