Граф коммитов

31 Коммитов

Автор SHA1 Сообщение Дата
Rolf Bjarne Kvinge 43f84f6ca7 [xharness] Improve device selection, taking wireless devices into account. (#2827)
* [xharness] Don't list unusable devices.

* [xharness] Show the list of candidate devices in the html report.

* [xharness] Prioritize devices depending on the interface speed.
2017-10-02 17:37:19 +02:00
Rolf Bjarne Kvinge ea3f9736e1 [xharness] Don't freak out if we find a device we can't categorize. (#2824)
It's most likely just an untrusted device (in which case DeviceClass will be
an empty string).
2017-10-02 17:37:00 +02:00
Rolf Bjarne Kvinge fdaeb9f2d2 [xharness] Don't try to run 32-bit tests on devices that don't support 32-bits. (#2749) 2017-09-22 19:53:35 +02:00
Rolf Bjarne Kvinge 551000c185 [xharness] Bump the device listing timeout to 2 minutes. (#2754)
Based on local experiments, sometimes it takes over a minute now 😞
2017-09-22 18:05:21 +02:00
Rolf Bjarne Kvinge 1ba523011a [xharness] Add support for manually reloading devices/simulators from the html UI. (#2753)
This is useful when forgetting to plug in a device before launching the web ui.
2017-09-22 18:04:55 +02:00
Sebastien Pouliot 05eb96d0a7 Merge branch 'xcode9' into xcode9-master-merge 2017-09-15 11:05:30 -04:00
Rolf Bjarne Kvinge ea73f99112 [xharness] Load simulators and devices in parallel. (#2442)
This speeds the launch up a little bit.
2017-08-08 19:34:59 +02:00
Rolf Bjarne Kvinge 2c6c24b51f [xharness] Make sure we complete simulator loading even if loading fails. (#2435)
This fixes an indefinite wait when loading the simulators fails.
2017-08-04 16:14:53 +02:00
Rolf Bjarne Kvinge 0ab72c1cd4 [xharness] Add a timeout for loading simulators/devices. (#2433)
30 seconds should be enough for both.
2017-08-04 14:31:32 +02:00
Rolf Bjarne Kvinge 207f16da09 [xharness] Fix enumerating an empty set of simulators. (#2436) 2017-08-04 14:30:38 +02:00
Rolf Bjarne Kvinge 29c04173ea [xharness] Make sure to mark device listing as completed even if it fails. (#2419) 2017-08-03 14:29:26 +02:00
Rolf Bjarne Kvinge f4d0f5e124 [xharness] Put the device listing in a separate log file so that it shows up nicely in the html report. (#2416) 2017-08-03 14:28:47 +02:00
Rolf Bjarne Kvinge 34e1d89963 [xharness] Kill any ibtoold processes when killing everything. (#2249) 2017-06-27 21:19:54 +02:00
Rolf Bjarne Kvinge 57ca12f402 [xharness] Run sim32 tests using the 10.3 simulator. (#2203) 2017-06-10 18:44:14 -07:00
Rolf Bjarne Kvinge fa3956cba0 [tests] Fix issues when launching watchOS apps in the simulator. (#2192)
This requires a new mlaunch as well.
2017-06-09 07:24:01 -07:00
Rolf Bjarne Kvinge 40e38a1707 [xharness] Fix iterating over no simulators. (#2183)
Fixes an issue where xharness would try to run tests on a 32-bit simulator,
which does not exist on iOS 11.ñ
2017-06-07 13:49:00 -07:00
Timothy Risi 25468bf617 Merge Quote methods into a single class instead of multiple versions (#2153) 2017-06-06 12:32:25 -08:00
Rolf Bjarne Kvinge 30b21dcc0e [xharness] Fix async code to propagate exceptions correctly. (#1991)
This fix will ensure that xharness won't hang when failing to list simulators.
2017-04-12 07:53:30 +02:00
Rolf Bjarne Kvinge 69e99dee6c [tests] Use the iPhone 6 simulator instead of the iPhone 5s simulator for 64-bit testing. (#1920)
Apparently Xcode 8.3 does not like the iPhone 5s simulator, and deletes it.

Every time Xcode is updated.

Which is slightly annoying when it affects the bots, since then iPhone 5s have
to be re-created on every bot.

So succumb to the pressure, and switch to using the iPhone 6 simulator instead.
2017-03-28 14:38:09 +02:00
Rolf Bjarne Kvinge 8391a3ca39 [xharness] Major rewrite (add server mode, add device support, add today extension support).
* Add a server mode, which launches a web server (and a web page) that can be
  used to interactively run tests and view their results.

* Add support for running test assemblies in a today extension (generating a
  new set of projects, similar to how we generate tvOS/watchOS projects based
  on the iOS project, we now generate a today extension project in addition to
  the tvOS and watchOS projects).

* Load all the different tests (and show them in the html report, although
  they show up as 'ignored'), even for disabled/ignored tests. This makes
  disabled/ignored tests more visible, and also makes it possible to actually
  run them using the embedded web server.

* Add support for running tests on device. Tests will be executed on multiple
  devices simulatenously (any connected devices will be used).
2017-01-05 13:08:48 +01:00
Rolf Bjarne Kvinge 9ffade2b16 [xharness] When a device from a list of multiple device candidates, order them first to make sure we select consistently. (#1401) 2016-12-22 18:55:25 +01:00
Rolf Bjarne Kvinge c83fa8a9bb [xharness] Fix target selection for simulators on wrench. (#1204) 2016-11-16 19:06:26 +01:00
Rolf Bjarne Kvinge 15b1204874 [xharness] Unify simulator selection code between Jenkins and Wrench and automatically create device pairs if none applicable is found. (#1202)
* [xharness] Don't crash if we can't find a simulator.

* [xharness] Create a device pair if none applicable is found.

* [xharness] Use an enum instead of string values for the target.

* [xharness] Unify the simulator selection code between Jenkins and Wrench.
2016-11-16 15:23:11 +01:00
Rolf Bjarne Kvinge a2570c6b84 [xharness] Improve cleaning by removing saved simulator state and the CoreSimulatorService. (#1203)
Also do this at the very start, to make sure no stale CoreSimulatorService is
around at build time. This will hopefully fix bug #[46097][1].

[1]: https://bugzilla.xamarin.com/show_bug.cgi?id=46097
2016-11-16 15:21:20 +01:00
Sebastien Pouliot 144d96999b Merge branch 'cycle8' into xcode8 2016-08-25 14:08:23 -04:00
Rolf Bjarne Kvinge 1d4019e966 [xharness] Don't run into an infinite loop if failing to run sqlite3. (#666) 2016-08-25 11:08:40 -04:00
Rolf Bjarne Kvinge 395a497281 [xharness] Fail properly if we fail to load simulators. (#520) 2016-08-02 18:24:34 +02:00
Rolf Bjarne Kvinge 3bf7b92d88 [xharness] Give permissions to watchkit apps as well. (#296)
* [xharness] Only execute sqlite3 once.

* [xharness] Give permissions to watchkit apps as well.
2016-06-28 07:04:10 -07:00
Rolf Bjarne Kvinge c355cf91be [xharness] Refactor how we do simulator configuration.
Split out the code to prepare the simulator from the AppRunner class,
which is now just handling the logic required for each test run.

This way it's easier to handle simulator preparation for multiple
test runs with the same simulator.

Also revamp logging to avoid printing directly to the console, but
instead use the logging classes that permit redirecting logging
to a file. This makes the html report show better logging.
2016-06-28 13:04:47 +02:00
Rolf Bjarne Kvinge 64bc391669 [xharness] Fix NRE when running from the command line. (#207)
* [xharness] Log simulator loading and handle any exceptions.

* [xharness] Add missing tests.

* [xharness] Throw a helpful exception instead of NRE when a simulator can't be found.

* [xharness] Fix null reference exception.
2016-06-15 18:57:47 -07:00
Rolf Bjarne Kvinge d135612f59 [tests] Implement support in xharness for running the simulator tests grouped by simulator, and write out an html report. 2016-06-15 10:51:14 -07:00