Граф коммитов

240 Коммитов

Автор SHA1 Сообщение Дата
Rolf Bjarne Kvinge e19426e073 [tests] Don't create test packages by default. (#1941)
* [tests] Don't create test packages by default.

Don't create test packages by default, instead add a new target to create test
packages. This new target is called on wrench, which means the packages will
still be created when needed, but they won't be built locally in every build
(and if a packaged test fails to build, it won't fail the entire build).

* [tests] Use a project reference instead of assembly reference for GuiUnit.exe

Use a project reference instead of assembly reference for GuiUnit.exe, so that
the GuiUnit reference is automatically built if necessary.

This also makes it required to build a sln for Classic (since mdtool can't
find referenced projects from a csproj).
2017-03-30 18:01:15 +02:00
Rolf Bjarne Kvinge 69e99dee6c [tests] Use the iPhone 6 simulator instead of the iPhone 5s simulator for 64-bit testing. (#1920)
Apparently Xcode 8.3 does not like the iPhone 5s simulator, and deletes it.

Every time Xcode is updated.

Which is slightly annoying when it affects the bots, since then iPhone 5s have
to be re-created on every bot.

So succumb to the pressure, and switch to using the iPhone 6 simulator instead.
2017-03-28 14:38:09 +02:00
Rolf Bjarne Kvinge b41307bb7f Merge commit '2272efbb189d457dc6c599cefd875425baad92a5' into framework-sdk 2017-03-14 19:24:07 +01:00
Rolf Bjarne Kvinge ea1d8cc861 [tests] Fix mlaunch path, it's no longer shipped with Xamarin Studio. (#1842) 2017-03-08 20:01:10 +01:00
Rolf Bjarne Kvinge d212b97b1a Merge remote-tracking branch 'origin/master' into framework-sdk 2017-02-21 18:14:29 +01:00
Rolf Bjarne Kvinge 8f65836e4d [xharness] Make 64-bits.
Avoids any problems with 32-bit OOM conditions (which can take a while to
diagnose, because random things start happening).
2017-02-20 17:14:13 +01:00
Rolf Bjarne Kvinge 4f5ad3517c [xharness] Minor improvements to the html report. 2017-02-20 17:14:10 +01:00
Rolf Bjarne Kvinge d288364127 [xharness] Refactor a little bit to work around mcs bug #52599.
mcs will miscompile using statements that has a catch clause that returns
early (by using 'return;') and a finally clause with await (the using's
variable won't be disposed).

So refactor a little bit to avoid returning early from inside a using
statement.
2017-02-20 17:13:24 +01:00
Rolf Bjarne Kvinge a70180ecf5 [xharness] Ensure we're always cleaned up, by moving the cleanup to the finally clause. 2017-02-20 17:13:23 +01:00
Rolf Bjarne Kvinge 10890b020c Bump to a mlaunch that hopefully fixes #50419. (#1424)
https://bugzilla.xamarin.com/show_bug.cgi?id=50419
2017-02-17 16:03:40 +01:00
Rolf Bjarne Kvinge db34d0969a [xharness] Cache log parsing.
Cache the result of log parsing. This avoids re-reading gigabytes of log files
every second when the web page requests an updated version of the report.
2017-02-13 08:49:01 +01:00
Rolf Bjarne Kvinge 6079a013d2 [xharness] Clean better.
Clean better by cleaning project references as well.
2017-02-13 08:48:19 +01:00
Rolf Bjarne Kvinge fd721e05a9 [xharness] Protect against null reference exceptions. 2017-02-10 16:39:38 +01:00
Rolf Bjarne Kvinge 83cbd20c3c [xharness] Can't select/deselect started tests. 2017-02-10 16:39:36 +01:00
Rolf Bjarne Kvinge 93ff19dcf8 [tests] Port today extension test template to F#. 2017-02-10 16:39:36 +01:00
Rolf Bjarne Kvinge fb8a1ca37f [xharness] Improve html report a little bit. 2017-02-10 16:39:35 +01:00
Rolf Bjarne Kvinge f62a3ec0cd [xharness] Remove code duplication. 2017-02-10 16:39:35 +01:00
Rolf Bjarne Kvinge c4a3f695b0 [xharness] Rename extension logs to say they're extension logs. 2017-02-10 16:39:35 +01:00
Rolf Bjarne Kvinge 8cf456cd0e [xharness] Encode links better. 2017-02-10 16:39:34 +01:00
Rolf Bjarne Kvinge 3f7f1354f2 [xharness] Tweak html report a little bit. 2017-02-10 16:39:34 +01:00
Rolf Bjarne Kvinge 789beb9a3e [xharness] Clean device projects after running them.
Device projects can take up *a lot* of disk space.
2017-02-10 16:39:34 +01:00
Rolf Bjarne Kvinge ff4db020e6 [xharness] Parse crash logs to determine crash reason and report it accordingly. 2017-02-10 16:39:33 +01:00
Rolf Bjarne Kvinge 9d3f4da6f2 [xharness] Process "$(ProjectDir)" in mtouch extra args when cloning project files. 2017-02-10 16:39:33 +01:00
Rolf Bjarne Kvinge 90d8b0b29c [xharness] Resolve HintPaths to their real location when cloning project files. 2017-02-10 16:39:32 +01:00
Rolf Bjarne Kvinge 751bc53a27 [xharness] Add web ui to select/deselect/run specific sets of tests. 2017-02-10 16:39:31 +01:00
Rolf Bjarne Kvinge 4f92eb1365 [xharness] Remove duplicated code. 2017-02-10 16:39:31 +01:00
Rolf Bjarne Kvinge 9d672e86ce [xharness] Make the top-level test names identical between iOS and Mac.
Make the top-level test name for equivalent tests between iOS and Mac have the
same name, so that these tests are grouped together.

For instance: we used to have a System-Mac tests and System tests (the latter
being iOS tests), now there are just System tests, and nested inside are both
the Mac and iOS System tests.
2017-02-10 16:39:31 +01:00
Rolf Bjarne Kvinge 068133f97b [xharness] Make exception handler handle more code. 2017-02-10 16:39:30 +01:00
Rolf Bjarne Kvinge c44be5db87 [xharness] Add favicon.ico support. 2017-02-10 16:39:30 +01:00
Rolf Bjarne Kvinge 70eefd7e80 [tests] Default today extension containers to iOS 8.0+.
It makes no sense to default to anything lower, since extensions were
introduced in iOS 8.0.
2017-02-10 16:39:28 +01:00
Rolf Bjarne Kvinge aa55661d3d [xharness] Add test cases for different assembly build targets. 2017-02-10 14:46:30 +01:00
Rolf Bjarne Kvinge 8a6d7cd0dd [tests] Add test for bug #43689. 2017-02-10 14:46:29 +01:00
Chris Hamons 2c835c5294 [XM] Add hybrid/standard AOT option and improve AOT code (#1650)
* [XM] Seperate parsing from compilation in AOT code

- Parsing command line options was too entangled with actually compiling
- Refactor test code to centralize Compile, reducing some complexity of tests
- Groundwork for hybrid vs non-hybrid AOT work

* Add hybrid/standard AOT support

* Add xammac_tests to makefile/jenkins

* Add flag to force AOT

* Disable MonoTouchFixtures.Contacts.ContactStoreTest.GetUnifiedContacts on XM due to prompts on Jenkins
2017-02-08 13:40:48 -06:00
Chris Hamons 1db1ce5a40 [XM] Add BCL tests (#1447) 2017-02-01 11:05:08 -05:00
Rolf Bjarne Kvinge 76587376e9 [xharness] Fix code to compile with csc. (#1586) 2017-01-30 10:04:59 +01:00
Rolf Bjarne Kvinge 8b17770d36 [xharness] Make 'IncludeMac' an general switch for all macOS tests. (#1582) 2017-01-27 18:24:10 +01:00
Rolf Bjarne Kvinge 71e61b4b04 [xharness] Always add the mmp test to the list of tests, but mark it as ignored when it shouldn't be executed. (#1580) 2017-01-27 17:02:21 +01:00
Rolf Bjarne Kvinge c0c1136d70 [xharness] Get the INCLUDE_ make variables and disable tests accordingly. (#1578) 2017-01-27 10:52:49 +01:00
Rolf Bjarne Kvinge 92659752df [xharness] No need to run the mac binding projects twice. (#1577) 2017-01-27 10:36:09 +01:00
Rolf Bjarne Kvinge 72080fb320 [xharness] Lines containing 'ghprbPull' are probably not build errors. (#1537) 2017-01-20 10:43:49 +01:00
Rolf Bjarne Kvinge da690aff81 [xharness] Show test xml files in the html report. (#1535)
* [xharness] Show test xml files in the html report.

* [xharness] Force links to xml files to show up in a new top-level window.

Jenkins shows the html report in an iframe, and links will load in that
iframe. This means that the browser renders the contents of the link as if it
was html, and rendering xml as html results in a blank page.

So set the target attribute on links to xml files, so that those xml files
open as top-level pages, and then the browser will rendering the xml like xml.
2017-01-20 10:42:55 +01:00
Rolf Bjarne Kvinge 38261db8ae [xharness] Don't autorefresh the html report if not in server mode. (#1538) 2017-01-20 10:39:24 +01:00
Rolf Bjarne Kvinge 6fe1c9feab [tests] Use a different bundle id for different apps that can be installed on the same device. (#1509)
* [tests] Use a different bundle id for different apps that can be installed on the same device.

* [xharness] Add workaround for radar #29847128.
2017-01-16 18:34:57 +01:00
Rolf Bjarne Kvinge 787c63766e [xharness] Fix generation of today extension projects to work from Xamarin Studio. (#1502)
Minor tweaks to make the solutions/project files usable from the IDE, and not
only the command line.
2017-01-16 16:23:49 +01:00
Rolf Bjarne Kvinge 6a780e76f0 [xharness] Fix today extension's project references. (#1504) 2017-01-16 16:18:53 +01:00
Rolf Bjarne Kvinge 65111d9e83 [xharness] Fix the name of referenced projects in derived projects. (#1503)
System.IO.Path expects unix-style directory separators, but MSBuild expects
window-style directory separators, so make sure to not confuse those.
2017-01-16 16:18:48 +01:00
Rolf Bjarne Kvinge 5f26772e1b [xharness] Add button to hide/show debug log in web page (and default to hidden). (#1490) 2017-01-16 07:32:28 +01:00
Rolf Bjarne Kvinge a02fb1d62e [xharness] Fix log stream handling. (#1494)
Don't create multiple writer streams for the same underlying file, instead
store the writer stream on the log instance, and return it whenever needed.

This fixes an issue where there would be multiple writer streams, which could
cause exceptions when creating more writer streams (access defined errors
because the file is already open).
2017-01-16 07:30:57 +01:00
Rolf Bjarne Kvinge 9f02c44613 [xharness] Add support for using the system's Xamarin.iOS/Xamarin.Mac instead of a locally build one. (#1498)
* [tests] Use the target directory from the loaded configuration.

* [xharness] Find the root directory based on xharness.exe's location (unless specified).

* [tests] Add makefile target to generate test config using the system XI.
2017-01-16 07:24:14 +01:00
Rolf Bjarne Kvinge 0e322fc87c [xharness] Fix test resets, to avoid logs showing up after re-running a test. (#1493) 2017-01-13 18:48:25 +01:00