Rolf Bjarne Kvinge
d32b7746c5
[xharness] Protect against duplicated connected/finished notifications. ( #301 )
2016-06-28 08:20:07 -07:00
Sebastien Pouliot
d824ac9396
[watchconnectivity] Small update for iOS 10 beta 1 ( #290 )
...
WCSessionDelegate members added in iOS 9.3 were turned into **required**
members in iOS 10 (beta 1). That's a breaking change so it's only enabled
for XAMCORE_4_0
2016-06-28 11:19:45 -04:00
Rolf Bjarne Kvinge
67cf4c1ccd
[monotouch-test] Update ModelIO tests to use Xcode versioning.
2016-06-28 16:34:10 +02:00
Rolf Bjarne Kvinge
055477225f
[tests] Implement version check for Xcode 8.
2016-06-28 16:19:42 +02:00
Rolf Bjarne Kvinge
63c6ae06dd
[xharness] Add the XI MSBuild tests to the jenkins test run.
2016-06-28 16:05:48 +02:00
Rolf Bjarne Kvinge
c4591f44d2
[xharness] Simplify non-grouped tasks in the html report a little bit.
2016-06-28 16:05:27 +02:00
Rolf Bjarne Kvinge
3bf7b92d88
[xharness] Give permissions to watchkit apps as well. ( #296 )
...
* [xharness] Only execute sqlite3 once.
* [xharness] Give permissions to watchkit apps as well.
2016-06-28 07:04:10 -07:00
Rolf Bjarne Kvinge
0d2d6e36b1
[xharness] Don't prepare simulator for tests that didn't build. ( #297 )
2016-06-28 07:03:40 -07:00
Rolf Bjarne Kvinge
507d2ace4a
[tests] Fix build failure for the introspection tests due to API change in master.
2016-06-28 13:52:19 +02:00
Rolf Bjarne Kvinge
613fb2118c
[jenkins] Skip mmptest to see if it'll speed up the test run on jenkins. ( #248 )
2016-06-28 13:05:00 +02:00
Rolf Bjarne Kvinge
455c741820
[xharness] Try to bump the launch timeout to 3 minutes.
2016-06-28 13:04:56 +02:00
Rolf Bjarne Kvinge
85d94face2
[xharness] Improve logging.
...
Make sure as much as possible is written to the logs, and not stdout.
Also copy an extra 1024 bytes when fetching the system log (and continue
capturing a while after stopped, since there may be unflushed system log
data in memory).
2016-06-28 13:04:52 +02:00
Rolf Bjarne Kvinge
c355cf91be
[xharness] Refactor how we do simulator configuration.
...
Split out the code to prepare the simulator from the AppRunner class,
which is now just handling the logic required for each test run.
This way it's easier to handle simulator preparation for multiple
test runs with the same simulator.
Also revamp logging to avoid printing directly to the console, but
instead use the logging classes that permit redirecting logging
to a file. This makes the html report show better logging.
2016-06-28 13:04:47 +02:00
Rolf Bjarne Kvinge
61485522d4
[xharness] Always setup/cleanup tvOS test runs.
...
Something strange is going on on the bots where only the first tvOS
test run actually launches the test app successfully.
2016-06-28 13:04:41 +02:00
Rolf Bjarne Kvinge
a59a762e84
[xharness] Download mlaunch if we don't have a local copy.
2016-06-28 13:04:10 +02:00
Rolf Bjarne Kvinge
1e6be7f547
[xharness] Add a few more variables to control what to include in a test run.
2016-06-28 13:02:21 +02:00
Rolf Bjarne Kvinge
c98cc1dc19
[xharness] Ignore ignored tests when deciding which color to use for a group of tests.
2016-06-28 13:02:16 +02:00
Rolf Bjarne Kvinge
1a48c36efd
[xharness] When capturing the system log for simulator runs, don't capture contents of the log from before our test run starts.
2016-06-28 13:02:12 +02:00
Rolf Bjarne Kvinge
fa33176ba8
[xharness] Cleanup must be done by the last test, not the first test.
2016-06-28 13:02:09 +02:00
Rolf Bjarne Kvinge
93f0b92eac
[xharness] iPhone 4s doesn't exist anymore, use iPhone 5 instead.
2016-06-28 13:02:03 +02:00
Rolf Bjarne Kvinge
c09c74dba5
[xharness] Improve html report a bit when some tests are ignored.
2016-06-28 12:59:54 +02:00
Rolf Bjarne Kvinge
ab7bd56e63
[xharness] Add a few variables to control if to include iOS/Mac tests in jenkins test mode.
2016-06-28 12:59:50 +02:00
Rolf Bjarne Kvinge
a7b20c1a43
[xharness] Fix emptyness check.
2016-06-28 12:59:42 +02:00
Rolf Bjarne Kvinge
3a825fc5e0
[xharness] Improve watching objects in the debugger.
2016-06-28 12:59:36 +02:00
Sebastien Pouliot
ddc3a56e68
[tests][harness] Add kTCCServiceMediaLibrary to avoid privacy popup ( #230 )
...
Running some API without permission can crash some tests.
2016-06-28 12:59:25 +02:00
Rolf Bjarne Kvinge
1a1958f52d
Merge remote-tracking branch 'origin/master' into xcode8
2016-06-28 12:44:08 +02:00
Alex Soto
2b51bf257b
[NS(mutable)Dictionary] Fix bug 41343 - NSDictionary<TKey, TValue>.FromObjectsAndKeys keys and values are twisted up ( #281 )
...
https://bugzilla.xamarin.com/show_bug.cgi?id=41343
* NSDictionary<TKey, TValue>.FromObjectsAndKeys keys and values are twisted up
* Fixed it in XAMCORE_4_0
* Obsoleted the 2 existing methods
* introduced FromObjectsAndKeys (TValue [] objects, TKey [] keys, nint count)
* Added unit tests with different types for TKey and TValue
2016-06-27 20:38:14 -04:00
Sebastien Pouliot
99a8da2359
[tests][xtro] Add CVOptionFlags == uint64_t to avoid a NIE processing macOS 10.12 headers ( #288 )
2016-06-27 17:18:30 -04:00
Sebastien Pouliot
4a1f7fa778
Merge branch 'master' into xcode8
2016-06-27 16:30:29 -04:00
Rolf Bjarne Kvinge
7e78269b3c
[monotouch-test] Fix a few ModelIO tests according to iOS 10 behavior. ( #286 )
2016-06-27 15:48:51 -04:00
Rolf Bjarne Kvinge
399501c837
[introspection] Implement a few Xcode checks for Mac.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
efa39f6214
[introspection] Fix build problem.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
73660edbdf
[tests] Fix a few dead code compiler warnings.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
e8d1aae78b
[introspection] Make the Mac version build.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
4b60767598
[introspection] Update protocol test for watchOS.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
5cbc9ca2fe
[introspection] Verify that variadic methods aren't public API.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
ef55c7774f
[introspection tests] Ignore typo checker on watchOS, there's no API available for it.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
f0b709b8bf
[introspection tests] Do version checks using Xcode version instead of specific platform versions.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
f35e8b8b35
[tests] Add introspection-ios to tests.sln
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
e2c2dc1061
[monotouch-test] Move version-checking code to a shared file.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
833ea3fc8b
[xharness] Fix name of referenced projects.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
7714d7a1cf
[bindings-framework-test] Remove unused define.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
d9610117a1
[monotouch-test] Ignore NSDataTest.Https on watchOS devices, the API doesn't work.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
343502ef52
[monotouch-test] Disable RuntimeTest.FinalizationRaceCondition/ResurrectedObjectsDisposedTest on watchOS/device, they use too much memory for the device.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
d8b4fff4e3
[monotouch-test] Disable test that uses TcpClient on watchOS, since TcpClient doesn't work on watchOS.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
8a4178b141
[monotouch-test] Fix registrar/trampoline tests according to watchOS ABI.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
26b1c27b81
[monotouch-test] Disable NSUbiquitousKeyValueStore test, since it doesn't work on watchOS.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
df640e61cd
[monotouch-test] Disable test that uses TcpListener, since TcpListener doesn't work on watchOS.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
d06100b952
[tests] Add some diagnostics to the watchOS test runner.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
d3ab94666f
[tests] Avoid running more than once simultaneously.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
e0e5824ce2
[monotouch-test] Set a timeout for UrlSessionTest so that the requests time out before the test itself.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
e623d92046
[tests] Improve the watchOS test runner a little bit.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
43da4642f1
[monotouch-test] Implement a non-GUI version of TestRuntime.RunAsync that works on watchOS.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
b4bb30c13c
[monotouch-test] Adjust tests according to watchOS behavior.
2016-06-27 13:07:37 +02:00
Rolf Bjarne Kvinge
0a8c6e3342
[tests] Check versions using Xcode version instead of platform version.
...
This is required to match API to the required platform version,
since our platforms have different version numbers.
2016-06-27 13:07:37 +02:00
Sebastien Pouliot
35c376a374
[gamecontroller] Update for iOS 10 beta 1 ( #276 )
...
The API for the AppleTV controller was added to iOS 10
2016-06-26 10:04:55 -04:00
Sebastien Pouliot
0ec3263eab
[quicklook] Add new bindings for iOS 10 beta 1 ( #272 )
...
Also fixed QLPreviewItem::previewItemTitle (not required) for XAMCORE_4_0
reference:
!incorrect-protocol-member! QLPreviewItem::previewItemTitle is OPTIONAL and should NOT be abstract
2016-06-26 10:04:20 -04:00
Sebastien Pouliot
dde6a06fcd
[uikit] Fix new UICollectionViewDataSourcePrefetching and UIContentSizeCategoryAdjusting protocols ( #277 )
...
The two later failure reports (references) were not prefixed with [FAIL]
so they were filtered out by in the bot results.
references:
[FAIL] iOSApiProtocolTest.ApiProtocolTest.GeneralCase : 2 types do not really conform to the protocol interfaces
[FAIL] Could not load UIKit.UICollectionViewDataSourcePrefetching
[FAIL] Could not load UIKit.UIContentSizeCategoryAdjusting
2016-06-25 12:43:36 -04:00
Sebastien Pouliot
278b760983
[replaykit] Add new bindings for iOS 10 beta 1 ( #270 )
2016-06-24 12:18:04 -04:00
Rolf Bjarne Kvinge
3d4a5075cb
[mtouch tests] Ignore tests that are testing mlaunch behaviour. ( #266 )
2016-06-24 01:04:03 -07:00
Rolf Bjarne Kvinge
278550795e
[xharness] Fix simulator validation check to not fail when it shouldn't. ( #265 )
2016-06-24 01:03:36 -07:00
Sebastien Pouliot
56d35304fd
[coreimage] Add new API from iOS 10 beta 1 ( #263 )
...
* CIRAWFilter support is new in iOS 10 but was, mostly, already supported on OSX, however
the API were not bound.
2016-06-23 21:07:03 -04:00
Sebastien Pouliot
7b7bb6722e
[tests] Remove duplicated files ( #269 )
...
Introspection test files are now all under /tests/introspection/
2016-06-23 18:16:31 -04:00
Timothy Risi
c94d0e7b70
Merge branch 'master' into xcode8
2016-06-23 10:45:09 -08:00
Sebastien Pouliot
50381a8e7b
[tvos] Fix introspection tests for tvOS ( #267 )
...
Wrong check for version
[FAIL] Default constructor not allowed for CoreLocation.CLCircularRegion : Can only check iOS system version on iOS.
[FAIL] Default constructor not allowed for AVFoundation.AVAudioSessionDataSourceDescription : Can only check iOS system version on iOS.
[FAIL] Default constructor not allowed for AVFoundation.AVAudioSessionPortDescription : Can only check iOS system version on iOS.
and a change in tvOS 10 SDK
[FAIL] Selector not found for TVMLKit.TVViewElement : setDisabled:
2016-06-23 14:38:43 -04:00
Vincent Dondain
ca718991df
[introspection] Fix bindings so the tests pass ( #254 )
...
- Added missing NSCopying, NSCoding and NSSecureCoding.
- Filled radar://26939747 with Apple - https://trello.com/c/6aIzLH4a
2016-06-22 17:32:00 -04:00
Sebastien Pouliot
004fe2f8d8
[tests][monotouch] More adjustments for iOS10 related failures/changes ( #239 )
...
* [tests][monotouch] More adjustments for iOS10 related failures/changes
- some might be Apple bugs and need to be reverted later
* Fix more failures on monotouch-tests wrt iOS 10
* MutableContactTest.cs: Wrong assert was changed (which is why each one
needs it's own unique string)
* TrustTest.cs: Fixed as results vary on < iOS9, iOS9 and iOS10
* NetworkReachabilityTest.cs: Fixed as results vary on < iOS9, iOS9 and iOS10
Those
[FAIL] UserDefaultsTest.Ctor_UserName : System.NullReferenceException : Object reference not set to an instance of an object
[FAIL] UserDefaultsTest.SetString : StringForKey-2
are due to
http://stackoverflow.com/questions/37840288/ios-10-nsuserdefaults-does-not-work
and should disappear once the bots are rebooted.
2016-06-22 16:28:27 -04:00
Rolf Bjarne Kvinge
d62295f0bd
[jenkins] Skip mmptest to see if it'll speed up the test run on jenkins. ( #248 )
2016-06-22 07:12:51 -07:00
Rolf Bjarne Kvinge
c560fee268
[registrar] Managed characters are equivalent to shorts in native code. ( #259 )
...
Fixes NSCharacterSetTest.NSMutableCharacterSet_TestStaticSets when
running with the P/Invoke wrapper (for exceptions) enabled (i.e.
watchOS), since otherwise the wrapper would truncate char parameters
to byte.
2016-06-22 05:47:13 -07:00
Rolf Bjarne Kvinge
fdccb019a5
[xharness] Try to bump the launch timeout to 3 minutes.
2016-06-22 10:42:22 +02:00
Rolf Bjarne Kvinge
fb37a21ef9
[xharness] Improve logging.
...
Make sure as much as possible is written to the logs, and not stdout.
Also copy an extra 1024 bytes when fetching the system log (and continue
capturing a while after stopped, since there may be unflushed system log
data in memory).
2016-06-22 10:42:22 +02:00
Rolf Bjarne Kvinge
dfd0fbe81a
[xharness] Refactor how we do simulator configuration.
...
Split out the code to prepare the simulator from the AppRunner class,
which is now just handling the logic required for each test run.
This way it's easier to handle simulator preparation for multiple
test runs with the same simulator.
Also revamp logging to avoid printing directly to the console, but
instead use the logging classes that permit redirecting logging
to a file. This makes the html report show better logging.
2016-06-22 10:42:22 +02:00
Rolf Bjarne Kvinge
755a0622bd
[xharness] Always setup/cleanup tvOS test runs.
...
Something strange is going on on the bots where only the first tvOS
test run actually launches the test app successfully.
2016-06-22 10:42:22 +02:00
Rolf Bjarne Kvinge
6b5a394244
[xharness] Add a few more variables to control what to include in a test run.
2016-06-22 10:42:22 +02:00
Rolf Bjarne Kvinge
0a39ec940f
[xharness] Ignore ignored tests when deciding which color to use for a group of tests.
2016-06-22 10:42:22 +02:00
Rolf Bjarne Kvinge
1e1bbec8a3
[xharness] When capturing the system log for simulator runs, don't capture contents of the log from before our test run starts.
2016-06-22 10:42:22 +02:00
Rolf Bjarne Kvinge
bd993fbe0d
[xharness] Cleanup must be done by the last test, not the first test.
2016-06-22 10:42:22 +02:00
Rolf Bjarne Kvinge
cf060f4611
[xharness] iPhone 4s doesn't exist anymore, use iPhone 5 instead.
2016-06-22 10:42:22 +02:00
Rolf Bjarne Kvinge
d6f27c2e65
[xharness] Improve html report a bit when some tests are ignored.
2016-06-22 10:42:22 +02:00
Rolf Bjarne Kvinge
ade84d6397
[xharness] Add a few variables to control if to include iOS/Mac tests in jenkins test mode.
2016-06-22 10:42:22 +02:00
Rolf Bjarne Kvinge
64bf75c533
[xharness] Fix emptyness check.
2016-06-22 10:42:22 +02:00
Rolf Bjarne Kvinge
b2431898b0
[xharness] Improve watching objects in the debugger.
2016-06-22 10:42:22 +02:00
Rolf Bjarne Kvinge
5a9c9003fa
[xharness] Use Xcode 8 when debugging.
2016-06-22 10:42:22 +02:00
Rolf Bjarne Kvinge
67dc777761
[apitest] Make SearchKitTest parallelizable by not using a hardcoded path. ( #249 )
2016-06-22 00:48:20 -07:00
Chris Hamons
04e7b77f1a
Remove duplication found in tests and unify namespaces of common code ( #250 )
...
* Remove duplication found in tests and unify namespaces of common code
* Stub out dontlink-mac since introspection took over
2016-06-21 15:46:07 -08:00
Vincent Dondain
aae5a73543
[messages] New framework in iOS 10.0 beta1 ( #190 )
2016-06-21 08:56:38 -04:00
Sebastien Pouliot
1659e121f0
Merge branch 'master' into xcode8
2016-06-20 20:48:14 -04:00
Chris Hamons
3fcb2ed89e
[XM] - XM Mobile should not resolve from the GAC either ( #242 )
...
- Centralize fix I made for XM 4.5 to apply to both and write larger test
- https://bugzilla.xamarin.com/show_bug.cgi?id=42001
2016-06-20 15:26:33 -04:00
Chris Hamons
75fcf376d3
[XM] Fix mmp test failure
...
- On some machines/mono versions it appears that printing System.Windows.DependencyObject requires System.Xaml for some reason.
- Since the test is testing our resolution from the GAC and we don't care about the specifics, I'm just adding that reference. Which we also get from the GAC.
2016-06-20 12:52:29 -05:00
Sebastien Pouliot
4995f58459
[tests][link sdk] Exclude CFNetwork test from watchOS ( #238 )
...
- framework not supported on watchOS
- fix build of "link sdk" under watchOS
2016-06-20 09:37:06 -04:00
Sebastien Pouliot
ebbc8addcc
[tests] Some fix for monotouch-test needed wrt iOS 10 ( #236 )
...
* Adjust ever changing AddressFormatingTest for iOS 10, which does
not output the country;
* Adjust Contact's ICNKeyDescriptor internal check;
* CLBeaconRegion.ProximityUuid does not return the original instance
anymore, but a different one with the same uuid;
* Add a small delta for Vector3 comparison in ModelIO tests;
* Adjust MapKit tests for pin color change and MapRect corner case;
* SecKeyTest with corner cases now pass (they failed before);
* SecPolicyIdentifier.AppleIDValidation does not report the OID it's
created from (migration?)
Note: some might be bugs that Apple will fix in later seeds
2016-06-19 09:32:01 -07:00
Alex Soto
5225450521
[VideoSubscriberAccount] Add VideoSubscriberAccount from xcode8 beta1
...
* Added VideoSubscriberAccount binding
* Ensured we link against VideoSubscriberAccount
* Ensured introspection tests pass
2016-06-18 14:38:02 -05:00
Sebastien Pouliot
7c279d9f9f
[tests][introspection] Fix protocol tests for SafariServices
...
The types are not _publicly_ conforming to the protocols (i.e. the header
files don't mention them). However they do conform at runtime, which is
what the test check (so we must ignore them)
2016-06-18 10:41:18 -04:00
Sebastien Pouliot
3381f7ca1e
[tests][introspection] Ignore Sublocality as a typo ( #234 )
...
Fix test for a previous commit. This is what Apple use as the API name
even if it's not perfect English.
2016-06-18 07:34:03 -07:00
Sebastien Pouliot
d9fb8dc937
[tests][harness] Add kTCCServiceMediaLibrary to avoid privacy popup ( #230 )
...
Running some API without permission can crash some tests.
2016-06-18 06:36:59 -07:00
Alex Soto
7c66cbf736
[CallKit] Add CallKit framework binding from xcode 10 beta1 ( #189 )
...
* Added CallKit Bindings
* Ensure CallKit.framework is linked
* Ensure CallKit passes introspection tests
* FIXME: https://trello.com/c/afWXDZ3A
Headers says CallKit is available on macOS 10.12
but uses AVAudioSession and it is iOS only
Opened Radar awaiting response.
2016-06-18 06:20:38 -07:00
Sebastien Pouliot
9e67e4674e
[tests][introspection] Fix protocol tests for SafariServices
...
The types are not _publicly_ conforming to the protocols (i.e. the header
files don't mention them). However they do conform at runtime, which is
what the test check (so we must ignore them)
2016-06-18 08:53:21 -04:00
Sebastien Pouliot
0835b59bc3
[tests][introspection] Allow subclass to satisfy the designated initializer requirement on subclasses ( #229 )
...
Fix a false positive when a .ctor is exposed with paramaters using a
subclass of what the designated initializer is exposing.
reference:
[FAIL] UIKit.UIGraphicsPdfRenderer should re-expose UIGraphicsRenderer::.ctor(CGRect, UIGraphicsRendererFormat)
2016-06-18 05:40:22 -07:00
Rolf Bjarne Kvinge
1e62987a29
[CoreGraphics] Fix CGRect.Inflate to work correctly, and add tests. Fixes #41684 . ( #225 )
...
https://bugzilla.xamarin.com/show_bug.cgi?id=41684
2016-06-17 10:45:58 -07:00
Manuel de la Pena
35be8c62a0
Merge pull request #224 from mandel-macaque/bug-41562
...
[Fix] Ensure that tests do not fail on iOS 8.
2016-06-17 14:51:10 +02:00
Manuel de la Pena
99a8468406
[Fix] Ensure that tests do not fail on iOS 8 by skipping a type that does not support the CMAttachment API.
2016-06-17 12:04:00 +02:00
Manuel de la Pena
f1e758c9e0
[Fix] Ensure NSExpression tests do run in the device ensuring that all members of the type are preserved.]
2016-06-17 11:19:07 +02:00
Sebastien Pouliot
ffc8388dd2
[tests][introspection] Fix crashers (not failures), add new required keys for permissions and disable logging (slows down execution and makes it difficult to parse normal issues) ( #215 )
2016-06-16 08:01:13 -07:00
Rolf Bjarne Kvinge
b8ceeeb044
[xharness] Fix logdirectory path to use correct directory separator. ( #212 )
2016-06-16 00:03:04 -07:00
Sebastien Pouliot
3966a5c7f5
[tests][introspection] Enable more verbosity and continue on failure to find out broken pieces. ( #211 )
2016-06-15 22:05:39 -07:00
Rolf Bjarne Kvinge
70747b3317
[xharness] Fix logdirectory path to use correct directory separator. ( #210 )
2016-06-15 22:05:12 -07:00
Rolf Bjarne Kvinge
68761c0e5e
[apitest] Modify a couple of test to not take a screen image just to get an image. ( #209 )
...
Taking a screen image does not work unless there's a window server
running, which may not always be the case on bots.
So instead just create an image manually, since these tests do
not seem to be requiring any particular type of image.
2016-06-15 19:29:15 -07:00
Rolf Bjarne Kvinge
bdf7ca8429
[tests] Bump min deployment target to 6.0. ( #208 )
2016-06-15 19:12:48 -07:00
Rolf Bjarne Kvinge
64bc391669
[xharness] Fix NRE when running from the command line. ( #207 )
...
* [xharness] Log simulator loading and handle any exceptions.
* [xharness] Add missing tests.
* [xharness] Throw a helpful exception instead of NRE when a simulator can't be found.
* [xharness] Fix null reference exception.
2016-06-15 18:57:47 -07:00
Rolf Bjarne Kvinge
8a164bc8d0
[xharness] Download mlaunch if we don't have a local copy.
2016-06-15 17:00:09 -07:00
Rolf Bjarne Kvinge
f17241e6e3
[xharness] Fix null reference exception.
2016-06-15 16:52:45 -07:00
Rolf Bjarne Kvinge
df326a1d59
[xharness] Throw a helpful exception instead of NRE when a simulator can't be found.
2016-06-15 16:52:24 -07:00
Rolf Bjarne Kvinge
ed1cbe003e
[xharness] Add missing tests.
2016-06-15 16:51:42 -07:00
Rolf Bjarne Kvinge
73b3a9b53e
[xharness] Log simulator loading and handle any exceptions.
2016-06-15 13:32:09 -07:00
Rolf Bjarne Kvinge
15a5af3342
[xharness] Exclude bcl tests by default.
2016-06-15 10:51:14 -07:00
Rolf Bjarne Kvinge
a5f5a76cc0
[xharness] Try and fix some strange file sharing exceptions.
2016-06-15 10:51:14 -07:00
Rolf Bjarne Kvinge
126de6836a
[xharness] Use full path to mdtool.
2016-06-15 10:51:14 -07:00
Rolf Bjarne Kvinge
0910cacf51
[xharness] Fix processing of ignored tasks.
2016-06-15 10:51:14 -07:00
Rolf Bjarne Kvinge
dcc605ed22
[xharness] Build XM/Classic projects using mdtool.
2016-06-15 10:51:14 -07:00
Rolf Bjarne Kvinge
af4a93a181
[xharness] Pass the right environment variables when invoking xbuild.
2016-06-15 10:51:14 -07:00
Rolf Bjarne Kvinge
ae1bf7fb5f
[xharness] Add support for ignoring tests.
...
And use it to ignore framework-test (never run on wrench) and
watchOS tests (currently ignored on wrench).
2016-06-15 10:51:14 -07:00
Rolf Bjarne Kvinge
d9bf0e1728
[xharness] Add support for building and running mac tests on jenkins.
2016-06-15 10:51:14 -07:00
Rolf Bjarne Kvinge
9a20b42bd6
[xharness] No need to prepare the simulator more than once.
2016-06-15 10:51:14 -07:00
Rolf Bjarne Kvinge
0c1f235800
[xharness] Fix simulator configuration to do all configuration before first launch.
2016-06-15 10:51:14 -07:00
Rolf Bjarne Kvinge
2d3001cd25
[xharness] Don't fail a machine has never seen a crash report.
2016-06-15 10:51:14 -07:00
Rolf Bjarne Kvinge
d135612f59
[tests] Implement support in xharness for running the simulator tests grouped by simulator, and write out an html report.
2016-06-15 10:51:14 -07:00
Rolf Bjarne Kvinge
68717b4100
[apitest] Modify a couple of test to not take a screen image just to get an image. ( #201 )
...
Taking a screen image does not work unless there's a window server
running, which may not always be the case on bots.
So instead just create an image manually, since these tests do
not seem to be requiring any particular type of image.
2016-06-15 10:49:15 -07:00
Rolf Bjarne Kvinge
adde200556
[xharness] Exclude bcl tests by default.
2016-06-15 09:57:24 -07:00
Rolf Bjarne Kvinge
fdf2bd5d7b
[xharness] Try and fix some strange file sharing exceptions.
2016-06-15 09:57:24 -07:00
Rolf Bjarne Kvinge
4bad2c1485
[xharness] Use full path to mdtool.
2016-06-15 09:57:24 -07:00
Rolf Bjarne Kvinge
266606528b
[xharness] Fix processing of ignored tasks.
2016-06-15 09:57:24 -07:00
Rolf Bjarne Kvinge
eec56fefc6
[xharness] Build XM/Classic projects using mdtool.
2016-06-15 09:57:24 -07:00
Rolf Bjarne Kvinge
f6948f8183
[xharness] Pass the right environment variables when invoking xbuild.
2016-06-15 09:57:24 -07:00
Rolf Bjarne Kvinge
39a0873403
[xharness] Add support for ignoring tests.
...
And use it to ignore framework-test (never run on wrench) and
watchOS tests (currently ignored on wrench).
2016-06-15 09:57:24 -07:00
Rolf Bjarne Kvinge
ad229cef71
[xharness] Add support for building and running mac tests on jenkins.
2016-06-15 09:57:24 -07:00
Rolf Bjarne Kvinge
969f2d7ca1
[xharness] No need to prepare the simulator more than once.
2016-06-15 09:57:24 -07:00
Rolf Bjarne Kvinge
3d5455b54c
[xharness] Fix simulator configuration to do all configuration before first launch.
2016-06-15 09:57:24 -07:00
Rolf Bjarne Kvinge
646bd59c85
[xharness] Don't fail a machine has never seen a crash report.
2016-06-15 09:57:24 -07:00
Rolf Bjarne Kvinge
d087ba2d5a
[tests] Implement support in xharness for running the simulator tests grouped by simulator, and write out an html report.
2016-06-15 09:57:24 -07:00
Sebastien Pouliot
f50b82df3d
[tests][linksdk][watchos] Fix HttpClientHandler tests for CFNetwork/watchOS ( #186 )
...
As noted in PR 177 [1] this does not build on watchOS since CFNetwork
is not supported on that platform. Uncaught as the PR bots don't build,
nor run, the tests yet.
[1] https://github.com/xamarin/xamarin-macios/pull/177
2016-06-14 07:42:41 -07:00
Manuel de la Pena
90c7eab95e
[Fix] Ensure that strong dictionaries can work with templated dictionaries as property types.
2016-06-13 12:13:48 +02:00
Sebastien Pouliot
d479ed00c7
[tests][link sdk] Add tests to validate default properties for all (3) handlers that we ship ( #177 )
2016-06-12 13:44:37 -04:00
Alex Soto
69740e78ed
[AudioUnit] Fix some breaking changes ( #173 )
...
commit 1f207bd3f3df363cb5a74e59b93acd8eb6e1fec2 in xamarin/maccore
introduced some breaking changes, this fixes them
2016-06-10 13:20:33 -04:00
Rolf Bjarne Kvinge
8af0326105
[xharness] Clean targets are named 'Clean', not 'clean'. ( #162 )
...
At least according to mdtool.
Fixes this:
[...]
Target 'clean not supported
make[4]: *** [clean-mac-classic-introspection] Error 1
2016-06-09 14:23:58 -04:00
Rolf Bjarne Kvinge
bf806525f6
[monotouch-test] Simplify test case to make it compile on all platforms. ( #163 )
2016-06-09 20:03:18 +02:00
Rolf Bjarne Kvinge
e3cc7c31bc
[xharness] Write relative paths in the makefiles. ( #160 )
...
Fixes the packaged mac tests when they're executed on a different
machine with a different path.
2016-06-09 17:36:32 +02:00
Rolf Bjarne Kvinge
fac7270eb8
[registrar] Rewrite ctor's super call to invoke objc_msgSendSuper directly. Fixes #41319 . ( #159 )
...
There's a clang bug [2] where if a selector is marked as unavailable,
it's marked as unavailable for every class, not just the class where
the unavailable selector is.
This means that we can't do `[super initWithCoder:x]` anywhere,
because `initWithCoder:` is marked as unavailable for UIActivityViewController.
So instead rewrite the call to super to call objc_msgSendSuper
directly, circumventing clang's broken availability checks.
[1] https://bugzilla.xamarin.com/show_bug.cgi?id=41319
[2] https://llvm.org/bugs/show_bug.cgi?id=28058
2016-06-09 17:18:35 +02:00
Rolf Bjarne Kvinge
d8287824e0
[mtouch tests] Fix MT1015 after mtouch change to not use fastsim for release builds. ( #157 )
...
MT1015 is a check that only occurs when using fastsim, so make sure
the test actually ends up using fastsim.
2016-06-09 13:03:14 +02:00
Sebastien Pouliot
5fd35014c1
[tests][introspection] Re-apply special case from 05bedce306
( #156 )
...
[FAIL] Selector not found for AppKit.NSCell : accessibilityNotifiesWhenDestroyed
[FAIL] Selector not found for AppKit.NSView : accessibilityNotifiesWhenDestroyed
Location changed and the duplicated files were removed (but I missed this
change on dontlink-mac)
2016-06-09 11:06:54 +02:00
Rolf Bjarne Kvinge
9c01fe6c9d
[tests] Use the right sources for dontlink, linksdk and linkall tests. ( #152 )
2016-06-08 23:39:47 +02:00
Rolf Bjarne Kvinge
e450dae136
[xharness] Add support for the introspection tests. ( #151 )
...
* [xharness] Add support for the introspection tests.
* [tests] Add support for mac introspection tests to xharness.
2016-06-08 19:45:31 +02:00
Chris Hamons
06c18bd887
[XM] Add release value option to msbuild/mmp to resolve XM 4.5 assemb… ( #150 )
...
[XM] Add release value option to msbuild/mmp to resolve XM 4.5 assemblies from system GAC
- This option "reverts" a C7 fix that prevented resovling assemblies from the GAC, which is unsafe
- If you use this option, you need to know what you are doing. The mono BCL and the XM BCL need to be compatible
- Use strictly puts you in the no support "you get to keep the pieces if it breaks" category.
2016-06-08 12:47:09 -04:00
Rolf Bjarne Kvinge
ca729b9773
[mtouch tests] Add Xamarin.Analysis.Tasks.dll as a valid assembly to have in the Classic BCL directory. ( #146 )
2016-06-08 17:47:09 +02:00
Rolf Bjarne Kvinge
e9983ef148
[mtouch tests] Fix typo in RegistrarTest. ( #147 )
2016-06-08 16:57:40 +02:00
Rolf Bjarne Kvinge
98af8b7d66
[mtouch tests] Make a few simulator tests more resilient against other output from mlaunch. ( #148 )
2016-06-08 16:19:56 +02:00
Chris Hamons
05bedce306
[XM] Fix dontlink by fixing some NSAccessibility binding mistakes ( #143 )
...
[XM] Fix dontlink by fixing some NSAccessibility binding mistakes
2016-06-08 09:51:19 -04:00
Rolf Bjarne Kvinge
0a19b5e3fc
[tests] Fix mac tests package layout after tests move. ( #141 )
2016-06-07 13:35:12 -04:00
Alexander Köplinger
86ce3d9e81
Add DISABLE_CAS_USE constant to the bcl-test .csproj's ( #135 )
...
Some tests rely on this constant to disable CAS code paths so we need to define it.
2016-06-06 16:03:39 +02:00
Rolf Bjarne Kvinge
aaae585d52
[xharness] Xcode 7.3 ships symbolicatecrash in a new place, so look there as well. ( #134 )
2016-06-06 15:32:09 +02:00
Rolf Bjarne Kvinge
98b966cd9f
[mmptest] Use the local targets when building. ( #130 )
2016-06-06 13:42:36 +02:00
Rolf Bjarne Kvinge
7cbaa254c5
[tests] Make mdtool verbose on CI, and fix a few xbuild invocation to honor XBUILD_VERBOSITY. ( #131 )
2016-06-06 13:01:24 +02:00
Rolf Bjarne Kvinge
4a714f3c43
Make logic not depend on the checkout directory being named 'xamarin-macios'. ( #129 )
2016-06-06 12:18:52 +02:00
Rolf Bjarne Kvinge
715c2fa5d4
[xharness] Add separate solution to make it load faster in the IDE. ( #124 )
2016-06-02 12:17:52 +02:00
Rolf Bjarne Kvinge
e8c51361b4
[tests] Fix typo that occurred in the migration to xamarin-macios. ( #116 )
2016-06-02 09:16:58 +02:00
Chris Hamons
dad55ae86a
[XM] Add mmp test for read only mdb files with assembly being referenced ( #121 )
2016-06-01 14:23:05 -04:00
Chris Hamons
f495ad50a7
[XM] Fix mmp tests to use shared mac-binding-project copy, and name SimpleClassDylib.dylib correctly ( #120 )
2016-06-01 13:51:04 -04:00
Rolf Bjarne Kvinge
383c43ec63
[tests] Update mtouch tests after some error/warning message changes. ( #117 )
2016-06-01 19:40:59 +02:00
Rolf Bjarne Kvinge
ad88558d82
[mtouch] Tweak error message for MT0073 and MT0074. Fixes #40606 . ( #111 )
...
https://bugzilla.xamarin.com/show_bug.cgi?id=40606
2016-06-01 19:18:35 +02:00
Chris Hamons
782c5116b6
[XM] Fix test failures ( #119 )
...
* [XM] Fix NSAccessibility binding issue breaking tests
* [XM] Don't run extension tests on OS X that don't have extension support
2016-06-01 12:23:34 -04:00
Rolf Bjarne Kvinge
0a25ffc9bf
[tests] Fix mtouch tests to actually fail when they fail. ( #112 )
2016-06-01 17:33:34 +02:00
Rolf Bjarne Kvinge
bbf2682b5a
[tests] Fix a few paths to test files. ( #106 )
...
This was incorrectly fixed in 4ad86833
, so this is just fixing that fix.
2016-05-31 15:03:45 +02:00
Rolf Bjarne Kvinge
db68e69a1d
[runtime] Support binding NSObjects as IntPtr. Fixes #41132 . ( #103 )
...
Support binding NSObjects as IntPtr. This is usually not
a problem, because when we fetch the ObjC signature for a
method, we usually get the signature as exported by us,
(in which case a parameter bound as 'IntPtr' would be treated
as 'void *' in the dynamic registrar) *except* when the
selector corresponds with a protocol the type implements,
in which case we get the signature as defined in the protocol.
https://bugzilla.xamarin.com/show_bug.cgi?id=41132
2016-05-31 11:58:27 +02:00
Chris Hamons
f3602b4e93
Fix tests broke by 47dc0f26c9
( #99 )
2016-05-28 12:06:32 -04:00
Zoltan Varga
7fad8dfb40
[tests] Build the bitcode configuration on arm64 only, armv7 doesn't seem to link:
...
Undefined symbols for architecture armv7:
"___gxx_personality_v0", referenced from:
2016-05-27 21:54:49 -04:00
Rolf Bjarne Kvinge
73d0e722d5
[tests] Add more files which are ignored by default.
2016-05-27 14:43:21 +02:00
Rolf Bjarne Kvinge
0629b461c6
[tests] Remove duplicated file.
2016-05-27 10:19:27 +02:00
Rolf Bjarne Kvinge
4ad86833ab
[tests] Update a few paths after test move.
2016-05-27 10:17:26 +02:00
Rolf Bjarne Kvinge
ba3c967619
[tests] Fix paths for mtouch tests.
2016-05-27 10:14:43 +02:00
Rolf Bjarne Kvinge
80e0ef0b50
[tests] Only generate qa-test-dependencies when the Xamarin build is enabled.
2016-05-27 10:14:28 +02:00
Rolf Bjarne Kvinge
5034fa5b68
[link sdk] Add missing file.
2016-05-27 10:01:12 +02:00
Rolf Bjarne Kvinge
82bbac0ae1
[docs] Fix wrench-docs.
2016-05-27 09:56:48 +02:00
Rolf Bjarne Kvinge
7d34d657c2
[tests] Update gitignore.
2016-05-26 15:15:21 +02:00
Rolf Bjarne Kvinge
c8b35f9b6a
[xharness] Fix mlaunch lookup.
2016-05-26 15:15:08 +02:00
Rolf Bjarne Kvinge
ecfdea9508
[tests] Import
2016-05-26 15:06:52 +02:00
Sebastien Pouliot
c126a6e354
[tests] Move linker tests from maccore ( #69 )
2016-05-20 14:07:34 -04:00
Rolf Bjarne Kvinge
1f1f6991a3
Implement support for exception marshalling.
2016-05-17 11:23:48 +02:00
Sebastien Pouliot
00ada0f773
Move parts of dontlink tests into new introspection tests ( #32 )
...
Those tests needs to be run with the linker disabled since they use
reflection for most of their work.
The original dontlink (for linker tests) was becoming too large in
some configuration (e.g. tvOS release with bitcode) but this was
due to other BCL assemblies (not the introspection tests)
2016-05-04 20:14:32 -04:00
Rolf Bjarne Kvinge
cb6557829f
[tests] Move HtmlTransform.xslt here from maccore. ( #16 )
...
Should fix this test error:
warning: failed to load external entity "../../xamarin-macios/tests/HtmlTransform.xslt"
cannot parse ../../xamarin-macios/tests/HtmlTransform.xslt
make[4]: *** [test-ios-tasks] Error 4
2016-04-28 15:07:26 -04:00
Rolf Bjarne Kvinge
aa7a17ccee
[tests] Fix test configuration issues with file moves. ( #15 )
...
This will fix at least some of the mtouch tests.
2016-04-28 15:06:41 -04:00
Rolf Bjarne Kvinge
c2bcb8d73f
[tests] Add bindings-framework-test.
2016-04-26 17:48:55 -04:00
Rolf Bjarne Kvinge
73ddab291c
[tests] Add bindings-test.
2016-04-26 17:27:37 -04:00
Rolf Bjarne Kvinge
842a86cb0d
[tests] Add test-libraries.
2016-04-26 08:00:35 -04:00
Sebastien Pouliot
9a680a7d02
[tests] Add README placeholder note
2016-04-25 16:55:12 -04:00
Rolf Bjarne Kvinge
24870304ba
Add an optional dependency on xamarin-specific build logic.
2016-04-24 14:48:45 -04:00
Rolf Bjarne Kvinge
68df944ad6
Build MSBuild targets & assemblies.
2016-04-24 14:48:44 -04:00