xamarin-macios/tests/introspection
Alex Soto 16d5d68503 [UIKit] Updated UIKit to xcode8-beta6 (#636)
Expected extrospection test failures:

- ios.unclassified:!missing-field! UIApplicationInvalidInterfaceOrientationException not bound

Generator bugs:

- HACK: We have a generator bug(?) that won't allow overloads (AmbiguousMatchException) in protocols

tvOS/iOS 9 Introspection Expected failures (UIKit Only):

- [FAIL] UIKit.UIContentSizeCategoryExtensions.UIContentSizeCategoryUnspecified
Generated enum extensions do not honor availability on NSString properties

API Diff, expected changes (verified and correct):

Type Changed: UIKit.UIContentSizeCategory

Modified fields:

	ExtraExtraExtraLarge = 6 7
	ExtraExtraLarge = 5 6
	ExtraLarge = 4 5
	ExtraSmall = 0 1
	Large = 3 4
	Medium = 2 3
	Small = 1 2

Added values:

	AccessibilityExtraExtraExtraLarge = 12,
	AccessibilityExtraExtraLarge = 11,
	AccessibilityExtraLarge = 10,
	AccessibilityLarge = 9,
	AccessibilityMedium = 8,
	Unspecified = 0,
2016-08-22 08:44:43 -04:00
..
Mac [XM] Fix "random" crash in introspection tests (#565) 2016-08-05 16:14:37 -05:00
iOS [UIKit] Updated UIKit to xcode8-beta6 (#636) 2016-08-22 08:44:43 -04:00
ApiBaseTest.cs Merge remote-tracking branch 'origin/master' into xcode8 2016-06-28 12:44:08 +02:00
ApiCMAttachmentTest.cs [tests] Fix intro failures reported from iOS 6.1 and 7.1 devices (#629) 2016-08-18 23:02:42 -04:00
ApiClassPtrTest.cs Move parts of dontlink tests into new introspection tests (#32) 2016-05-04 20:14:32 -04:00
ApiCoreImageFiltersTest.cs Move parts of dontlink tests into new introspection tests (#32) 2016-05-04 20:14:32 -04:00
ApiCtorInitTest.cs [metalperformanceshaders] Update up to beta 5 (#605) 2016-08-16 12:00:49 -04:00
ApiFieldTest.cs Move parts of dontlink tests into new introspection tests (#32) 2016-05-04 20:14:32 -04:00
ApiPInvokeTest.cs [metalperformanceshaders] Update up to beta 5 (#605) 2016-08-16 12:00:49 -04:00
ApiProtocolTest.cs [modelio] Update for iOS 10 beta 1 (#606) 2016-08-19 13:55:59 -04:00
ApiSelectorTest.cs [modelio] Update for iOS 10 beta 1 (#606) 2016-08-19 13:55:59 -04:00
ApiSignatureTest.cs [spritekit] Update for iOS 10 beta 1 (#498) 2016-08-03 19:12:07 +02:00
ApiStructTest.cs Move parts of dontlink tests into new introspection tests (#32) 2016-05-04 20:14:32 -04:00
ApiTypoTest.cs [metalperformanceshaders] Update up to beta 5 (#605) 2016-08-16 12:00:49 -04:00
ApiWeakPropertyTest.cs Move parts of dontlink tests into new introspection tests (#32) 2016-05-04 20:14:32 -04:00
CoreSelectorTest.cs Move parts of dontlink tests into new introspection tests (#32) 2016-05-04 20:14:32 -04:00
EnvironmentVariable.cs Move parts of dontlink tests into new introspection tests (#32) 2016-05-04 20:14:32 -04:00
README.md [tests] Move linker tests from maccore (#69) 2016-05-20 14:07:34 -04:00
xamarin1.png Move parts of dontlink tests into new introspection tests (#32) 2016-05-04 20:14:32 -04:00

README.md

Introspection Tests

Introspection tests are executed on target (both simulator and device for iOS) or a specific version of OSX. The application proceed to analyze itself using:

  • System.Reflection for managed code; and
  • the ObjectiveC runtime library for native code

and compare the results. E.g. if using .NET reflection it can see a binding for a NSBundle type then it should be able to find a native NSBundle type using the ObjC runtime functions. Otherwise an error is raised...

Since the application analyze itself it must contains everything we wish to test. That's why the introspection tests needs to be built with the managed linker disable, i.e. "Don't link".

Pros

  • The tests always tell the truth, which can differ from documentation or header files;

Cons

  • Incomplete - Not everything is encoded in the metadata / executable;
  • Too complete - Not every truth is good to be known (or published), which requires creating special cases in the tests