xamarin-macios/tests/introspection
Rolf Bjarne Kvinge 2ca8970122
[tests] Add a .NET version of introspection for Mac Catalyst. (#12039)
* [tests] Add a .NET version of introspection for Mac Catalyst.

It shows a lot of failures (so it's disabled by default), but this way we can
at least start to fix the failures.

* [xharness] Always ignore the new test.

* [xharness] Ignored projects should be ignored.
2021-07-28 09:39:29 +02:00
..
Mac [tests][macos] Fix protocol failures for introspection on beta 3 (#12233) 2021-07-26 20:29:05 -04:00
dotnet [tests] Add a .NET version of introspection for Mac Catalyst. (#12039) 2021-07-28 09:39:29 +02:00
iOS [tests] Fix introspection results on iOS 15 beta 3 devices (#12232) 2021-07-26 20:31:13 -04:00
ApiAvailabilityTest.cs [introspection] Add/fix/remove availability attributes for Mac Catalyst to make introspection's Introduced test pass. (#10587) 2021-04-13 15:48:20 -04:00
ApiBaseTest.cs [tests] Remove Classic code from all tests. (#8707) 2020-05-29 16:43:06 +02:00
ApiCMAttachmentTest.cs [corefoundation] Update `CFArray` and make it public (#12003) 2021-07-19 18:10:44 -04:00
ApiClassPtrTest.cs [tests] Remove Classic code from all tests. (#8707) 2020-05-29 16:43:06 +02:00
ApiCoreImageFiltersTest.cs [xcode12.2] Initial commit for Xcode 12.2 Beta 3 (#9877) 2020-10-15 12:08:27 -04:00
ApiCtorInitTest.cs [runtime] Add support for toggle refs to CoreCLR. (#11757) 2021-06-02 00:13:49 +02:00
ApiFieldTest.cs [xcode13] Bump PR to Xcode 13 Beta 2 (#12017) 2021-06-28 17:54:52 -04:00
ApiFrameworkTest.cs [CoreWLan] Add XCode13 beta 1 support. (#12103) 2021-07-19 09:02:47 -04:00
ApiPInvokeTest.cs [dotnet][tests][intro] Update ApiPInvokeTest (#11557) 2021-05-14 09:00:18 -04:00
ApiProtocolTest.cs [xcode13] Bump PR to Xcode 13 Beta 2 (#12017) 2021-06-28 17:54:52 -04:00
ApiSelectorTest.cs [tests] Fix introspection on macOS 12 (#12234) 2021-07-26 20:23:12 -04:00
ApiSignatureTest.cs [generator][dotnet] Add support for `[Uns|S]upportedOSPlatformAttribute` (#10580) 2021-04-10 11:09:14 -04:00
ApiStructTest.cs [tests] Remove Classic code from all tests. (#8707) 2020-05-29 16:43:06 +02:00
ApiTypeTest.cs [introspection] Add/fix/remove availability attributes for Mac Catalyst to make introspection's Introduced test pass. (#10587) 2021-04-13 15:48:20 -04:00
ApiTypoTest.cs [CHIP] Add support for Xcode13 beta2. (#12025) 2021-06-30 20:18:41 -04:00
ApiWeakPropertyTest.cs [tests] Remove Classic code from all tests. (#8707) 2020-05-29 16:43:06 +02:00
CoreSelectorTest.cs [xcode12] Introspection-based fixes for Big Sur (#9632) 2020-09-15 08:56:24 -04:00
EnvironmentVariable.cs Move parts of dontlink tests into new introspection tests (#32) 2016-05-04 20:14:32 -04:00
README.md [tests] Move linker tests from maccore (#69) 2016-05-20 14:07:34 -04:00
xamarin1.png Move parts of dontlink tests into new introspection tests (#32) 2016-05-04 20:14:32 -04:00

README.md

Introspection Tests

Introspection tests are executed on target (both simulator and device for iOS) or a specific version of OSX. The application proceed to analyze itself using:

  • System.Reflection for managed code; and
  • the ObjectiveC runtime library for native code

and compare the results. E.g. if using .NET reflection it can see a binding for a NSBundle type then it should be able to find a native NSBundle type using the ObjC runtime functions. Otherwise an error is raised...

Since the application analyze itself it must contains everything we wish to test. That's why the introspection tests needs to be built with the managed linker disable, i.e. "Don't link".

Pros

  • The tests always tell the truth, which can differ from documentation or header files;

Cons

  • Incomplete - Not everything is encoded in the metadata / executable;
  • Too complete - Not every truth is good to be known (or published), which requires creating special cases in the tests