xamarin-macios/tests/introspection
Alex Soto bfc98f8059
[xcode12] Initial bump for Xcode 12 GM (#9644)
* [xcode12] Initial bump for Xcode 12 GM

* [tests][intro] We cannot load CoreNFC framework on iOS simulator anymore

* [tests][xtro] New Metal API are not abstract (before XAMCORE_4_0)

* [tests][intro] Fix crash when CSLocalizedString 'description' selector is called

* [tests][xtro] Add support for excluding platforms

Based on `Make.config` variables `INCLUDE_[IOS|TVOS|WATCH|MAC]`

This required moving some entries (common -> macOS) to keep the
sanitizer happy.

* [xtro] Ignore Intents watchOS differences since they will likely match iOS in the future

* Update to use Xcode 12 GMb instead of the old GM

* [tests][xtro] Remove OSLog for iOS and tvOS (changed in GM)

* [tests][msbuild] Disable FrameworkListTest based on the active/disabled platforms

* [tests][msbuild] Track new directory/file inside CoreML projects

* [mlaunch] Bump maccore and disable mlaunch if mac build is disabled

New commits in xamarin/maccore:

* xamarin/maccore@ba332d4d07 Disable mlaunch if Mac is not built (#2314)

Diff: 87a96d21c9..ba332d4d07

Co-authored-by: Sebastien Pouliot <sebastien.pouliot@microsoft.com>
2020-09-16 11:41:44 +02:00
..
Mac [xcode12] Introspection-based fixes for Big Sur (#9632) 2020-09-15 08:56:24 -04:00
iOS [xcode12] Initial bump for Xcode 12 GM (#9644) 2020-09-16 11:41:44 +02:00
ApiAvailabilityTest.cs [xcode12] Bump for beta 1 (#8935) 2020-06-26 14:02:44 -04:00
ApiBaseTest.cs [tests] Remove Classic code from all tests. (#8707) 2020-05-29 16:43:06 +02:00
ApiCMAttachmentTest.cs [xcode12] Bump for beta 3 (#9162) 2020-07-24 08:52:33 -04:00
ApiClassPtrTest.cs [tests] Remove Classic code from all tests. (#8707) 2020-05-29 16:43:06 +02:00
ApiCoreImageFiltersTest.cs [xcode12] Update for Xcode 12 beta 2 (#9052) 2020-07-10 08:56:23 -04:00
ApiCtorInitTest.cs [Vision] Update bindings to Xcode 12 Beta 1 - 6 (#9523) 2020-08-28 10:57:22 -04:00
ApiFieldTest.cs [xcode12] Bump for beta 1 (#8935) 2020-06-26 14:02:44 -04:00
ApiFrameworkTest.cs [tests] Remove Classic code from all tests. (#8707) 2020-05-29 16:43:06 +02:00
ApiPInvokeTest.cs [tests] Remove Classic code from all tests. (#8707) 2020-05-29 16:43:06 +02:00
ApiProtocolTest.cs [xcode12] Introspection-based fixes for Big Sur (#9632) 2020-09-15 08:56:24 -04:00
ApiSelectorTest.cs [Metal] Update framework for xcode 12 beta 6. (#9569) 2020-09-11 16:06:22 -04:00
ApiSignatureTest.cs [tests] Remove Classic code from all tests. (#8707) 2020-05-29 16:43:06 +02:00
ApiStructTest.cs [tests] Remove Classic code from all tests. (#8707) 2020-05-29 16:43:06 +02:00
ApiTypeTest.cs [xcode11.4] [tests] Add `.cctor` execution to introspection (#7987) 2020-02-26 16:16:04 -05:00
ApiTypoTest.cs [xcode12] Initial bump for Xcode 12 GM (#9644) 2020-09-16 11:41:44 +02:00
ApiWeakPropertyTest.cs [tests] Remove Classic code from all tests. (#8707) 2020-05-29 16:43:06 +02:00
CoreSelectorTest.cs [xcode12] Introspection-based fixes for Big Sur (#9632) 2020-09-15 08:56:24 -04:00
EnvironmentVariable.cs Move parts of dontlink tests into new introspection tests (#32) 2016-05-04 20:14:32 -04:00
README.md [tests] Move linker tests from maccore (#69) 2016-05-20 14:07:34 -04:00
xamarin1.png Move parts of dontlink tests into new introspection tests (#32) 2016-05-04 20:14:32 -04:00

README.md

Introspection Tests

Introspection tests are executed on target (both simulator and device for iOS) or a specific version of OSX. The application proceed to analyze itself using:

  • System.Reflection for managed code; and
  • the ObjectiveC runtime library for native code

and compare the results. E.g. if using .NET reflection it can see a binding for a NSBundle type then it should be able to find a native NSBundle type using the ObjC runtime functions. Otherwise an error is raised...

Since the application analyze itself it must contains everything we wish to test. That's why the introspection tests needs to be built with the managed linker disable, i.e. "Don't link".

Pros

  • The tests always tell the truth, which can differ from documentation or header files;

Cons

  • Incomplete - Not everything is encoded in the metadata / executable;
  • Too complete - Not every truth is good to be known (or published), which requires creating special cases in the tests