ARFoundation With OpenCVForUnity Example

• An example of integrating ARFoundation with OpenCVForUnity.
• An example of replacing WebCamTextureToMatHelper with ARFoundationCameraToMatHelper.
• An example of ArUco marker detection from an ARFoundation camera image.

Environment

• Android (Pixel, Galaxy S10+) / iOS (iPhoneSE2)
• Unity >= 2021.3.35f1+
• Scripting backend MONO / IL2CPP
• [AR Foundation] 5.1.5+
• [ARCore XR Plugin] 5.1.5+
• [ARKit XR Plugin] 5.1.5+
• OpenCV for Unity 2.6.4+

Demo

• Android ARFoundationWithOpenCVForUnityExample.apk

Setup

1. Download the latest release unitypackage. ARFoundationWithOpenCVForUnityExample.unitypackage
2. Create a new project. (ARFoundationWithOpenCVForUnityExample)
3. Install AR Foundation from Package Manager.
4. Install ARCore XR Plugin from Package Manager.
5. Install ARKit XR Plugin from Package Manager.
6. Import OpenCVForUnity.
   • Setup the OpenCVForUnity. (Tools > OpenCV for Unity > Set Plugin Import Settings)
7. Import the ARFoundationWithOpenCVForUnityExample.unitypackage.
8. Change the "Player Settings (Androd)" Inspector as follows.
   • Graphics APIs : OpenGLES 3 (Remove "Vulkan" from the Graphics APIs list)
   • Minimum API Level : Android 7.0 (API Level 24)
9. Open the menu "Edit => Project Settings => XR Plug-in Management (Android)" and check "ARCore".
10. Change the "Player Settings (iOS)" Inspector as follows.
    • Camera Usage Description : "Required for augmented reality support."
    • Target minimum iOS Version : 12.0
    • Architecture : ARM64
11. Open the menu "Edit => Project Settings => XR Plug-in Management (iOS)" and check "ARKit".
    • (It seems that the camera cannot switch to the inner camera unless the Face tracking subsystem is enabled here.)
12. Add the "Assets/ARFoundationWithOpenCVForUnityExample/*.unity" files to the "Scenes In Build" list in the "Build Settings" window.
13. Build and Deploy to Android and iOS.
    • (Print the AR marker "CanonicalMarker-d10-i1-sp500-bb1.pdf" on an A4 size paper)

ScreenShot