Mixed Reality Creators

AI powered spatial games & apps development using Unity.


Mixed Reality Creators

Over versions 69 through 74, the Meta XR Unity SDK packages evolved from basic Unity 6 compatibility fixes to a rich suite of mixed-reality features—dynamic object tracking, audio-driven visemes, microgestures, Passthrough Camera APIs, in-headset debugging tools, and expanded OpenXR support. Below is a breakdown of the most significant updates in each package.

Meta XR Core SDK (com.meta.xr.sdk.core)
v69 – v69.0.1 (Oct 2024)
Unity 6 editor regression fix: Patched input registration and head-locking issues when using Unity OculusXR Plugin alongside Meta XR Core SDK; users were urged to update to v69.0.1 via Unity Package Manager .

v72.0 (Jan 23 2025)
Dynamic Object Tracking API: Public release of an API enabling runtime tracking of real-world objects for physics and interactions .

Audio-to-Expressions Viseme Support: Machine-learning-driven mapping of microphone input to avatar facial motions (lip sync, upper-face expressions) .

v74.0 (Mar 14 2025)
Minimum Unity version bumped to 2022.3.15f1 .

Microgesture support: Thumb-swipe and thumb-tap gestures for Quest 2/3/S/Pro to streamline actions like scrolling or teleportation .

Passthrough Camera API (PCA): Experimental public API granting access to forward-facing RGB cameras for in-engine effects and ML/CV pipelines .

Immersive Debugger integration: View and inspect scene hierarchy directly in-headset; moved Scene Debugger from MR Utility Kit into the main tool .

Building Blocks enhancements: Added “Collections” grouping, new multiplayer matchmaking blocks (“Friends Matchmaking”, “Local Matchmaking”), and “Instant Content Placement” for MR experiences .

New in-Editor tools: SDK welcome screen, notification system for actionable items, and direct bug submission from Project Setup Rules page .

v74.1 (Mar 26 2025)
Passthrough over Link crash fix: Resolved engine crash during shutdown of Insight Passthrough .

Depth API over Link known issue: Documented a hang in the Meta Link App when using Environment Depth API over Link (play mode), pending resolution in an upcoming release .

v74.2 (Apr 9 2025)
OpenXR floor space update: Prevented undefined behavior and excessive log spam when setting Floor space under the OpenXR Plugin .

Interaction profile warning: Added project-setup tooling to warn if no interaction profile is defined, ensuring OVRInput compatibility .

Meta XR Interaction SDK
v69 (Aug – Sep 2024)
Horizon OS UI Set: Introduced a Unity-native UI component library styled for Horizon OS, supporting direct touch and pinch interactions from both controllers and hand tracking .

v74 (Mar 2025)
Depth API support: Enabled Unity’s Depth API for occlusion and environment depth via OpenXR, improving mixed-reality compositing workflows .

OpenXR hand skeleton transition: Continued support for the legacy OVR hand skeleton through v74, with migration guidance toward the new OpenXR hand skeleton APIs .

Meta XR Audio SDK
v74 (2025)
Core audio API expansions: Refined classes such as MetaXRAudioSettings, MetaXRAcousticSettings, FMODPluginInterface, and introduced experimental feature flags on audio sources .

Meta XR Simulator
v74 (Mar 14 2025)
Unity version requirement raised to 2022.3.15f1 .

OpenXR extension support: Added XR_META_dynamic_object_keyboard, XR_EXT_PALM_POSE_EXTENSION, and XR_KHR_locate_spaces .

Controller-driven hand tracking: Enabled pairing of physical controllers for enhanced simulated hand tracking .

Quest 3S device profile and LocalFloor space support .

Passthrough resuming, Mac gamepad control, and a “Report issue” button for easier feedback .

Logging and input improvements: More granular log types and input simulation fixes; corrected synthetic-environment mesh orientation; fixed freezing when combined with OpenXR floor space .

Meta XR All-in-One SDK
v74.2 (Apr 9 2025)
Aggregated package bump: Increased minimal Unity to 2022.3.15f1 and automatically pulls in the latest Core, Audio, Haptics, Interaction, Platform, Voice, Simulator, and MR Utility Kit packages, ensuring consistent upgrades across all Meta XR UPM packages .

3 days ago | [YT] | 1

Mixed Reality Creators

Join the Meta Interaction SDK Unity Development Livestream tomorrow:

youtube.com/live/ZHLWgl13718?si=csABWWeG9Tl5mtWc

5 months ago | [YT] | 0

Mixed Reality Creators

Changed the name of the channel from "The Mixed Reality Engineer" to "Mixed Reality Creators" to encompass a wider range of designer, developers and artists who associate with mixed reality, AI and spatial computing.

Mixed reality is the future of interactions and we must master all the skills required to build those interactions!

5 months ago | [YT] | 2

Mixed Reality Creators

There will be a livestream on coming Sunday where I will be explaining how to use Meta Interaction SDK to build custom interactions for Meta Quest 3/3S.

Details loading soon...

5 months ago | [YT] | 1

Mixed Reality Creators

Thumbnail for the next video in the Meta Quest Mixed Reality series is ready!
Here it is. Thoughts?... Video coming out by end of coming week.

6 months ago (edited) | [YT] | 2

Mixed Reality Creators

I am now live on patreon!

patreon.com/TheMixedRealityEngineer?utm_medium=unk…

Working hard to build a community around AI assisted game & mixed reality development.

You can follow me on patreon to start getting latest posts, resources and an invite to my discord community (launching next week).

6 months ago (edited) | [YT] | 2

Mixed Reality Creators

Cursor IDE is a game-changer for Unity development!

Check out this live demo video to learn how to seamlessly integrate Cursor IDE as a Visual Studio alternative in your Unity workflow.

Elevate your game with AI-powered Unity development!

7 months ago (edited) | [YT] | 0

Mixed Reality Creators

Getting inputs from controllers is the first step to make any interaction with the elements in the virtual world. That’s why its important as a developer to understand how to make it work the way you want.

Our upcoming video will give you the complete idea of how you can access the inputs of the various controller buttons of your meta quest controllers.

PS: Video is now released:- https://youtu.be/ne4g6bz1XaI?si=d89Eu...

Stay updated by subscribing to the channel and pressing the bell button to get the notifications :)

8 months ago (edited) | [YT] | 1