Graphics & Games / 14:05

Explore enhancements to visionOS object tracking

Graphics & GamesSpatial Computingiosipadosvisionos

Key Points

  • Find out how visionOS is advancing object tracking and spatial accessory input.
  • Covers new supported classes of spatial accessories and what is needed to build their own custom accessories to enable unique interaction models in apps.
  • The session moves through Object tracking, Spatial accessories, Creating a spatial accessory, Plug-and-play accessories, Implementing in an app.
  • Key concepts include Object Tracking, spatial accessories, USDZ, visionOS 26, PSVR2, ARKit, CreateML, GCSpatialAccessory.
  • Platform coverage: ios, ipados, visionos.

Condensed Flow

01

Object tracking:

Focuses on ARKit.

02

Creating a spatial accessory:

Focuses on ARKit, CreateML.

03

Implementing in an app:

Focuses on GCSpatialAccessory.

More Detail

Additional details

  • Detailed flow: Object tracking -> Spatial accessories -> Creating a spatial accessory -> Plug-and-play accessories -> Implementing in an app.
  • APIs and concepts to recognize: Object Tracking, spatial accessories, USDZ, visionOS 26, PSVR2, ARKit, CreateML, GCSpatialAccessory, iOS 27, LEDs, ARObjectAnchor, UTType.
  • Version and support notes focus on spatial accessories, visionOS 26, PSVR2, iOS 27, ARKit.
  • Implementation focus: USDZ, ARKit, LEDs.

Resources