Spatial Computing / 16:23

Build live production tools for Apple Immersive Video

Spatial ComputingAudio & Videomacosvisionos

Key Points

  • Go behind the scenes of live Apple Immersive Video production.
  • Shows how to package immersive video, spatial audio, and scene metadata for transport over IP networks using the SMPTE 2110 standard.
  • To get the most out of this session, watch "Learn about Apple Immersive Video technologies" from WWDC25.
  • The session moves through Live production overview, What makes immersive live different, Immersive live format, Real-time media transport, Recording and playback.
  • Key concepts include Apple Immersive Video, SMPTE, AVFoundation, WWDC25, SportsNet, ProRes, JSON, ASAF.
  • Platform coverage: macos, visionos.

Condensed Flow

01

What makes immersive live different:

Focuses on ASAF, SMPTE.

02

Immersive live format:

Focuses on ProRes, JSON.

03

Real-time media transport:

Focuses on ProRes.

04

Recording and playback:

Focuses on JSON, AVFoundation, VideoToolbox, AudioToolbox.

More Detail

Additional details

  • Detailed flow: Live production overview -> What makes immersive live different -> Immersive live format -> Real-time media transport -> Recording and playback.
  • APIs and concepts to recognize: Apple Immersive Video, SMPTE, AVFoundation, WWDC25, SportsNet, ProRes, JSON, ASAF, VideoToolbox, AudioToolbox, AVVideoCompressionPropertiesKey, AVAssetWriter.
  • Version and support notes focus on ProRes.
  • Implementation focus: AVVideoCompressionPropertiesKey, VideoToolbox, Apple Immersive Video, AVFoundation, AudioToolbox, ProRes.

Resources