Meet the Music Understanding framework

Key Points

• Covers Music Understanding, a new framework that lets an app analyze audio across six dimensions, on device: key, rhythm, structure, pace, instrument activity, and loudness.
• And use the Music Understanding Lab sample app to visualize each result.
• The session moves through Musical features, Framework integration, Music Understanding Lab.
• Key concepts include MusicUnderstandingSession, AVAsset, CMTimeRanges, LUFS, AudioProvider, AsyncSequence, AVReadOnlyAudioPCMBuffer, KeyResult.
• Platform coverage: ios, ipados, macos, visionos, watchos.