What’s new in image understanding

Key Points

• Covers powerful image understanding with the latest Vision framework and Foundation Models framework updates.
• Combine the new image support in Apple Foundation Model together with OCR, barcode scanning and their own tools to deliver LLM-powered visual understanding in an app.
• The session moves through Segment images with tap-to-segment, Image inputs for Foundation Models, Image-based tool calling, Vision on watchOS.
• Key concepts include Vision framework, Foundation Models, ImageRequestHandler, GenerateIterativeSegmentationRequest.
• Platform coverage: ios, ipados, macos, visionos, watchos.