AI & Machine Learning / 29:21

Dive into Core AI model authoring and optimization

AI & Machine Learningiosipadosmacoswatchos

Key Points

  • Covers the complete custom model deployment workflow for Apple silicon with the new Core AI framework.
  • Covers powerful techniques for authoring models using custom Metal kernels, alongside platform-aware compression strategies.
  • The session moves through Models and skills, Python workflow, Model optimization, Core AI Debugger, Advanced authoring, Custom Metal kernels, and related wrap-up guidance.
  • Key concepts include Core AI, Metal, PyTorch, SAM3, Metal tensors, TorchMetalKernel, LLMs, TorchConverter.
  • Platform coverage: ios, ipados, macos, watchos.

Condensed Flow

01

Models and skills:

Focuses on Core AI, PyTorch.

02

Python workflow:

Focuses on Core AI, PyTorch.

03

Model optimization:

Focuses on SAM3.

04

Core AI Debugger:

Focuses on Core AI.

05

Advanced authoring:

Focuses on Core AI.

06

Custom Metal kernels:

Focuses on Metal, Core AI, SAM3, Metal tensors.

07

Model re-authoring:

Focuses on Core AI, PyTorch.

More Detail

Additional details

  • Detailed flow: Models and skills -> Python workflow -> Model optimization -> Core AI Debugger -> Advanced authoring -> Custom Metal kernels -> Model re-authoring.
  • APIs and concepts to recognize: Core AI, Metal, PyTorch, SAM3, Metal tensors, TorchMetalKernel, LLMs, TorchConverter, KMeansPalettizer.
  • Implementation focus: Core AI, PyTorch, SAM3, Metal, Metal tensors, KMeansPalettizer.

Resources