SwiftUI & UI Frameworks / 15:10

Read between the strokes with PencilKit

SwiftUI & UI FrameworksApp Servicesiosipadosmacosvisionos

Key Points

  • Covers handwriting recognition in apps using the same powerful technology behind Apple apps like Freeform and Notes.
  • Shows how to use handwriting recognition across a wide range of alphabets and languages, and covers new capabilities for integrating PencilKit into a wider variety of.
  • The session moves through Handwriting recognition, Path conversion, Improved model access, Stroke slicing.
  • Key concepts include PencilKit, PaperKit, visionOS 27, iOS 27, PKStrokeRecognizer, UIFindInteractionDelegate, PKStrokePaths, PKDrawing.
  • Platform coverage: ios, ipados, macos, visionos.

Condensed Flow

01

Handwriting recognition:

Focuses on iOS 27, PKStrokeRecognizer, UIFindInteractionDelegate.

02

Path conversion:

Focuses on PencilKit, PKStrokePaths, PKDrawing, PKStrokeRecognizer.

03

Improved model access:

Focuses on PencilKit, iOS 27.

04

Stroke slicing:

Focuses on iOS 27, PKStroke, PKStrokePath.

More Detail

Additional details

  • Detailed flow: Handwriting recognition -> Path conversion -> Improved model access -> Stroke slicing.
  • APIs and concepts to recognize: PencilKit, PaperKit, visionOS 27, iOS 27, PKStrokeRecognizer, UIFindInteractionDelegate, PKStrokePaths, PKDrawing, PKStroke, PKStrokePath, Metal, UIFindInteraction.
  • Version and support notes focus on PaperKit, PencilKit, iOS 27, visionOS 27, PKStrokeRecognizer.
  • Implementation focus: PencilKit, iOS 27, UIFindInteractionDelegate, PKStrokePaths, PKDrawing, PKStrokeRecognizer.

Resources