Skip to content

THR888 Theater Tue 17 Nov 16:05 PST

Build On-Device AI Experiences w/ Windows AI APIs

Savo Icagic, Greg Woo

Session description

Microsoft's catalogue description

See Aion Instruct and Windows AI APIs in action. Learn how to add on-device language and vision capabilities to Windows apps using practical APIs, patterns, and tools for responsive AI experiences on Windows.

Demo timestamps

Microsoft's player does not support links to a specific time, so open the recording and skip to the time shown.

  1. Skip to 0:05:03

    Text generation, rewrite and summarization APIs demo

    Demo of ready-to-use text APIs: text rewrite, summarization, structured output and LoRA fine-tuning. Examples include email drafting, casual-tone rewriting and summarizing a long report locally on an NPU.

  2. Skip to 0:08:23

    Flux Ink handwriting AI and next-word prediction

    Flux Ink, an AI-powered note-taking app, uses two models. One is a handwriting AI model powered by Windows ML. The other provides next-word prediction.

  3. Skip to 0:09:14

    Structured output API for JSON generation

    A customer order intake workflow turns free-form text into structured JSON containing item names, quantities and shipping methods.

  4. Skip to 0:14:44

    Video Super Resolution and video stabilization

    Original and enhanced video streams are compared, showing improved clarity and more readable text. Another demo shows video stabilization reducing camera shake.

Watch on-demand (opens in a new tab)

Resources named in the session

← All sessions