THR888 Theater Tue 17 Nov 16:05 PST
Build On-Device AI Experiences w/ Windows AI APIs
Savo Icagic, Greg Woo
Session description
Microsoft's catalogue description
See Aion Instruct and Windows AI APIs in action. Learn how to add on-device language and vision capabilities to Windows apps using practical APIs, patterns, and tools for responsive AI experiences on Windows.
Demo timestamps
Microsoft's player does not support links to a specific time, so open the recording and skip to the time shown.
- Skip to 0:05:03
Text generation, rewrite and summarization APIs demo
Demo of ready-to-use text APIs: text rewrite, summarization, structured output and LoRA fine-tuning. Examples include email drafting, casual-tone rewriting and summarizing a long report locally on an NPU.
- Skip to 0:08:23
Flux Ink handwriting AI and next-word prediction
Flux Ink, an AI-powered note-taking app, uses two models. One is a handwriting AI model powered by Windows ML. The other provides next-word prediction.
- Skip to 0:09:14
Structured output API for JSON generation
A customer order intake workflow turns free-form text into structured JSON containing item names, quantities and shipping methods.
- Skip to 0:14:44
Video Super Resolution and video stabilization
Original and enhanced video streams are compared, showing improved clarity and more readable text. Another demo shows video stabilization reducing camera shake.