BRK450 Breakout Tue 17 Nov 14:00 PST
No cloud required: Build AI apps with SQL Server on Azure Local
Bob Ward
Summary
From the recording / Microsoft AI summary
The session positioned Azure Local between self-managed Windows Server and Hyper-V or VMware, with a path for VMware customers. The demo was a care transfer app running SQL Server and Foundry Local models entirely on-premises, with GitHub Copilot in SSMS using a local model. Much works disconnected, managed through Arc, though some features are limited offline. Connected billing is per core per hour.
Session description
Microsoft's catalogue description
Performance and AI innovation should not come at the expense of compliance and control. See how Microsoft brings SQL and local AI to sovereign, regulated, edge, and disconnected environments. Learn how Azure Local and Microsoft Foundry help keep sensitive data within trusted boundaries, bring AI inferencing closer to operational data, and support data residency, governance, resiliency, and low-latency requirements.
Demo timestamps
Microsoft's player does not support links to a specific time, so open the recording and skip to the time shown.
- Skip to 0:09:40
Scenario: regional care transfer centre app on Azure Local
An app that must run inside a compliant boundary with no cloud: Azure Virtual Desktop, SQL Server 2025 in Azure Local VMs, and Foundry Local on a GPU AKS cluster. Incoming ambulance patient data appears as a queue.
- Skip to 0:15:03
SQL Server 2025 AI features in the app
Shows semantic search with embeddings, JSON storage, regular expressions and a stored procedure that generates a receiving briefing using vector search over patient history.
- Skip to 0:24:25
AI skills stored in a table, audited with Ledger
Stores AI skills as JSON in a table, builds prompts and calls the local model over REST from SQL. Each request and response is recorded in a Ledger table that administrators cannot change.
- Skip to 0:31:10
Local GitHub Copilot in SSMS and VS Code
GitHub Copilot in SSMS analyses deadlocks from the System Health extended events session using a Foundry Local model. Copilot in VS Code explains the AI schema, with no cloud model.