Foundry on your own AKS clusters
Foundry can run on customers' own AKS clusters, including Flex nodes on-premises. This is in preview.
Sources
Related sessions
INV643 Innovation Session Tue 17 Nov 14:00 PST
AI infrastructure from cloud to edge
Pavan Davuluri, Mark Russinovich
From the recording / Microsoft AI summary
The session covered Agent Grid, which sets network policy per agent sandbox, and Azure Integrated HSM, which keeps secrets away from models. It also covered RDMA from Azure Storage directly into VMs, Foundry on a customer's own AKS with Flex nodes, Azure Catalyst from ServiceNow inventory to landing zone, and new confidential VMs and confidential AKS nodes.
BRK420 Breakout Tue 17 Nov 16:30 PST
Deploy and run Microsoft Foundry models and agents on AKS
Brendan Burns, Jorge Palma
Demo timestamps
Microsoft's player does not support links to a specific time, so open the recording and skip to the time shown.
- Skip to 0:05:20
AKS AI manager overview video
Short recorded intro to AKS AI manager, described as connecting the Foundry managed service to Azure Kubernetes Service, from model-as-a-service through to open-weight models on the customer's own infrastructure.
- Skip to 0:11:06
Caldova production-line application
Operations view of multiple production lines with an issue on line 7. Signals, readiness checks and equipment-manual links show the existing slow root-cause analysis path before agents and models are applied.
- Skip to 0:19:44
Plant-side nodes managed by AKS with Entra-authenticated models
Models are deployed onto cores running in the plants rather than Azure, with nodes managed by AKS. Models are accessed with short-lived Microsoft Entra ID tokens instead of API keys.
- Skip to 0:27:07
Agent Grid policies in the Azure portal
Agent Grid shows allow-lists for maintenance, telemetry and explicit APIs. The same blocked call seen in Foundry appears as a red line in the portal graph of agent API calls.
More in this area
- Status: Generally available AI Gateway for unified AI management and policy
- Status: Generally available Azure Catalyst: agent-led discovery, business case, landing zones and migration
- Status: Generally available Azure Chaos Studio Workspaces and AKS extension
- Status: Generally available Azure Cobalt 200 VMs