Skip to content
Status: Preview Includes Flex nodes on-premises

Foundry on your own AKS clusters

Foundry can run on customers' own AKS clusters, including Flex nodes on-premises. This is in preview.

Sources

INV643 Innovation Session Tue 17 Nov 14:00 PST

AI infrastructure from cloud to edge

Pavan Davuluri, Mark Russinovich

From the recording / Microsoft AI summary

The session covered Agent Grid, which sets network policy per agent sandbox, and Azure Integrated HSM, which keeps secrets away from models. It also covered RDMA from Azure Storage directly into VMs, Foundry on a customer's own AKS with Flex nodes, Azure Catalyst from ServiceNow inventory to landing zone, and new confidential VMs and confidential AKS nodes.

BRK420 Breakout Tue 17 Nov 16:30 PST

Deploy and run Microsoft Foundry models and agents on AKS

Brendan Burns, Jorge Palma

Demo timestamps

Microsoft's player does not support links to a specific time, so open the recording and skip to the time shown.

  1. Skip to 0:05:20

    AKS AI manager overview video

    Short recorded intro to AKS AI manager, described as connecting the Foundry managed service to Azure Kubernetes Service, from model-as-a-service through to open-weight models on the customer's own infrastructure.

  2. Skip to 0:11:06

    Caldova production-line application

    Operations view of multiple production lines with an issue on line 7. Signals, readiness checks and equipment-manual links show the existing slow root-cause analysis path before agents and models are applied.

  3. Skip to 0:19:44

    Plant-side nodes managed by AKS with Entra-authenticated models

    Models are deployed onto cores running in the plants rather than Azure, with nodes managed by AKS. Models are accessed with short-lived Microsoft Entra ID tokens instead of API keys.

  4. Skip to 0:27:07

    Agent Grid policies in the Azure portal

    Agent Grid shows allow-lists for maintenance, telemetry and explicit APIs. The same blocked call seen in Foundry appears as a red line in the portal graph of agent API calls.

Watch on-demand (opens in a new tab)

More in this area

← All announcements