ODSP2218 Pre-recorded On demand
Follow one record: What an AI agent will hand over if you ask nicely
Roee Shohat
Summary
From Microsoft's AI summary
Orca Security demonstrates how an Azure OpenAI-backed shop assistant can leak customer data. A storage container holds customer records, and the agent's VM has leftover access to it. Direct jailbreak phrases are blocked, but indirect prompts framed as verification or migration succeed. Orca detects prompt injection and PII, including social security numbers, using an eBPF sensor without TLS interception. A second assistant with a custom guardrail policy covering PII blocks the same attempts. The session recommends least privilege and tailored filtering. No availability or pricing was stated.
Session description
Microsoft's catalogue description
A shopping assistant built on Azure AI Foundry does its job: answer questions, look up accounts, be helpful. Then someone asks it to confirm a record “for the migration,” and it returns a name, email, Social Security number and full card number. Follow that record from Blob Storage through the agent’s tool call into the answer, trace where data can be exposed on the way, and find the one configuration change separating an agent that leaks from one that refuses, though both look protected.