The questions below concern security of AI systems: where information, identity and authority change hands. Our parallel AI-assisted security testing work is exploratory; these questions do not describe a product or a published result.
Material study / Shared foundation, separate spaces
01Intent & action
When does content become authority?
We investigate how an agent handles instructions embedded in retrieved documents, tool responses and other untrusted context. The question is what separates information it can read from actions it can take.
A shared index, context cache or memory store still needs to respect each user's access. We examine where identity and access checks apply as information moves from storage into a model's context.
RAG retrieval · Tenant filtering · Shared memory
03Identity & reach
Whose permissions does the agent inherit?
We study the relationship between a requested task, the agent executing it and its cloud workload identity. Which permissions are necessary, which are inherited, and what remains reachable if the agent is compromised?
A user approves a bounded task. Later, retrieved content changes the action or its target. The original approval may no longer describe what the agent is about to do.
The research question: does enforcement evaluate the final request, or rely on a decision made before it changed?
Illustrative scenario. Not a reported vulnerability or a client finding.
Examine the changeIntent ≠ execution
An illustrative request before and after its parameters change
Check
Approved task
Proposed action
Identity
Same user
Same user
Action
Read a record
Export records
Resource
Tenant A
Tenant B
The boundary to test
Authorisation must match the action and resource at execution—not just an earlier version of the task.
Investigate the conditions. Observe the decision. Test the alternative explanation.
From anomaly to evidence
One strange result is a starting point.
Research needs more than a convincing demonstration. It needs conditions another investigator can examine, and a conclusion that survives being challenged.
Material study / The detail that holds
What would change our conclusion?
01
State the assumption
Name the boundary that should hold. Record the system, identity, permissions and sequence needed to test it.
02
Separate cause from coincidence
Compare the observed behaviour with a control. Change relevant conditions and consider simpler explanations before assigning a cause.
03
Reproduce, then challenge
Repeat the test, record variation and examine counter-evidence. An inconsistent result narrows the claim; it is not a reason to hide uncertainty.
04
Define what the result supports
Keep the conclusion tied to tested conditions. Distinguish the demonstrated mechanism, untested cases and proposed fixes that still need validation.
Research into defence
Understand the failure. Improve the control.
The purpose is practical: sharper test cases for red teams, clearer enforcement points for engineers, and better questions for defenders to ask of their telemetry.
A useful result explains where a control belongs, what it must check and which conditions a retest needs to cover.
Working on an agent, retrieval system or cloud architecture with a boundary you need to understand? Tell us what it should prevent and where the uncertainty begins.