Guided defense lab
Incident Investigation
A guided exercise on one question: does the available evidence support confirmed security impact, or must the case remain investigation evidence or unobserved? Detector alerts, blocked proposals, executed requests, telemetry gaps and scoped credential exposure.
This exercise uses authored, deterministic, synthetic evidence records with fictional systems and .example.test names. It calls no models, APIs or providers, contains no real logs or credential values and is not legal advice. Real evidence may contain personal or confidential data: collect only what an investigation needs, restrict access and apply defined retention.
Learning objectives
- Keep suspicious content, model influence, control decisions, proposals, submissions, executions and downstream effects as separate evidence states.
- Reconstruct the evidence chain with correlation IDs instead of inferring from a detector hit, model statement, block or missing response.
- Treat unobserved stages as unobserved, neither failed nor safe.
- Scope confirmed impact, containment and credential rotation to what the evidence establishes.
- Preserve evidence before destructive cleanup where practical, collecting only what the investigation needs.
- Explain why a failed deterministic boundary needs a boundary repair, not only new prompt wording.
Prerequisites
- Incident Response defense article (recommended)
- Prompt Injection Detection defense article (recommended)
Evidence chain
Source text and model output are variable content. That they were observed at a stage, their provenance, timestamps, correlation IDs, authorization decisions, execution telemetry and downstream audit are evidence kept outside the model. The classification is derived from the strongest available evidence.
- Source / provenance recordRecorded evidence->
- Context / model observationVariable content->
- Proposed actionVariable content->
- Authorization / control decisionRecorded evidence->
- Submission / execution telemetryRecorded evidence->
- Downstream effect / provider auditRecorded evidence->
- Investigation classification (derived from evidence)Recorded evidence
Model-visible text and model output
Retrieved content, proposals and what the model says it did. Useful context, never authoritative evidence of execution or impact.
- Retrieved article excerpt
Support article KB-51 with a paragraph phrased as an instruction to the assistant (shown here as a synthetic marker only).
- Model answer
Here are the three steps to reset your fictional device, from KB-51.
Recorded evidence
Provenance, detector events, plan and authorization records, submission and execution telemetry, downstream or provider audit and correlation IDs.