Guided defense lab

Incident Investigation

A guided exercise on one question: does the available evidence support confirmed security impact, or must the case remain investigation evidence or unobserved? Detector alerts, blocked proposals, executed requests, telemetry gaps and scoped credential exposure.

Conceptual simulationAdvanced18 minutes2026-09-27
Conceptual simulation

This exercise uses authored, deterministic, synthetic evidence records with fictional systems and .example.test names. It calls no models, APIs or providers, contains no real logs or credential values and is not legal advice. Real evidence may contain personal or confidential data: collect only what an investigation needs, restrict access and apply defined retention.

3/6

Learning objectives

  • Keep suspicious content, model influence, control decisions, proposals, submissions, executions and downstream effects as separate evidence states.
  • Reconstruct the evidence chain with correlation IDs instead of inferring from a detector hit, model statement, block or missing response.
  • Treat unobserved stages as unobserved, neither failed nor safe.
  • Scope confirmed impact, containment and credential rotation to what the evidence establishes.
  • Preserve evidence before destructive cleanup where practical, collecting only what the investigation needs.
  • Explain why a failed deterministic boundary needs a boundary repair, not only new prompt wording.

Prerequisites

  • Incident Response defense article (recommended)
  • Prompt Injection Detection defense article (recommended)
Choose a scenario

Each fictional scenario shows model-visible text and, separately, evidence records maintained outside the model. You decide whether the current evidence supports confirmed security impact - not whether anything should be permitted.

Evidence chain

Source text and model output are variable content. That they were observed at a stage, their provenance, timestamps, correlation IDs, authorization decisions, execution telemetry and downstream audit are evidence kept outside the model. The classification is derived from the strongest available evidence.

  1. Source / provenance recordRecorded evidence->
  2. Context / model observationVariable content->
  3. Proposed actionVariable content->
  4. Authorization / control decisionRecorded evidence->
  5. Submission / execution telemetryRecorded evidence->
  6. Downstream effect / provider auditRecorded evidence->
  7. Investigation classification (derived from evidence)Recorded evidence

Model-visible text and model output

Retrieved content, proposals and what the model says it did. Useful context, never authoritative evidence of execution or impact.

  1. Retrieved article excerpt

    Support article KB-51 with a paragraph phrased as an instruction to the assistant (shown here as a synthetic marker only).

  2. Model answer

    Here are the three steps to reset your fictional device, from KB-51.

Recorded evidence

Provenance, detector events, plan and authorization records, submission and execution telemetry, downstream or provider audit and correlation IDs.

Which evidence is authoritative for classifying this case?