E-08Adversarial Evals

Mix attack tasks into the benchmark and score refusals as wins.

Key insight

Capability and resistance are different axes. An agent you’ve only measured on cooperative tasks is unmeasured where it matters.

Failure mode

Attack tasks the agent can fingerprint: if adversarial items look different, you’re measuring detection, not resistance.

Elsewhere in the atlas