E-07Outcome vs Process Mismatch
An agent can succeed through a bad trajectory, and fail despite a mostly sound one.
Further reading
- Let’s Verify Step by Step Lightman et al., OpenAI 2023
- Training Verifiers to Solve Math Word Problems Cobbe et al., OpenAI 2021