/p/2026-10-17 · explainer
Paper explainer · 2610.20805 · Li, Shi and Li

It reasoned, you retrieved, and the trace outvoted the evidence.

Every pipeline that thinks before it looks has this seam: the model writes a reasoning trace, fresher evidence arrives, and then something has to answer. Keep going inside the model’s own thinking block and it repeats the now-stale conclusion in 65.6% to 87.0% of conflicts. Ask again in a separate call with the new evidence last and it follows that evidence 29.9 to 60.6 points more often — for the same accuracy when the two agree. A trace being useful and a trace being obeyed are different properties, and your eval almost certainly measures only the first.

01 · The problem

Two sources, one answer, and nobody declared a winner

which model answered

02 · The mechanism

Three knobs you never thought of as knobs

what you ask it to do

03 · The evidence

Same help, wildly different obedience

04 · Why I care

Fix the trace, not the answer step

what you do about a trace written from bad evidence

05 · Apply it

One seam in your own pipeline illustrative

how the answer step is wired

Results

What the paper actually measured

What it does not show

In practice