/p/2026-10-04 · explainer
Paper explainer · 2610.00084 · Kassis

The persona prompt bought nothing.

A profession profile is a system prompt that tells the model who it is, in detail — “you are an experienced bioinformatician”, then four thousand tokens of workflow, standards, tools and troubleshooting. Scored against four controls on nine science benchmarks, the full profile landed 0.6 percentage points below “You are a helpful assistant”, with no benchmark clearly improved, at 2.2 to 4.5 times the cost per answer. On the one task set with tools and a budget it was 10 points worse.

01 · The problem

Nine benchmarks, five prompts, no winner

highlight one benchmark
zero means the profile and the one-line prompt scored the same

Every benchmark, profile against baseline
02 · The cost

You pay for it on every turn

03 · Where it actually hurts

The agent ran out of budget, not out of expertise

04 · The one real gain

Length made the calls land, and expertise had nothing to do with it

highlight one prompt

05 · Why I care

What each prompt buys you, per answer illustrative

the system prompt you ship

Results

What the paper actually measured

What it does not show

In practice