Loadbearing · checkpoint once, fork per mutation
pydantic-ai-description-2.5.1
Every declared input does what the pipeline claims. Found by running it.
12
forks from one checkpoint
6.11s
all 14 runs, in parallel (43.32s one after another)
7.1x
faster than running them in sequence
0
defects
One checkpoint, every fork
Every field, every mutation
| field | should matter? | destroy | drop | nudge | verdict |
|---|---|---|---|---|---|
| user_id | no | same | same | same | inert |
| question | yes | moved | moved | moved | load-bearing |
| output_name | yes | moved | moved | moved | load-bearing |
| output_description | yes | moved | moved | moved | load-bearing |
Baseline
input
user_id: u_48213
question: What is a banana?
output_name: fruit_or_vehicle
output_description: Classify the thing the user asks about: a fruit with its colour, or a vehicle with its number of wheels.
output
model_was_told: {"output_description": "Classify the thing the user asks about: a fruit with its colour, or a vehicle with its number of wheels.", "output_name": "fruit_or_veh…