← Back to the demo
Loadbearing · checkpoint once, fork per mutation

haystack-answer-meta-2.7.0

2 inputs do not do what the pipeline claims. Found by running it, not by reading it.

15
forks from one checkpoint
10.99s
all 17 runs, in parallel (73.36s one after another)
6.7x
faster than running them in sequence
2
defects

One checkpoint, every fork

destroydropnudgerequest_idinertdestroydropnudgequeryload-bearingdestroydropnudgereplyload-bearingdestroydropnudgemeta.source_urlsilent passthroughdestroydropnudgemeta.policy_versionsilent passthroughcheckpoint

Every field, every mutation

fieldshould matter?destroydropnudgeverdict
request_idnosamesamesameinert
queryyesmovedmovedmovedload-bearing
replyyesmovedmovedmovedload-bearing
meta.source_urlyessamesamesameSILENT PASSTHROUGH
meta.policy_versionyessamesamesameSILENT PASSTHROUGH

The evidence

meta.source_url · silent passthrough

Declared as an input that should change the output. It was destroyed, dropped and nudged in 3 separate forks, and the output never moved. The pipeline does not read it.

baseline output
answers: [{"data": "No, the 14-day return window has passed, but the warranty covers a repair.", "meta": {"model": "nemotron"}, "query": "Can I still return headphones …
after destroy (identical)
answers: [{"data": "No, the 14-day return window has passed, but the warranty covers a repair.", "meta": {"model": "nemotron"}, "query": "Can I still return headphones …

meta.policy_version · silent passthrough

Declared as an input that should change the output. It was destroyed, dropped and nudged in 3 separate forks, and the output never moved. The pipeline does not read it.

baseline output
answers: [{"data": "No, the 14-day return window has passed, but the warranty covers a repair.", "meta": {"model": "nemotron"}, "query": "Can I still return headphones …
after destroy (identical)
answers: [{"data": "No, the 14-day return window has passed, but the warranty covers a repair.", "meta": {"model": "nemotron"}, "query": "Can I still return headphones …

Baseline

input
request_id: req_8Kx2pd
query: Can I still return headphones after 20 days?
reply: No, the 14-day return window has passed, but the warranty covers a repair.
meta: {"source_url": "https://shop.example/help/returns-policy", "policy_version": "2026-09"}
output
answers: [{"data": "No, the 14-day return window has passed, but the warranty covers a repair.", "meta": {"model": "nemotron"}, "query": "Can I still return headphones …