SOURCE-LINKED INTELLIGENCE

When Guardrails Look Effective: Construct Validity Failures in LLM Agent Commerce Evaluation

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Interactive simulations increasingly evaluate policies in markets populated by language-model agents. Their outputs can look economic---prices, profits, consumer surplus, and welfare---without instantiating the behavior named in the claim. We audit this risk in a multi-turn buyer--seller testbed for configurable hotel transactions. An initial implementation reported welfare gains from two marketplace guardrails of +87.4, +35.0, and +28.8 across a Qwen2.5 1.5B--14B ladder. It also gave guarded and unguarded agents different offer schemas and choice procedures. Holding the schema and buyer choos

Read original source ↗ Open in workspace

recordType

paper

region

Global