SOURCE-LINKED INTELLIGENCE

Augmented Hypothesis Testing with Persona-Based LLM Simulations

arXiv · AI, language, vision and robotics · article · Sep 21, 2026 · UTC

A/B testing requires large sample sizes, long timelines, and significant costs. When auxiliary predictions of experimental outcomes are available from machine learning models, uncertain prediction quality precludes replacing human experiments entirely, yet these predictions may still contain useful signal. We propose a principled framework for learning-augmented hypothesis testing that leverages predictions of unknown quality to reduce sample sizes while maintaining statistical validity. Predictions naturally vary in granularity, from coarse aggregate signals to fine-grained individual-level e

Read original source ↗ Open in workspace

recordType

paper

region

Global