SOURCE-LINKED INTELLIGENCE

Evaluating the Capabilities of LLMs for Persuasive Dialogue

arXiv · AI, language, vision and robotics · article · Aug 30, 2026 · UTC

Large language models (LLMs) can generate apparently highly persuasive text, but does sounding persuasive mean arguing well? We introduce \textsc{Persuasio}, a multi-agent dialogue platform grounded in a formal argumentation-based theory of persuasion dialogues that adjudicates logical winners during free-text debates. Using this system, we generated 192 debates on a UK political topic between humans and LLMs, and evaluated 22 interlocutors through both automated adjudication and 9,702 crowdsourced pairwise judgements across 1{,}386 annotation instances. We observed a consistent decoupling bet

Read original source ↗ Open in workspace

recordType

paper

region

Global