SOURCE-LINKED INTELLIGENCE

When Youth Enter The Chat: An Epistemic Shift in the Validation of LLM-Based Measures of Student Talk

arXiv · AI, language, vision and robotics · article · Aug 24, 2026 · UTC

LLMs are being used increasingly to measure aspects of student discourse (e.g. talk moves, collaboration, equity of voice) at scale. Typically, LLM-based measures of student talk use transcriptions of classroom conversations that only include verbal contributions, which de-contextualize student language. Common practices for validating these measures include comparing outputs against expert annotations by adults, using held out evaluation sets and F1 scores. We argue that these approaches are insufficient to ensure that such measures are meaningful and equitable for teaching and learning, part

Read original source ↗ Open in workspace

recordType

paper

region

Global