AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Stepwise-Querying: Distilling Reasoning without Access to Teacher Chain-of-Thought

arXiv · AI, language, vision and robotics · article · Oct 30, 2026 · UTC

Reasoning distillation is widely used to transfer the reasoning capabilities of large language models to smaller students through teacher-generated supervision. In the black-box setting, however, teachers may expose only final answers and brief solutions, leaving intermediate calculations and validity conditions unavailable and thus limiting the reasoning supervision available for distillation. We propose Stepwise Querying, which elicits step-specific explanations without requiring access to the teacher's internal chain-of-thought (CoT) traces. Independent queries to the same teacher request i

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-11-02T10:21:21.339Z. This is not the publication date.