SOURCE-LINKED INTELLIGENCE

In-Context Neurofeedback: Can LLMs Control Their Internal Representations through Privileged Access?

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Whether large language models (LLMs) can control their own internal representations matters for both machine metacognition and AI safety. A recent study applied neurofeedback to LLMs and claimed that they can control their internal representations. However, the reported control may rely on superficial mechanisms rather than genuine internal access because the control targets in that study are not privileged, meaning that a third party can infer them from the prompt. We redesign the neurofeedback paradigm for LLMs so that the control target satisfies the privileged access requirement, which is

Read original source ↗ Open in workspace

recordType

paper

region

Global