SOURCE-LINKED INTELLIGENCE

Augmenting Human Performance with an XR Agent Learning from Online Behavior and BCI Evidence

arXiv · AI, language, vision and robotics · article · Aug 31, 2026 · UTC

We present OLIVE, a framework for adapting a foundation model to provide real-time assistance in temporally demanding, high-stakes, and dynamic tasks. We show that passive EEG, fused online with behavioral evidence, can meaningfully extend the number of targets users detect and engage beyond their unaided action bandwidth. OLIVE learns from both explicit behavioral signals (the targets the user shoots down in an XR first-person shooter game) and implicit physiological signals (fixation-locked EEG) to provide timely guidance, continuously adapting a frozen vision-language model's inference on w

Read original source ↗ Open in workspace

recordType

paper

region

Global