SOURCE-LINKED INTELLIGENCE

Digital Twin-Driven VR Teleoperation with Multi-View Spatial Perception for Surgical Robots

arXiv · AI, language, vision and robotics · article · Sep 22, 2026 · UTC

Current robot-assisted minimally-invasive surgery (RMIS) platforms provide a fixed console for the surgeon to view stereo endoscopic images and teleoperate instruments inside the patient. Several researchers have proposed the use of a head-mounted display (HMD) as a portable console, with video pass-through rendering of the endoscope images which, like the fixed console, restricts the operator to a single endoscopic viewpoint and limits depth perception. We present a digital twin-driven virtual reality (VR) teleoperation platform, where the digital twin is created from markerless perception of

Read original source ↗ Open in workspace

recordType

paper

region

Global