SOURCE-LINKED INTELLIGENCE

Real-Time Hand Gesture Recognition for OpenXR Using Transformer-Based Machine Learning

arXiv · AI, language, vision and robotics · article · Sep 21, 2026 · UTC

Hand gesture recognition is a key component in human-computer interaction (HCI), enabling intuitive interfaces for applications in gaming, virtual reality (VR), robotics, and more. This study integrates transformer-based machine-learning models for real-time hand gesture recognition, using hand-tracking data captured through the OpenXR standard in Unity. We leverage positional data of hand joints and wrist rotation angles to train a custom gesture recognition system. By utilizing the sequential modeling capabilities of transformers, the system captures temporal dependencies within short gestur

Read original source ↗ Open in workspace

recordType

paper

region

Global