World Mouse: exploring interactions with a cross-reality cursor

Micro and Nano Systems Letters · Springer Nature · 2026-11-13 · DOI: 10.1007/s12652-026-05137-9

Аннотация

As Extended Reality (XR) systems increasingly map and understand the physical world, interacting with these blended representations remains challenging. The current push for “natural” inputs has its trade-offs: touch is limited by human reach and fatigue, while gaze often lacks the precision for fine interaction. To bridge this gap, we introduce World Mouse , a cross-reality cursor framework designed for seated XR spatial productivity. World Mouse reinterprets the familiar 2D desktop mouse for complex, blended 3D environments by coupling surface-normal alignment with dynamic empty-space depth interpolation across both virtual content and semantically segmented physical environments. Furthermore, we contextualize and expand upon data gathered from our prior studies to evaluate targeting performance, kinematic efficiency, and postural ergonomics within these continuous physical-virtual scenes. Through a series of prototypes —spanning precise object manipulation, IoT control, and screen-to-world transitions— we demonstrate how cross-reality cursors provide a low-fatigue, high-precision alternative for seamless interaction across fully blended realities.

Читать у издателя →

Похожие статьи