RestfulRaycast: Exploring Ergonomic Rigging and Joint Amplification for Precise Hand Ray Selection in XR
Authors
Hand raycasting is widely used in extended reality (XR) for selection and interaction, but prolonged use can lead to arm fatigue (e.g., "gorilla arm"). Traditional techniques often require a large range of motion where the arm is extended and unsupported, exacerbating this issue. In this paper, we explore hand raycast techniques aimed at reducing arm fatigue, while minimizing impact to precision selection. In particular, we present Joint-Amplified Raycasting (JAR)---a technique which scales and combines the orientations of multiple joints in the arm to enable more ergonomic raycasting. Through a comparative evaluation with the commonly used industry standard---Shoulder-Palm Raycast (SP) and two other ergonomic alternatives---Offset Shoulder-Palm Raycast (OSP) and Wrist-Palm Raycast (WP)---we demonstrate that JAR results in higher selection throughput and reduced fatigue. A follow-up study highlights the effects of different JAR joint gains on target selection and shows users prefer JAR over SP in a representative UI task.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 75%
µGlyph: a Microgesture Notation
CHI '23· Hand Gesture Recognition
- 60%
Inpher: Inferring Physical Properties of Virtual Objects from Mid-Air Interaction
CHI '18· Full-Body Interaction & Embodied Input +1
- 60%
Pentelligence: Combining Pen Tip Motion and Writing Sounds for Handwritten Digit Recognition
CHI '18· Hand Gesture Recognition +1
- 60%
Designing, Engineering, and Evaluating Gesture User Interfaces
CHI '18· Hand Gesture Recognition +1
- 60%
Designing, Engineering, and Evaluating Gesture User Interfaces
CHI '18· Hand Gesture Recognition +1
- 60%
AtaTouch: Robust Finger Pinch Detection for a VR Controller Using RF Return Loss
CHI '21· Hand Gesture Recognition +1
- 60%
The Voight-Kampff Machine for Automatic Custom Gesture Rejection Threshold Selection
CHI '22· Hand Gesture Recognition +1
- 60%
Towards a Consensus Gesture Set: A Survey of Mid-Air Gestures in HCI for Maximized Agreement Across Domains
CHI '23· Hand Gesture Recognition +1
- 60%
Non-Natural Interaction Design
CHI '25· Hand Gesture Recognition +1
- 60%
Abacus Gestures: A Large Set of Math-Based Usable Finger-Counting Gestures for Mid-Air Interactions
UbiComp '23· Hand Gesture Recognition +1
Based on Jaccard similarity of research subtopics & professions (≥60%)