Deriving Selection Techniques for GUIs based on the Multiple Process Model

Research Background and Issues

• Issues and Challenges: Target selection in graphical user interfaces (GUIs) is a critical task in human-computer interaction (HCI) research. However, existing techniques still face limitations in improving selection efficiency and user experience. The authors discovered that the Multiple Process Model offers a better explanation of the control mechanisms in the target selection process, but there are challenges in directly translating this theory into design solutions.
• Significance: Target selection is a common operational task in desktop computing, mobile devices, and mixed reality systems, and its efficiency directly impacts user experience and productivity. Designing more efficient selection techniques not only enhances device applications but also provides solutions for complex target selection scenarios.
• Research Motivation and Related Work: Based on theories of goal-directed movement (e.g., Fitts' Law and the optimized sub-movement model), the authors aim to integrate control processes from the Multiple Process Model (such as pre-planning, impulse control, and limb target control) to improve GUIs selection techniques. Related studies have explored enhancing selection performance by adjusting cursor position, target size, and dynamically controlling display ratios, but they lack theory-driven design methodologies.

Solution

• Methods and Solutions:
  1. Derive three hypotheses from the Multiple Process Model: how pre-planning, impulse control, and limb target control influence GUIs target selection.
  2. Propose and develop three new selection techniques: Cloaking (cursor hiding), Pulsing (cursor initial position jumping), and Unfurling (dynamic unfolding of clustered targets).
• Innovations:
  • Cloaking simplifies user strategies during target selection.
  • Pulsing leverages impulse control mechanisms to optimize initial movement, designed to reduce transition distances.
  • Unfurling shifts the unfolding of clustered targets to occur dynamically during movement, reducing user operation steps through contextual changes.
• Implementation Steps and Key Technologies:
  1. Develop specific design techniques based on theoretical hypotheses.
  2. Use an online pre-registration system to clarify research hypotheses and methods, ensuring reproducibility and transparency.
  3. Validate the techniques through three crowdsourced pointing task experiments in a Fitts’ Ring-based testing environment.

Research Outcomes

• Specific Results:
  1. Cloaking: Hiding the cursor while displaying selection feedback significantly reduces selection response time and task completion time, particularly when feedback is displayed in advance.
  2. Pulsing: Initial cursor jumps (short distances) reduce cursor movement distance while maintaining seamless selection processes, but longer jumps result in additional explicit corrections.
  3. Unfurling: Dynamically unfolding clustered targets during selection significantly reduces selection time and cursor movement distance while optimizing user performance.
• Advantages: Compared to traditional methods, these techniques achieve improved selection efficiency through theoretical support, such as reducing multi-step selection time, automatically correcting initial cursor deviations, and utilizing dynamic target unfolding to enhance accuracy.
• Experiment and Evaluation Results:
  • Cloaking: Performs best when selection feedback appears in advance but has limited effectiveness when feedback is displayed within the target.
  • Pulsing: A 25% distance jump seamlessly improves performance, while jumps of 50% or more incur time costs for explicit corrections.
  • Unfurling: Both variants—unfolding targets at the start phase or peak phase—significantly outperform traditional progressive refinement techniques.
• Limitations and Future Directions:
  • Limitations: Cloaking requires adaptation to more complex task scenarios to address potential conflicts between cursor and visual feedback. Pulsing does not significantly shorten task time, and Unfurling may introduce additional interference in complex interfaces.
  • Future Directions: Further research on the application of these techniques in mixed reality systems, constrained screens, and target-dense scenarios, as well as designing target unfolding methods better suited for text and complex menus.

Conclusion and Insights

The three studies demonstrate how integrating the Multiple Process Model with GUIs design techniques can enhance user interaction efficiency. The "Justified Concepts" approach proposed in this paper facilitates the translation of theory into design instances and deepens understanding of boundary conditions and applicable scenarios through pre-registration and experimental validation. This approach can be extended to other forms of HCI design research, providing a reference framework for bridging theory and practice.