Non-Natural Interaction Design

Research Background and Issues

• Identified Problems and Challenges:

  • Although natural interaction (NI) and natural user interfaces (NUI) based on intuition and user behavior have been widely adopted, this paradigm faces numerous criticisms. For example, beginners struggle to learn complex gestures, cultural differences exist, and there are challenges in mapping between physical and digital environments.
  • The "naturalness" of current natural interaction is sometimes overly simplified, failing to capture the rich operational possibilities of users. Many effective non-natural interactions remain unexplored systematically in interaction design.

• Significance:

  • Natural interaction is not always suitable for all contexts. For instance, users with disabilities (e.g., those with mobility or sensory impairments) may require alternative, more flexible interaction methods.
  • The introduction of non-natural interaction (NNI) design can address the shortcomings of natural interaction, offering a user experience distinct from traditional natural expectations and setting new standards for future interactions.

• Research Motivation:

  • The authors propose expanding the boundaries of human-computer interaction by exploring the design of non-natural interaction (NNI), deliberately deviating from natural intuition and the causal laws of the physical world to provide highly usable yet thought-provoking interaction experiences.
  • Given the limitations of existing paradigms and user performance, designing interactions that transcend the constraints of the physical world holds significant value.

Solutions

• Proposed Approach:

  • The authors introduce "non-natural interaction design" (NNI) as an evolution and complement to natural interaction (NI), defining the relationship between natural and non-natural interaction through four perspectives: horizontal subversion, mutual affinity, mutual extensibility, and binary synergy.
  • They design three innovative gesture interaction prototypes, implemented in physical environments, on users' bodies, and through digital devices, and systematically evaluate the effectiveness of these prototypes.

• Innovations:

  • Departing from the traditional assumptions of "intuition" and "physical naturalness" in natural interaction design, the authors propose entirely different user experience pathways.
  • They systematically define three core design dimensions—Inconsistency, Inconstancy, and Inaction—to guide the design of non-natural interactions.
  • The approach transforms users' memory, imagination, and other perceptual skills into the foundation of interaction, rather than relying on immediate system feedback.

• Implementation Steps and Techniques:

  1. Horizontal Subversion: Subverting the traditional consistency between physical actions and feedback, such as designing how users access digital content in the absence of direct feedback.
  2. Mutual Extensibility: Systematically designing connections between natural and non-natural interactions, with experiments including abstract gestures on the body or spatially feedback-free digital interactions.
  3. Bidirectional Evaluation and Norms: Developing a range of gesture-based user prototypes, from right-arm vibration feedback to accessing unanchored digital files in space.

Research Findings

• Specific Outcomes:

  • The study proposed detailed guidelines for non-natural interaction design, including how to deviate from traditional system outputs, user inputs, and the intuitive causal relationships between inputs and outputs.
  • It demonstrated the practical usability of three prototype applications, showing that users could adapt to environments lacking feedback, spatially locate non-physical objects, and interact with touchscreens decoupled from feedback.

• Advantages Over Existing Solutions:

  • Compared to traditional natural interaction, NNI not only activates users' existing memory and spatial imagination but also enriches the experiential layers of user interaction through inconsistent designs (e.g., decoupled vibration feedback or invisible information).
  • By employing counterintuitive methods, the approach encourages users to engage deeply on behavioral, perceptual, and reflective levels, providing greater design freedom and extensibility for applications.

• Experimental and Evaluation Results:

  • Experimental results showed that users' memory deviation in feedback-free environments averaged only about 15 cm, and this non-natural design did not significantly reduce user efficiency or satisfaction.
  • The gesture recognition solution demonstrated a high accuracy rate of +99% with minimal training data requirements.
  • User evaluations of touch feedback exceeded those of the control group (without feedback), indicating that the design successfully optimized the user experience.

• Limitations and Future Directions:

  • Current non-natural interaction designs are primarily limited to prototype validation, with insufficient coverage of real-world application scenarios.
  • The proposed design principles need further integration into broader commercial products, particularly in accessible design (e.g., for visually impaired or mobility-restricted users) or enhanced human-computer collaboration.
  • Future research is encouraged to explore long-term user adaptation, including the process of transitioning "from unfamiliarity to habit," and to evaluate the learning curve and lasting impact of non-natural interaction designs.

By introducing the concept of non-natural interaction, this study redefines the notion of naturalness and its philosophical boundaries, opening up new perspectives in the field of user experience.