Cyberoception: Finding A Painlessly-Measurable New Sense In The Cyberworld Towards Emotion-awareness In Computing

Research Background and Problem

• What problems or challenges did the authors identify?

  1. In the field of Affective Computing, accurately recognizing user emotions is fundamental to human-computer interaction, but current mainstream emotion recognition methods often rely on measuring user interoception.
  2. Interoception measurement methods (e.g., heartbeat detection tasks) require sophisticated physiological sensors and controlled laboratory environments, which are difficult to implement in everyday applications.
  3. Interoceptive ability is related to individual emotional capacity, but existing methods face significant limitations, making them unsuitable for dynamic and noisy real-world environments.

• Why is this problem important?

  1. Emotion perception technology can significantly enhance human-computer interaction experiences and support areas such as mental health assessment and personalized services.
  2. Developing convenient, non-invasive, and sustainable emotion assessment methods is a critical research direction in the field of Affective Computing.
  3. Providing a low-cost, smart device-based alternative solution could enable large-scale application of emotion perception technologies.

• Research Motivation and Related Work

  1. Existing interoception measurement methods (e.g., heartbeat counting tasks) rely on expensive equipment and are unsuitable for daily use.
  2. The authors noted the widespread use of smartphones in daily life and proposed exploring a smartphone-based measurement method.
  3. Drawing on previous research on the relationship between interoception and emotional capacity, the authors introduced the new concept of "Cyberoception."

Solution

• What methods or solutions did the authors propose?

  1. Introduced the novel concept of "Cyberoception," which refers to the subjective perception of user interaction behaviors with smart devices (e.g., smartphones).
  2. Proposed using smartphone-embedded sensors and related data (e.g., screen-on frequency, unlock frequency) as a substitute for complex physiological sensors to detect emotion-related correlations similar to interoception.
  3. Designed experiments to validate whether Cyberoception exhibits emotion-related characteristics similar to interoception and whether it can serve as a substitute.

• What are the innovative aspects of this solution?

  1. Redefined emotion perception measurement by using everyday smart device interaction behaviors instead of traditional physiological measurements.
  2. Integrated a comparative study of Cyberoception and interoception, exploring their similarities and their relationship with emotional capacity for the first time.
  3. Provided a feasible, non-invasive emotion perception measurement framework that balances practicality and continuity for real-world applications.

• What are the implementation steps and key technologies used?

  1. Proposed six Cyberoception indicators:
     • Turning On
     • Unlocking
     • Screen Use Duration
     • Micro-usage
     • Most-used App frequency
     • Typo frequency
  2. Experimental Design:
     • A 10-day hybrid experiment (including both laboratory and daily environments).
     • Collected subjective perception data and smartphone sensor data using the Experience Sampling Method (ESM).
     • Conducted interoception experiments (heartbeat counting tasks), emotional image rating experiments, and typing experiments in the lab.
  3. Data Collection Platform: Developed an Android application to continuously collect users' real usage data (e.g., unlock frequency) and subjective perception data (e.g., self-perceived usage frequency).

Research Findings

• What specific findings were achieved?

  1. Emotion Correlation: Found that the "Turning On" indicator was significantly correlated with emotional valence, suggesting that individuals sensitive to their smartphone behaviors tend to experience more negative emotions.
  2. Correlation Validation: Demonstrated for the first time that Cyberoception is related to emotional experiences.
  3. Partial Substitutability for Interoception: While some indicators (e.g., Turning On, Micro-usage) showed certain correlations with interoception, they could not fully replace physiological sensor-based interoception measurements.

• What advantages does it have compared to existing solutions?

  1. Non-invasiveness: Cyberoception is based on smart device sensor data rather than physiological measurements, eliminating the need for complex equipment and making it suitable for real-time monitoring in daily life.
  2. Ease of Use: Does not require specialized laboratory environments, reducing experimental complexity and expanding the range of applicable populations.
  3. Innovative Application Scenarios: As a foundational module for emotion perception, Cyberoception can support a wide range of applications, such as mental health interventions and personalized services.

• What were the experimental or evaluation results?

  1. The Cyberoceptive Error of the "Turning On" indicator showed a significant positive correlation with emotional valence (p = 0.05) but no significant correlation with emotional arousal.
  2. There were certain positive correlations among different Cyberoception indicators, although statistical significance was relatively weak.
  3. In some scenarios, the generalizability of Cyberoception was limited, and it could not fully replace physiological sensor-based interoception measurements.

• Limitations and Future Directions

  1. Sample Limitations: Participants were primarily university students with a narrow age range, and the results may not generalize to other age groups.
  2. Limited Emotional Stimuli: Due to ethical constraints, only low-arousal image stimuli were used; future studies should include a broader range of stimuli.
  3. Long-term Application Validation: The study only analyzed short-term experiments and immediate emotions; future research should explore the potential of Cyberoception in long-term emotion monitoring.
  4. Potential Negative Psychological Effects: Requiring frequent self-perception from users over the long term may have negative psychological effects, necessitating further research into application strategies and risks.

Conclusion

This study introduced the novel concept of "Cyberoception" for the first time, demonstrating its potential correlation with user emotional experiences and providing a new low-cost, non-invasive solution for emotion perception. The research opens new directions for emotion perception studies using smart devices while presenting challenges and opportunities for future research.