Joie: a Joy-based BCI

Brain-Computer Interface (BCI) & NeurofeedbackGame UX & Player BehaviorMental Health Apps & Online Support CommunitiesPsychiatrists & PsychotherapistsPhysical Therapists & Rehabilitation SpecialistsEsports Athletes

Title of the Paper

Joie: a Joy-based Brain-Computer Interface (BCI)

Paper Information

  • Subject Area: Affective Computing, Brain-Computer Interface (BCI), Emotion Regulation Technology
  • Keywords: Brain-Computer Interface (BCI), Emotion Regulation, Neurofeedback, Biofeedback, Wearable Devices, Anxiety, Mental Health

Research Background and Problem Statement

  • Identified Problems or Challenges:

    1. While brain-computer interfaces have been extensively studied in areas such as cognitive enhancement, personalized learning, and gaming, emotion regulation and control have not received sufficient attention.
    2. Using neural interfaces for emotion regulation poses several challenges, such as difficulties in non-invasively recording emotional information from deep brain structures, issues with data accuracy, and the lack of clear emotion interaction models.
  • Research Significance:

    • Approximately 32.3% of adults in the United States are affected by anxiety and depression. Addressing these mental health issues holds significant societal importance.
    • Brain-computer interface technology can provide individual-level solutions, but its application in the field of emotion regulation remains limited.
  • Research Motivation and Related Work:

    • The authors drew inspiration from previous studies on prefrontal asymmetry activation and the "approach-avoidance motivation model."
    • Based on prefrontal activity, an emotional neurofeedback system can be developed, and this model could be further applied to mental health interventions.
    • This study combines brain-computer interfaces and emotion regulation, aiming to develop an interactive system based on "joy and excitement" as emotional input.

Proposed Solution

  • Proposed Method and Solution:

    • Developed an emotion regulation game system based on a brain-computer interface called "Joie." The game integrates EEG (electroencephalography) technology, operating by measuring left frontal asymmetry activity induced by positive emotions (joy and excitement).
    • The game uses an "endless runner game" design, where players control the game character to collect coins or avoid obstacles through their EEG activity.
  • Innovations:

    • Utilized EEG to extract left frontal asymmetry activity as input for emotion regulation, differing from previous studies using fNIRS data recording. This provides a lower-cost and more wearable implementation for brain-computer interface technology.
    • Offered an instantiated training method combining positive emotion strategies like joy and excitement, enabling users to learn emotion regulation strategies through the system.
  • Implementation Steps and Key Technologies:

    1. EEG Signal Collection and Processing: Used the Neuroelectrics Enobio 32 EEG device to collect brainwave data and perform signal preprocessing, including detrending, filtering, and spectral power density calculation.
    2. Game Design Based on "Operant Conditioning" Theory: When the user's relative left frontal asymmetry activity reaches a certain threshold (e.g., +/-0.85 standard deviation), they are encouraged to perform game tasks.
    3. User Interaction and Feedback Design: Developed the game interface using Unity, with each round providing positive feedback, negative feedback, and neutral states to enhance user experience.
    4. Experimental Design: The study included experimental, placebo, and control groups. The experimental group was instructed to imagine positive emotional content to verify the emotion regulation capability of neurofeedback.

Research Outcomes

  • Specific Findings:

    • The experimental group demonstrated a significant increase in left frontal asymmetry activation after multiple training sessions, with notable differences compared to the control and placebo groups.
    • The increase in left frontal activation extended beyond the game training period into the "resting phase," indicating the potential effects of neurofeedback.
    • Users in the experimental group who received guidance on "joy and excitement" emotional strategies were more likely to transfer these strategies to real-life scenarios.
  • Advantages Compared to Existing Solutions:

    • Utilized EEG devices instead of the higher-cost fNIRS for brainwave data recording, reducing cost barriers and increasing wearability.
    • The gamified design ensured participant engagement and active participation, which is rare in neurofeedback systems.
    • Combined left frontal asymmetry emotion neurofeedback with positive emotion strategies for the first time, and validated its effects through a randomized single-blind trial.
  • Experimental or Evaluation Results:

    • Through analysis of game scores, EEG data changes, and user interviews, the authors validated that "positive emotion strategies" effectively enhanced left frontal brain activity.
    • Some users reported applying the learned strategies to regulate emotions outside the game.
  • Limitations and Future Directions:

    • The training period was short, with the experiment conducted over a 5-day cycle, making it difficult to assess long-term effects.
    • The sample size was small, with only 20 participants, necessitating larger-scale studies to ensure the reliability and external validity of the results.
    • Future research could integrate mental health indicators (e.g., anxiety and depression symptoms) for more in-depth efficacy studies, while exploring the feasibility of real-time operation in real-world environments, such as developing wearable real-time emotion regulation devices.

This study demonstrates the potential of combining brain-computer interfaces with emotional neurofeedback and provides an innovative intervention method for emotion regulation technologies.

Quick Actions

Share

Share this page

ios_share

https://hci.top/en/papers/uist/126687/2023

AdRecommended

Learn AI Coding at CodeNow

open_in_newOpen DOI Link
DOI: https://doi.org/10.1145/3586183.3606761
At a Glance

Paper Snapshot

fact_check
dataset
Source
UIST
calendar_month
Year
2023
emoji_events
Award
No award tagged
group
Authors
3 authors
sell
Subtopics
Brain-Computer Interface (BCI) & Neurofeedback, Game UX & Player Behavior, Mental Health Apps & Online Support Communities
work
Professions
Psychiatrists & Psychotherapists, Physical Therapists & Rehabilitation Specialists, Esports Athletes
article
Content Status
Full text indexed
hub
Related Papers
0 related papers