We Play and Learn Rhythmically: Gesture-based Rhythm Game for Children with Intellectual Developmental Disabilities to Learn Manual Sign

Title of the Paper

Learning and Playing with Rhythm: A Rhythm Game Approach to Gesture Language Learning for Children with Intellectual Developmental Disabilities

Bibliographic Information

• Subject Area: Special Education Technology, Sign Language Learning, Gamified Education
• Keywords: Children with Intellectual Developmental Disabilities, Gesture Language Learning, Gamification, Rhythm Games, Special Education, Human-Computer Interaction, Attention, Social Learning, Autonomous Learning, Children's Education

Research Background and Problems

• Identified Problems or Challenges:

  • Children with Intellectual Developmental Disabilities (IDD) often have short attention spans, low learning motivation, and require continuous intervention. Traditional gesture language teaching methods (e.g., Sondam) face limitations.
  • Learning gesture language through static images or videos is less effective for IDD children, and cultivating imitation skills is challenging.
  • Teachers face high workloads due to repetitive teaching, and students struggle to apply gesture language in everyday environments.

• Significance of the Research:

  • Gesture language is crucial for the communication and language development of IDD children. Improving teaching methods can help children better adapt to society and promote independent living.
  • There is limited methodological research on optimizing gesture language teaching, highlighting the need for innovation and empirical studies.

• Research Motivation and Related Work:

  • The shortcomings of traditional methods (e.g., books or videos) have driven the demand for interactive solutions.
  • Music has been proven to enhance children's engagement and memory, while gamification offers potential advantages in improving attention and motivation.
  • The research aims to design an interactive teaching tool that integrates music and gamification to enhance teaching effectiveness and reduce teacher workload.

Solution

• Proposed Solution or Method:

  • Developed a rhythm game called "Sondam Rhythm Game" to help IDD children learn Korean gesture language (Sondam) through music.
  • The game combines children's songs, animated characters, and instant visual feedback to enhance motivation, attention, and imitation skills.
  • The system includes customizable features (e.g., difficulty adjustment, game preview, speed control) and supports both school and home use.

• Innovative Features:

  • Utilizes music to guide gesture language learning, differentiating it from traditional video or classroom teaching.
  • Reduces reliance on teachers through instant interaction and feedback.
  • Introduces familiar animated characters and a mirror camera function to improve the learning experience and engagement.

• Implementation Steps and Key Technologies:

  1. Content Design: The game includes 10 children's songs related to daily life, with each song featuring 5-10 commonly used words.
  2. User Interface Design: Features animated character gesture demonstrations and real-time visual feedback (e.g., scores and encouraging language).
  3. Game Mechanics: Students imitate gestures displayed on the screen; the game scores their accuracy and adjusts feedback difficulty accordingly.
  4. Contextual Application: The game is compatible with tablets and laptops, enabling use by teachers and families in various environments.

Research Outcomes

• Specific Outcomes:

  • The rhythm game improved the learning motivation and attention of IDD children, reducing the frequency of teacher prompts.
  • The game significantly enhanced children's emotional expression and frequency of gesture imitation during learning.
  • The game demonstrated comparable learning memory and accuracy effects to video-based teaching methods.

• Advantages Over Existing Solutions:

  • Maintains students' interest and engagement better than traditional static video learning.
  • Reduces teachers' workload and the need for highly personalized repetitive interventions.
  • Better supports independent learning while helping children naturally apply learned gestures in daily life.

• Experimental or Evaluation Results:

  • Quantitative results show that compared to video-based teaching methods, the game has significant advantages in children's attention (p < 0.001), motivation (p < 0.05), and autonomous imitation (p < 0.001).
  • Qualitative feedback indicates that teachers and students generally acknowledge the game's guiding role, particularly in maintaining motivation and enhancing teaching interaction.

• Limitations and Future Directions:

  1. Sample Limitations: The study involved only 8 children with varying types of disabilities, requiring larger-scale experiments to validate the generalizability of the results.
  2. Character Optimization: Animated characters need to demonstrate gestures more precisely and improve user adaptation speed.
  3. Content Diversity: More diverse game content and interactive formats are needed to sustain long-term engagement.
  4. Long-Term Evaluation: Future studies should conduct longitudinal tracking to assess children's use of gesture language in everyday scenarios.

Conclusion

This paper demonstrates the potential of rhythm-based gamified teaching tools in gesture language learning for children. By integrating music, feedback, and interactive mechanisms, the Sondam Rhythm Game effectively stimulates learning interest in children with intellectual developmental disabilities, enhances learning experiences, and reduces teacher workload. It also provides valuable references for subsequent research and technological applications.