MathKingdom: Teaching Children Mathematical Language Through Speaking at Home via a Voice-Guided Game

Document Title

MathKingdom: Teaching Children Mathematical Language Through Speaking at Home via a Voice-Guided Game

Document Information

• Subject Area: Children's mathematical language education, home learning technology interaction
• Keywords: mathematical language, children, voice agent, gamified learning, home education, mathematical ability, interaction design, physical interaction, parental involvement, technology-driven learning

Research Background and Problem

What problems or challenges did the authors identify?

1. The frequency and quality of mathematical language usage in home environments are relatively low.
2. Preschool children often passively receive mathematical activities, lacking opportunities for conversational practice.
3. Mathematical language activities at home are monotonous, lacking diversity, guidance, and systematic approaches.
4. Children's attention and engagement in mathematical activities are low, necessitating a more engaging educational model.

Why is this problem important?

Mathematical ability is a crucial component of children's development, influencing academic performance (e.g., in STEM fields) and overall health and personal well-being. Differences in mathematical ability begin to emerge during the preschool years, and language skills (particularly mathematical language) have been proven to be key to the development of mathematical ability.

Research Motivation and Related Work

• Early mathematics education has focused on the effects of natural learning contexts, such as play activities. However, existing technologies primarily aim to enrich learning experiences or enhance specific mathematical skills, with few focusing on technological support for mathematical language.
• Voice agents have demonstrated potential in reducing participation barriers and facilitating smooth activities in early childhood education. However, no technology has been specifically designed for mathematical language learning in home environments.

Solution

What methods or solutions did the authors propose?

The authors developed a voice-agent-based interactive game called MathKingdom to guide children aged 4-7 in learning mathematical language through mathematical conversations. Key features include:

1. Gamified avatars for awakening, transforming, decorating, and free expression.
2. Opportunities to learn and practice rich mathematical language concepts (e.g., measurement, sequences, patterns).
3. Cartoon-style voice agents serving as guides and companions to support mathematical language communication.

What are the innovative aspects of this solution?

1. Adaptation to home environments: Specifically designed for scenarios where parents and children jointly participate in mathematical language learning.
2. Multimodal interaction: Combines voice and physical interaction. Children can control the game through language and influence game characters through actions, enhancing self-engagement.
3. Gamified learning: Integrates mathematical language learning into activities like dressing up and storytelling, increasing children's interest.
4. Parental support guidance: Provides specific recommendations for parents on effectively interacting with their children.

What are the implementation steps and key technologies used?

1. Game process design:
   • Stage 1: Awakening: Children identify geometric shapes and answer basic mathematical questions.
   • Stage 2: Transformation: Use single sentences of mathematical language to describe geometric features and change game character attributes.
   • Stage 3: Decoration: Use coherent sentences of mathematical language to describe decorative designs, including sequences and patterns.
   • Stage 4: Storytelling: Free expression, using mathematical language to describe personalized characters.
2. Voice agent design:
   • Provides cartoon-style voice guidance with questions, feedback, and examples of mathematical language.
   • Implements voice interaction using Tencent and Baidu's speech conversion technologies.
3. Technical support:
   • Developed on the Unity platform, integrating MMPose for real-time posture estimation.
   • UDP transmission of sub-body motion data for real-time mapping.
   • Voice synthesis and recognition supported by Tencent and Baidu cloud technologies.

Research Outcomes

What specific outcomes were achieved?

1. Increased child engagement: Children showed high interest and enthusiasm for the game, particularly in interactions with game characters.
2. Improved mathematical language skills: Post-experiment, children demonstrated significant improvements in the fluency and accuracy of mathematical language, with notable progress in the geometric domain.
3. Enhanced mathematical ability: Comparative analysis of pre- and post-experiment test results revealed significant improvements in numerical and geometric mathematical abilities.
4. Promoted parent-child interaction: Observations showed smooth mathematical language communication between parents and children during the game, with some parents improving their mathematical guidance skills.

What advantages does it have compared to existing solutions?

• Provides an innovative solution for home-based mathematical language education, combining gamification, voice interaction, and physical interaction.
• The game design allows children to become active participants, enhancing learning motivation and encouraging spontaneous dialogue.

What were the experimental or evaluation results?

• Over six days, three experiments validated the educational effectiveness of the system using pre- and post-tests on mathematical language and the standard mathematical assessment scale (REMA-SF).
• Engagement indicators, such as Smileyometer data (M=3.94), demonstrated the game's strong ability to capture children's attention.
• Scores for mathematical language and mathematical ability showed significant improvements.

Limitations and Future Directions

1. Insufficient game levels: The content may be too simple for repeated use, reducing appeal for high-level children.
2. Thin storytelling content: The free expression section has repetitive content and needs richer contexts.
3. Voice guidance optimization: Lengthy voice instructions may reduce children's patience, requiring adjustments to voice interaction design.
4. Long-term impact observation: Future research should explore the long-term effects of this learning technology on family mathematical interactions and language learning.

Improvement Suggestions:

• Add more complex game content to cater to high-ability children.
• Provide modular, optional content, such as customizable tasks and dialogue difficulty settings.
• Optimize voice flow by reducing redundancy and intelligently setting content based on children's actual abilities.