A robot teacher "is very good for learning, but not for human relationships": Japanese Children’s Critical Perspectives Towards Ethical AI Futures

Voice User Interface (VUI) DesignAI Ethics, Fairness & AccountabilityParticipatory DesignK-12 TeachersEarly Childhood Educators

Research Background and Issues

  • Identified Problems or Challenges: The authors point out that an increasing number of young children interact with artificial intelligence (AI) in their daily lives, yet they often lack an understanding of the ethical issues or potential design implications of these technologies. This has led to AI education for children focusing primarily on technical skills while neglecting the development of critical perspectives.
  • Importance of the Issue: As AI becomes pervasive across various sectors of society, it is crucial for younger generations to understand the ethical implications of these technologies. This understanding will help them critically evaluate AI in their daily lives and prepare them for an increasingly complex technological future.
  • Research Motivation and Related Work: Children tend to anthropomorphize AI and attribute magical qualities to it, misconceptions that need to be corrected. Current research shows that most AI education interventions aim to develop technical knowledge, but there is a growing call for fostering critical thinking in children, particularly regarding the social and ethical impacts of AI.

Proposed Solution

  • Proposed Method or Solution:
    • The authors designed a four-day "Critical AI Education Workshop" to educate 96 Japanese elementary school students (aged 11-12) by having them imagine and design future technologies.
    • They employed a "design futures" approach, encouraging students to envision technologies for future schools while engaging in ethical reflection throughout the process.
  • Innovative Aspects:
    • Combining design futures with critical AI education to achieve dual goals of technical learning and ethical reflection by having children design their own future schools and technologies.
    • Focusing on children's everyday problems and their technological needs, demonstrating how technology design can address current issues.
    • Emphasizing ethical considerations in children's design processes, including fairness, inclusivity, responsibility, and sustainability.
  • Implementation Steps:
    1. Introduction Phase: Explain basic AI concepts and their applications in daily life.
    2. Design Phase: Groups brainstorm future teachers, school facilities, or other technological entities.
    3. Creation Phase: Use low-fidelity prototyping materials to create representations of their designs and document their functions and limitations.
    4. Reflection and Discussion: Groups present their designs, focusing on ethical issues such as fairness, sustainability, and responsibility in AI design.

Research Outcomes

  • Specific Outcomes:
    • Students designed various future technological entities (e.g., robot teachers, automated stationery, intelligent learning desks) aimed at solving practical problems, such as heavy school bags, limited playground space, and the need for personalized learning.
    • Children shifted from initially anthropomorphizing and attributing magical qualities to AI to a more critical understanding of its potential flaws, such as errors and social and ethical impacts.
    • Regarding ethical issues, the designs reflected children's concerns about fairness and inclusivity, such as making technology more affordable or supporting its use in impoverished countries through public funding.
  • Advantages Compared to Existing Solutions:
    • This approach not only teaches technical knowledge but also provides opportunities for children to deeply explore ethical and social implications.
    • The use of design futures enables students to connect current technological challenges with future solutions, encouraging long-term thinking.
  • Experimental or Evaluation Results:
    • Children demonstrated a deeper understanding of AI operations and ethical issues. For example, they were able to critically discuss AI's role in society and propose insights on fairness and responsibility allocation.
    • Some students reflected on potential dangers of AI, such as societal problems arising from over-reliance, showcasing their critical attitudes.
  • Limitations and Future Directions:
    • A limitation of the workshop was its short duration, which allowed only surface-level exploration of ethical issues rather than in-depth coverage.
    • Future research could expand to more diverse cultural contexts to study children's perceptions of AI in other regions.
    • Long-term support for children's AI education is necessary, providing platforms for continuous development and addressing rapidly evolving AI technologies (e.g., generative AI).

Conclusion

This study demonstrates the potential of critical AI education by engaging children in design and ethical reflection, fostering their critical understanding of AI technologies. The research highlights the role of children as future technology designers and societal contributors while emphasizing the need to further explore global children's perspectives on AI. This approach promotes societal recognition of children's participation in technology design and helps build an inclusive and sustainable technological future.

Quick Actions

Share

Share this page

ios_share

https://hci.top/en/papers/chi/189429/2025

AdRecommended

Learn AI Coding at CodeNow

open_in_newOpen DOI Link
DOI: https://dl.acm.org/doi/10.1145/3706598.3713204
At a Glance

Paper Snapshot

fact_check
dataset
Source
CHI
calendar_month
Year
2025
emoji_events
Award
No award tagged
group
Authors
3 authors
sell
Subtopics
Voice User Interface (VUI) Design, AI Ethics, Fairness & Accountability, Participatory Design
work
Professions
K-12 Teachers, Early Childhood Educators
article
Content Status
Full text indexed
hub
Related Papers
0 related papers