Empowering Adults with AI Literacy: Using Short Videos to Transform Understanding and Harness Fear for Critical Thinking

Research Background and Issues

• What problems or challenges did the authors identify?

  1. The rapid development of AI technology, especially generative AI, has made it increasingly important in both personal and professional contexts. However, most people lack a clear understanding of the basic principles, capabilities, and limitations of AI, indicating a deficiency in AI literacy.
  2. Current AI literacy education is primarily focused on formal education systems, such as curriculum modules designed for K-12 and university students. However, adults, a crucial demographic, are often overlooked as they are no longer part of formal education systems and may lack time or knowledge about AI due to their busy work schedules.
  3. Adults who lack AI literacy may harbor misunderstandings or fears about AI, such as concerns over privacy issues, bias, or job displacement, and may underestimate the potential positive impacts of AI.

• Why is this issue important?

  1. Adults are a key demographic facing the transformative impacts of AI technologies, as they frequently encounter AI in their workplaces. A lack of AI literacy may hinder their career development and acceptance of new technologies.
  2. A mature understanding of AI can help adults use these technologies more effectively, alleviate technology-related fears, and foster a rational acceptance of AI.

• Research Motivation and Related Work

  1. Enhancing AI literacy among adults requires effective educational interventions, but traditional course-based approaches are not well-suited to non-technical adult audiences.
  2. Short videos, with their wide reach and flexibility, are considered a potential solution that caters to the needs of adult learners.
  3. Previous research has rarely explored "reducing AI fear through educational interventions," and even fewer studies have attempted to educate adults through short videos while simultaneously boosting their confidence in evaluating and using AI.

Solution

• What methods or solutions did the authors propose? The authors designed an AI literacy educational intervention based on "short videos" to achieve the following goals:

  1. Disseminate foundational concepts and operational mechanisms of AI.
  2. Demonstrate how generative AI can be applied in everyday life and work scenarios.
  3. Help adults understand the positive and negative societal impacts of AI.

• What are the innovative aspects of this solution?

  1. Target Audience Focus: The intervention is tailored for a specific age group (30-49 years old, the core working demographic), addressing a gap in AI literacy research for adult populations.
  2. Methodological Flexibility: The short video format saves time and meets the fragmented learning needs of adults, combining information delivery with experiential teaching in practical scenarios.
  3. Integration of Emotion and Cognition: In addition to improving AI usage skills, the intervention also addresses participants' fear of AI, proposing a unique perspective that "fear" can serve as a starting point for developing critical thinking.

• What are the implementation steps? What key technologies were used?

  1. Design five short videos with clear themes (total duration approximately 14 minutes), including:
     • Introduction to basic AI concepts and mechanisms.
     • Applications of generative AI (e.g., ChatGPT) in various scenarios.
     • Advantages and risks of AI, including examples such as privacy breaches, bias, and job displacement.
     • Demonstrations of the benefits (e.g., workflow optimization) and drawbacks (e.g., hallucinations and bias) of generative AI.
  2. The video content was reviewed by experts to ensure accuracy and incorporated real-life scenarios and case studies to enhance the learning experience.
  3. Conduct a controlled experiment: 94 adults aged 30-49 were divided into a "historical video control group" (focused on the history of AI development) and an "AI literacy training group" (focused on modern AI educational short videos). The intervention was tested through an online experiment.

Research Findings

• What specific outcomes were achieved?

  1. Improved Self-Efficacy in AI Usage:
     • Participants' confidence in using AI significantly increased after watching the short videos.
  2. Stimulated Critical Thinking About AI:
     • Participants in the AI literacy training group exhibited significantly increased concerns about potential privacy violations, bias, and job displacement caused by AI. However, these levels of fear did not exceed the midpoint. The authors interpret this moderate fear as indicative of a certain level of critical thinking.
  3. Enhanced AI Knowledge:
     • Participants in the experimental group demonstrated significantly better AI knowledge in tests compared to the control group, indicating that the short videos effectively enhanced their knowledge base about AI.

• What advantages does it have compared to existing solutions?

  1. It is more suitable for time-constrained adults, offering a learning tool with greater immediacy and flexibility.
  2. In addition to strengthening knowledge, it also addresses emotional and psychological responses, aiming to use fear as a catalyst for deeper thinking and rational attitudes.

• What were the experimental or evaluation results?

  • Three Dimensions of AI Literacy:
    • Significant improvement in AI usage (treatment group mean 4.00, control group mean 3.87).
    • Near-significant improvement in AI evaluation ability (treatment group mean 3.95, control group mean 3.89).
    • No significant improvement in AI understanding (treatment group mean 4.02, control group mean 4.00).
  • AI Fear:
    • Significant increases in fears of AI-related privacy violations (F = 8.00, p = .006**), bias (F = 6.93, p = .01**), and job displacement (F = 4.93, p = .029*).

• Limitations and Future Directions

  1. Time Constraints: Short-term interventions may not fully explain complex AI concepts, especially regarding the technical principles of AI.
  2. Sample Bias: Participants may already have a higher interest in technology, which might not fully represent the impact on populations with lower AI knowledge.
  3. Need for Iterative Optimization: Future efforts should develop more focused video content tailored to specific tasks and contexts, such as exploring a single core concept in depth within a single video.
  4. Participant Feedback: Future experiments should collect feedback from participants on the intervention content itself to further improve material design.

Through this study, the authors preliminarily validated the feasibility of using short videos to enhance AI literacy among adults. They also highlighted that "moderate fear of AI" could contribute to the development of critical thinking, offering new perspectives and practical directions for future research.