Providing Adaptive Feedback in Concept Mapping to Improve Reading Comprehension

Document Title

Providing Adaptive Feedback in Concept Mapping to Improve Reading Comprehension

Document Information

• Subject Area: Educational Technology and Learning Strategies
• Keywords: Concept Mapping, Intelligent Learning Environments, Comparative Strategies, Reading Comprehension, Feedback Mechanisms, Adaptive Assessment, Human-Computer Interaction, Metacognition

Research Background and Issues

• Problems and Challenges

  • Concept mapping is a widely used learning activity in the educational domain, offering benefits for enhancing learning outcomes. However, its high cognitive demands may overwhelm students who lack adequate support.
  • Existing feedback mechanisms primarily focus on the final concept map outcomes, lacking real-time support and monitoring during the concept mapping process.
  • Previous studies indicate that comparative strategies (e.g., cross-paragraph information comparison and connection building) are critical for learning outcomes. However, providing process feedback alone may not sufficiently promote the development of comparative strategies.

• Significance

  • Comparative strategies help students establish relationships between concepts, construct their knowledge structures, and deeply understand learning content.
  • Effectively inspiring students to adopt and internalize comparative strategies in learning is a key issue for improving learning outcomes.

• Research Motivation and Related Work

  • The effectiveness of feedback mechanisms has been confirmed in educational research, but new methods combining content feedback and process feedback are needed to comprehensively support students' metacognitive activities.
  • Further exploration is required to determine whether the combination of process feedback and content feedback can enhance students' use of comparative strategies in concept mapping and improve long-term transfer effects.

Solution

• Proposed Method

  • Developed an interactive concept mapping learning system named MindDot, which combines content feedback with adaptive process feedback to stimulate students' use of comparative strategies.
  • The system provides real-time feedback during learning tasks, including diagnostics of learning behaviors (process feedback) and specific suggestions based on content (content feedback).

• Innovations

  • Systematically integrates content-based feedback with process feedback during the concept mapping process for the first time.
  • Provides real-time feedback support rather than post-task summary feedback, enabling immediate correction of students' learning behaviors.
  • Triggers corresponding feedback based on students' behavioral patterns (e.g., failure to establish cross-linkages between nodes), helping them rectify inefficient behaviors.

• Implementation Steps and Key Technologies

  1. System Design:
     • The system displays learning content and concept maps in a dual-window layout, allowing students to create nodes by directly long-pressing words in the text.
     • Provides students with incomplete expert templates as references and supports concept navigation through hyperlinks.
  2. Intelligent Model:
     • The system analyzes students' learning performance through 10 behavioral patterns (e.g., "failure to revisit content" or "creation of cross-page relationships") to diagnose the effectiveness of learning behaviors.
     • Dynamically compares students' concept maps with expert models to evaluate the completeness and accuracy of the concept maps.
  3. Feedback Mechanism:
     • Offers diagnostic feedback with specific content suggestions for ineffective behaviors (e.g., suggesting the addition of nodes or comparing content across adjacent pages).
     • Provides positive reinforcement feedback for effective behaviors.
  4. Experimental Design:
     • Recruited 46 university students to participate in a comparative study with three groups (combined feedback group, process feedback-only group, and no feedback group).

Research Outcomes

• Specific Results

  • Students in the combined feedback group (CF) demonstrated significantly better learning outcomes, particularly in complex problem-solving and free-response tasks, compared to the process feedback-only group (PF) and no feedback group (NF).
  • CF group students exhibited a higher frequency of comparative strategy use during concept map construction.

• Advantages Comparison

  • Compared to PF and NF, the CF group showed higher comparative strategy usage rates during both primary learning stages and transfer stages.
  • Content feedback helped students quickly identify key concepts and their relationships, reducing the cognitive burden of high-strategy activities to some extent.

• Experimental and Evaluation Results

  • During the main experimental phase, the CF group scored significantly higher than other groups on explanatory questions and free-response tasks (explanatory questions: p=0.03; free-response tasks: p=0.028).
  • In the transfer test phase, although the CF group scored higher in comparative strategies than PF, overall learning outcomes showed no significant differences.
  • Comparative strategy scores did not exhibit a significant correlation with actual learning scores, suggesting that strategy acquisition may have short-term effects.

• Limitations and Future Directions

  • Limitations:
    • The experimental setting was in a laboratory rather than a classroom environment, and time constraints may have influenced learning behaviors.
    • The absence of a content feedback-only group makes it difficult to isolate the independent effects of content feedback.
    • The small sample size may limit the statistical power of certain significant findings.
  • Future Directions:
    • Test the feedback mechanism in real classroom environments to further validate its long-term effects.
    • Explore ways to support the internalization and transfer of comparative strategies, such as integrating self-reflection or thought process recordings.
    • Increase research on feedback adaptability to optimize cognitive load and enhance learning outcomes.

This study provides innovative contributions to concept mapping and comparative strategy research, proposing a new design framework for adaptive feedback tools, which offers valuable insights for future educational research and technology development.