ClassInSight: Designing Conversation Support Tools to Visualize Classroom Discussion for Personalized Teacher Professional Development

Document Title

ClassInSight: Designing Conversation Support Tools to Visualize Classroom Discussion for Personalized Teacher Professional Development

Document Information

• Domain: Educational Technology and Human-Computer Interaction
• Keywords: Teacher Professional Development, Classroom Discussion, Data Visualization, Reflection Tools, Conversation Support, Educational Technology

Research Background and Problem

• Identified Problems or Challenges:

  1. Feedback for teacher professional development often lacks personalization and continuity.
  2. Traditional classroom observation and video feedback are labor-intensive and difficult to scale.
  3. There remain unresolved issues in the design and practical application of technology-supported tools for classroom discussion.

• Research Significance: Enhancing the quality of classroom discussions can improve students' learning experiences, foster critical thinking, and support knowledge construction. Developing visualization tools to empower teachers in reflecting on and improving their teaching practices contributes to innovation and practical advancements in educational technology.

• Research Motivation and Related Work: The study builds on successful cases of data-driven teaching reflection tools (e.g., M-Powering Teachers or TeachFX) and emphasizes the critical role of classroom discussions in student learning. Previous research has rarely addressed the application gap between data visualization and practical teaching reflection.

Solution

• Proposed Methods and Solutions: Developed a reflection tool named ClassInSight, which visualizes classroom discussions to help teachers better understand and improve their teaching practices.

• Innovations:

  1. Provides three levels of classroom discussion data visualization (e.g., Talk Ratio, Turn-Taking, and text transcription).
  2. Utilizes a structured reflection framework to guide teachers through the reflection process.
  3. Links tool design with the transformation of teachers' professional vision during practical use.

• Implementation Steps and Key Technologies:

  1. Investigated classroom discussion recordings using pressure zone microphones and techniques for capturing online course audio.
  2. Applied conversation coding to refine data, categorizing classroom discourse into types such as "building ideas," "connecting," and "evaluating."
  3. Built an interactive visualization interface using React.js for the web application.
  4. Conducted iterative tool development and optimization through design-based research (DBR) in close collaboration with campus teachers.

Research Outcomes

• Specific Results:

  1. The ClassInSight tool effectively facilitated teacher reflection on classroom discussions and enhanced collaboration during experiments.
  2. Teachers experienced a shift from quantitative data analysis to qualitative thinking, gradually developing deeper professional perspectives.
  3. The study demonstrated how tool design can promote professional learning through data visualization.

• Comparison with Existing Solutions: Compared to generic workshop-based professional development, ClassInSight offers more personalized and continuous reflection support.

• Experimental or Evaluation Results:

  1. Over a 3-year longitudinal design study, 22 reflection sessions were conducted with 5 school teachers.
  2. Teachers showed improved awareness of various dynamics in classroom discourse, transitioning from early quantitative goals (e.g., percentage of student talk) to deeper analysis of discussion content.

• Limitations and Future Directions:

  1. Limitations:
     • Small sample size (only 5 participants).
     • Uneven data collection time spans, particularly impacted by the COVID-19 pandemic.
     • Manual coding of language data is time-consuming and limits scalability for automation.
  2. Future Directions:
     • Introduce AI modeling to advance automated conversation analysis.
     • Extend research to broader professional contexts (e.g., psychotherapy, doctor-patient conversation analysis).
     • Explore privacy and data-sharing applications and ethical considerations in educational technology.