CoMap: A Collaborative 3D Sketch Mapping Game to Engage Spatial Communication in Search and Rescue

Paper Title

CoMap: A Collaborative 3D Sketch Mapping Game to Engage Spatial Communication in Search and Rescue

Publication Info

• Topic area: Human-computer interaction in disaster response and training
• Keywords: Search and rescue, spatial communication, 3D sketch mapping, virtual reality, disaster response, collaborative tools, situation awareness, training systems, multimodal interaction, map synchronization

Background and Problem

• Problem / challenge: Current SAR mapping practices rely heavily on 2D maps, which fail to adequately represent the dynamic and three-dimensional nature of disaster environments. Communication methods, such as voice reporting, are prone to errors and inefficiencies, limiting shared situational awareness and decision-making.
• Significance: Enhancing spatial communication and coordination in SAR can improve operational efficiency, reduce risks, and save lives during disaster response missions.
• Motivation and related work: Prior research has explored digital mapping, GIS systems, and collaborative tools, but these approaches often lack real-time synchronization, intuitive 3D representation, and multimodal communication support. This paper addresses these gaps by introducing a novel collaborative 3D sketch mapping system.

Solution

• Proposed approach: CoMap, a collaborative 3D sketch mapping system designed for SAR training and operations, implemented in a virtual reality environment.
• Novelty:
  1. Integration of multimodal externalization tools for efficient spatial communication and map annotation.
  2. Synchronization of shared visual workspaces to support collective sensemaking.
  3. Role-specific interfaces tailored to the distinct perspectives and tasks of commanders and field responders.
  4. Data logging and reconstruction capabilities for post-task review and debriefing.
• Procedure and key techniques:
  • Development of CoMap using a client-server architecture for real-time data synchronization.
  • Implementation of externalization tools such as sketch mapping, pin placement, and multimedia attachments.
  • Design of layered 3D maps to represent multi-story environments intuitively.
  • Evaluation through a controlled user study with 13 dyads and expert interviews with nine SAR professionals.

Results

• Concrete findings:
  • CoMap increased mapping efficiency by 25% compared to 2D sketch mapping.
  • Improved accuracy in AOI representation, with higher IoU scores and completeness.
  • Participants reported greater satisfaction and fewer interface constraints.
  • Communication behavior shifted to more proactive and descriptive exchanges, reducing clarification requests.
• Advantage over baselines:
  • CoMap outperformed traditional 2D mapping in efficiency, accuracy, and user satisfaction.
  • Enhanced spatial communication through shared visual workspaces and multimodal interaction.
• Experiments / evaluation:
  • A within-subject study with 26 participants (13 dyads) comparing CoMap to baseline 2D mapping in VR-based SAR scenarios.
  • Metrics included mapping efficiency, accuracy, user experience, and communication behavior.
  • Expert interviews validated CoMap’s potential for real-world SAR applications and identified areas for improvement.
• Limitations and future work:
  • VR simulation lacks full replication of real-world stressors (e.g., dynamic environmental changes).
  • Simplified experimental setup excludes complex SAR hierarchies and multimodal communication channels.
  • Limited evaluation across diverse SAR scenarios, such as wilderness or maritime environments.
  • Challenges in real-world deployment due to hardware fragility and connectivity issues.

Summary

CoMap is a collaborative 3D sketch mapping system designed to enhance spatial communication and coordination in SAR training and operations. In controlled user studies, CoMap demonstrated superior mapping efficiency, accuracy, and user satisfaction compared to traditional 2D methods. Communication analysis revealed more proactive and descriptive exchanges, supporting collective spatial cognition. Expert feedback highlighted CoMap’s potential for training transferable skills, improving coordination, and enabling post-task review, while identifying constraints related to hardware reliability and usability. Future SAR tools can benefit from integrating multimodal communication, realistic simulations, and ruggedized hardware to advance disaster response capabilities.