ASTEROIDS: Exploring Swarms of Mini-Telepresence Robots for Physical Skill Demonstration

Title of the Paper

ASTEROIDS: Exploring Swarms of Mini-Telepresence Robots for Physical Skill Demonstration

Paper Information

• Domain: Remote Physical Skill Demonstration and Human-Computer Interaction
• Keywords: Telepresence, Collaboration, Robotics, Physical Skills, Swarm Robots, Video Conferencing, Visualization

Research Background and Problem

• Problem or Challenge:

  • Current online synchronous teaching struggles to provide sufficient spatial awareness and perspective control for physical skill demonstrations.
  • Traditional fixed camera setups require extensive configuration and fail to fully meet the personalized observation needs of the audience.
  • Demonstrators find it difficult to perceive the presence and reactions of remote audiences, lacking means for real-time adjustments to audience needs, which diminishes the sense of spatial interaction.
  • Existing telepresence technologies (e.g., augmented reality and single robotic cameras) focus more on remote assistance rather than supporting team-based audience viewing across multiple physical workspaces.

• Significance:

  • With the rise of online education, enhancing audience engagement, mastery of demonstration details, and interaction with instructors is critical to improving the quality of online physical skill teaching.

• Motivation:

  • The authors aim to address the above issues through novel micro-robot technology, providing a teaching model that enhances remote interaction and visual freedom while strengthening instructor-audience interaction.

Solution

• Method/Solution:

  • The Asteroids system is proposed, introducing a new method for demonstrating and broadcasting physical skills using a swarm of mini telepresence robots placed on a workbench.
  • Audiences can control the robots to navigate and switch perspectives to observe details in different areas, while instructors can guide the teaching process through physical manipulation of the robots and tangible markers.

• Innovations:

  • Applying mini swarm robots to remote physical demonstration scenarios, granting remote audiences a sense of physical presence.
  • Enabling audiences to switch between robots for new perspective freedom, enhancing engagement and interactivity.
  • Instructors can directly control robots using tangible interaction interfaces, facilitating the management of demonstration flow and audience viewpoints.

• Implementation Steps and Key Technologies:

  • The system hardware consists of mini robots, tangible command markers, and coordinate-tracking cameras.
  • A web-based user interface is designed, allowing audiences to navigate robots automatically or manually via a map.
  • L-shaped workspace markers define primary work areas, and interactive control markers for fixing or moving robots are detectable by cameras.
  • The A* algorithm is used for robot automatic path planning, combined with visual tracking feedback for real-time position updates.

Research Outcomes

• Specific Outcomes:

  • The system designs an interaction method enabling remote audiences to flexibly control viewpoint positions, focusing on different areas of the workbench.
  • Demonstrators can enhance teaching effectiveness through physical interaction with the robots and easily adapt to audience needs.
  • Features provided by the system, such as specifying focal points and restricting movement, were evaluated as effective in improving the audience's teaching experience.

• Advantages Compared to Alternatives:

  • Compared to fixed cameras or single remote-controlled camera solutions, Asteroids allows audiences not only to switch perspectives but also enables instructors to enhance teaching interaction through physical methods.
  • It improves audience understanding of demonstration content, engagement, and interaction quality with the instructor.

• Experiment and Evaluation Results:

  • User studies showed that audiences reported higher engagement, presence, and content comprehension when using the Asteroids system.
  • During a demonstration of architectural model-making, participants not only accurately answered technical and tool-related test questions but also successfully sketched detailed model diagrams from memory.
  • Unique system features, such as "specific robot focus" and "automatic follow display area," significantly enhanced audience participation flexibility.

• Limitations and Future Directions:

  • The current research primarily focuses on audience experience; future studies should explore how demonstrators integrate system operations into their workflows.
  • The experimental environment was limited to a single workbench and a small number of participants; further exploration is needed to scale up the workspace and the number of robots.
  • Research could expand to include robot camera panning/rotation and arm functionality to enable more complex remote interactions and collaborations.