(Dis)Appearables: A Concept and Method for Actuated Tangible UIs to Appear and Disappear based on Stages

Document Title

(Dis)Appearables: A Concept and Method for Actuated Tangible UIs to Appear and Disappear based on Stages

Document Information

• Subject Area: Actuated Tangible User Interface Design and Interaction
• Keywords: Physical interaction implementation, autonomously transformable forms, dynamic physical interaction, stage design, multi-robot control, tangible user interface

Research Background and Issues

• Issues and Challenges:
  • Current Tangible User Interfaces (TUIs) are diverse and innovative, but there is insufficient research on dynamically controlling their appearance (e.g., making them "appear" or "disappear").
  • Programmatic control of physical objects faces significant limitations, especially in terms of users' spatial perception and attention allocation when tracking objects.
• Importance:
  • Enhancing the design quality of physical interaction interfaces.
  • Breaking the limitations of Graphical User Interfaces (GUIs) and exploring more physically present and flexible interaction methods.
• Research Motivation and Related Work:
  • Drawing inspiration from stage art (such as the dynamic switching between "front-stage" and "back-stage" in stage design) to create innovative user interaction models.
  • Building on existing research advancements in dynamic shape-changing TUIs and robotic physical interaction, addressing the research gap in TUIs' (dis)appearance functionality.

Solution

• Method and Approach:
  • Proposing a new method called "(Dis)Appearables," which combines autonomously moving TUIs with a "Stage" (a physical platform simulating a stage) to achieve dynamic "appearance" and "hiding" of user interfaces.
  • The "Stage" consists of "four key components": front-stage, back-stage, boundaries, and transition portals.
• Innovations:
  • Introducing portal designs inspired by stage performances (e.g., wall and floor portals), integrating technology and design.
  • Providing a spatial design framework and diverse physical interaction expressions, enhancing the physical form's expressiveness and flexibility in user interfaces.
  • Integrating feasible prototypes based on off-the-shelf hardware (e.g., two-wheeled robots) and modular design tools, making the design and testing of user interface prototypes more efficient.
• Implementation Steps and Key Technologies:
  1. Design and Manufacture of the "Stage": Using GUI tools to plan and design the platform's physical dimensions, front-stage/back-stage, and portal locations.
  2. Control Module: Implementing robot path planning based on a C++ conflict search algorithm to ensure non-conflicting multi-robot scheduling.
  3. Dynamic Interaction Implementation: Utilizing servo motors and modular components to mechanize portal operations.
  4. Application Demonstrations: Including virtual city traffic simulation, dynamic organization of desktop office equipment, and remote competitive scenarios.

Research Outcomes

• Specific Outcomes:
  • Proposed and validated the concept and design prototype of (Dis)Appearables.
  • The design space encompasses multiple aspects, including basic (dis)appearance effects, visual effects combined with graphical media, and enhanced interaction brought by multi-robot collaboration modes.
  • Developed a complete design pipeline for hardware control between Stage and TUIs.
• Advantages and Contributions:
  • Significantly reduced visual and physical interference of physical interfaces (e.g., surface clutter issues).
  • Provided a novel approach for simultaneously achieving dynamic appearance and functional switching of physical objects.
  • Demonstrated innovative interaction use cases in multiple practical application domains, such as desktops and entertainment.
• Experimental Results:
  • Using multiple TUIs, the system was built and demonstrated in an environment up to 1260 mm x 1188 mm, showcasing robot navigation accuracy and module functionality effectiveness.
  • Example applications showed the solution's adaptability to customized scenarios.
• Limitations and Future Directions:
  • Limitations:
    • Current dynamic portal technology relies on servo motors, limiting tight integration with certain hardware.
    • Spatial design still requires optimization to adapt to real-life environments.
    • Lack of experimental observation of specific user interaction behaviors.
  • Future Directions:
    • Exploring complex spatial control methods (e.g., integrating transparency technology with augmented reality, dynamic scene lighting, and even stage designs for 3D flying robot TUIs).
    • Further optimizing the linkage mechanism between user interfaces and multi-robot path planning algorithms.
    • Expanding platform support for other types of hardware (e.g., curved interfaces, modular robots).
    • Validating the real impact of visual effects on interaction behavior through user experience studies.

Output Format

The above analysis focuses on the document's target interaction background and experimental details, comprehensively introducing key features by combining design and future directions.