MOSion: Gaze Guidance with Motion-triggered Visual Cues by Mosaic Patterns

Title of the Paper

MOSion: Gaze Guidance with Motion-triggered Visual Cues by Mosaic Patterns

Paper Information

• Research Area: Human-Computer Interaction, Visual Perception, Augmented Reality
• Keywords: Gaze guidance, visual perception, saliency, visual afterimage effect, computer vision, high-speed projection

Research Background and Problem Statement

• Identified Problems or Challenges:

  1. Existing gaze guidance methods (e.g., blurring, scaling) achieve their effects by directly altering image pixel values, which may introduce visual artifacts in the target area and compromise its natural appearance.
  2. Current methods produce the same guidance effect for all observers, lacking adaptive adjustments based on the observer's motion state (e.g., stationary or moving).
  3. In public advertising design, varying behaviors of observers (e.g., stationary viewing or quickly passing by) pose additional challenges for effective gaze guidance.

• Research Significance: This study integrates the visual afterimage effect and high-speed projection technology to provide clear images for stationary observers while enhancing attention to designated areas for moving observers, addressing the limitations of traditional methods in terms of visual artifacts and multi-user adaptability.

• Research Motivation and Related Work: Inspired by visual cognition theories (e.g., visual afterimage mechanisms), this study builds upon existing visual guidance methods (e.g., flicker-based or blur-based approaches) and develops an innovative method suitable for both stationary and dynamic scenarios.

Solution

• Proposed Method or Solution: The authors propose a gaze guidance method called MOSion, which utilizes the light integration effect and the visual system's afterimage effect to achieve dynamic guidance through mosaic pattern transformations. Key features of the method include:

  1. Generating mosaic patterns in the target area, which are displayed through high-frequency cyclic projection.
  2. Stationary observers perceive an undistorted original image through visual integration, while moving observers experience enhanced visual saliency in the target area.

• Innovative Contributions:

  1. Achieves motion-state-based adaptive gaze guidance, a capability not present in other gaze guidance methods.
  2. Operates without real-time tracking devices, leveraging high-speed imaging and visual perception mechanisms for low computational cost autonomous guidance.
  3. Applicable to diverse scenarios, including flat poster advertisements and dynamic projections onto real 3D objects.

• Implementation Steps and Technologies:

  1. Input Image and Target Selection: Designers input the image to be processed and select the area to enhance attention.
  2. Mosaic Pattern Generation: The method decomposes the target area into mosaic patterns tiled with RGB and black, projected at a frequency of 400fps.
  3. High-Speed Projection: A high-speed projector is used to project the image onto a screen.
  4. Human Visual Perception: Under stationary conditions, light integration restores the original image; under motion conditions, afterimages cause the mosaic area to stand out.

Research Outcomes

• Specific Results:

  1. Demonstrated that MOSion enhances the perceived saliency of target areas for moving observers while maintaining an undistorted view for stationary observers.
  2. User studies confirmed that participants were more easily guided to the target area while moving, with MOSion significantly outperforming untreated images in guidance effectiveness.
  3. Adapted to practical application scenarios (e.g., poster advertisements and 3D object displays).

• Advantages:

  1. Adaptive adjustment based on observer motion state, providing strong guidance without disrupting the experience of stationary observers.
  2. No need for additional tracking devices or complex computations, offering high scalability.
  3. Applicable to a wide range of real-world scenarios, from flat surfaces to complex 3D objects.

• Experimental and Evaluation Results:

  1. Subjective experiments showed that images projected under stationary conditions were almost distortion-free, while under motion conditions, participants' attention to the target area significantly increased.
  2. User questionnaires and verbal feedback supported the effectiveness of MOSion; some participants reported perceiving visual artifacts, but most acknowledged the method's success in guiding attention.

• Limitations and Future Directions:

  1. Flicker Issue: Despite the high projection frequency (400fps), some observers experienced slight artifacts under stationary conditions, particularly during eye movements.
  2. Adaptation to Different Images: The method performed less effectively on images with low RGB intensity or monochromatic color schemes.
  3. User Comfort Optimization: Further research is needed to balance high comfort levels with effective guidance.
  4. Visual Integration Mechanism Research: Modeling the specific perception mechanisms of the human eye could optimize guidance effects and reduce visual discomfort.

Conclusion

MOSion introduces an innovative dynamic gaze guidance method, opening new possibilities for human-computer interaction and visual display techniques with significant potential for broad applications. Future research will further explore user comfort and method adaptability while advancing its practical use in advertising, exhibitions, and augmented reality.