BrightMarker: 3D Printed Fluorescent Markers for Object Tracking

Title of the Paper

BrightMarker: 3D Printed Fluorescent Markers for Object Tracking

Paper Information

• Domain: Human-Computer Interaction (HCI), Digital Fabrication, Augmented Reality (AR)/Virtual Reality (VR), Object Tracking Technologies
• Keywords: 3D printing, digital fabrication, fluorescence, infrared imaging, marker tracking, invisible markers

Research Background and Problem Statement

• Challenges: Current invisible object marker technologies face limitations such as low resolution and weak signals (low signal-to-noise ratio), making real-time tracking in dynamic scenarios difficult. Additionally, these technologies are restricted by object color compatibility; for example, InfraredTags only work on black objects, while AirCode is limited to white objects.
• Importance: Achieving invisible object marking and real-time tracking is critical for animation production, gaming, AR/VR interaction, and industrial object tracking, while minimizing interference with users' visual experiences.
• Motivation and Related Work: Inspired by existing motion capture systems (e.g., OptiTrack), the authors aim to overcome the limitations of current invisible marker systems in resolution, real-time performance, and color adaptability through advancements in fluorescent materials.

Solution

• Proposed Method: The authors introduce the BrightMarker system, which embeds invisible markers into multicolored objects using near-infrared fluorescent materials. Combined with infrared cameras and matching optical filters, this system generates high-contrast images for real-time tracking. The marker detection performance is enhanced through the wavelength conversion property of fluorescent materials ("Stokes shift").
• Innovations:
  • Embedding invisible markers using fluorescent materials to overcome color restrictions.
  • Providing software tools for automatic marker embedding based on geometric structures.
  • Developing hardware modules compatible with existing AR/VR devices.
  • Implementing a real-time image processing pipeline without relying on complex machine learning models.
• Implementation Steps:
  1. Design markers and embed them into 3D models using CAD tools.
  2. Use multi-material 3D printers to integrate fluorescent markers into objects.
  3. Activate fluorescent materials with infrared LEDs and capture marker light through optical filters.
  4. Achieve real-time marker localization and analysis using image processing techniques.
  5. Provide hardware support, including smartphone attachment modules and high-performance standalone modules.

Research Outcomes

• Key Results:
  • The BrightMarker system successfully embeds fluorescent markers on multicolor surfaces and supports long-distance marker detection (over 2m).
  • The image processing pipeline demonstrates high marker detection rates (>98%) and low system latency (<3.7ms/frame).
• Advantages and Comparisons: Compared to InfraredTags and paper-based markers, BrightMarker improves detection distance and real-time performance while adapting to various object colors such as red, yellow, and blue. Its fluorescent imaging eliminates environmental light interference, enhancing noise resistance.
• Experimental or Evaluation Results:
  • Detection Distance: Red markers can be detected from 90cm, while blue markers require reduced interference.
  • Detection Speed: Maintains a 100% tracking rate even at high object motion speeds, significantly outperforming InfraredTags' 60.73%.
  • Minimum Marker Size: Successfully detects markers as small as 6mm × 6mm, with red markers achieving longer detection distances.
• Limitations and Future Directions:
  • Limitations:
    • Fluorescent dye concentration limits light intensity; higher concentration materials need exploration.
    • Infrared transparency of black objects is weak, requiring specialized materials.
    • Marker embedding may be affected by object surface shapes and extensive motion.
  • Future Directions:
    • Develop highly concentrated fluorescent materials.
    • Explore mass production techniques such as plastic overmolding.
    • Combine magnetic materials for hybrid tracking to address occlusion issues.

Application Scenarios

1. Rapid Product Tracking: Enables quick scanning and shelving records for items in industrial production (e.g., product tracking on packaging assembly lines).
2. Wearable Devices for Human Motion Tracking: Prints flexible or rigid wristbands with embedded markers for privacy-preserving human motion digitization.
3. Contact-Based Interfaces in Mixed Reality: Uses objects embedded with BrightMarker as high-precision interaction tools or tactile substitutes in VR/AR.
4. Night Vision Monitoring: Provides privacy-preserving object tracking technology that captures only marker contours, suitable for nighttime home surveillance.