ReflecTrack: Enabling 3D Acoustic Position Tracking Using Commodity Dual-Microphone Smartphones

Document Title

ReflecTrack: Enabling 3D Acoustic Position Tracking Using Commodity Dual-Microphone Smartphones

Document Information

• Subject Area: 3D Acoustic Positioning Technology, User Interface and Interaction Techniques
• Keywords: Acoustic tracking, sound reflection, FMCW, smartphones, 3D positioning, interaction techniques, gesture recognition, virtual reality, smartphones, FMCW radar

Research Background and Problem

• Problem or Challenge:

  • Modern smartphones face limitations in 3D position tracking, making it difficult to popularize 3D tracking technology without relying on additional hardware.
  • Traditional 3D tracking systems heavily depend on external sensors or custom hardware, which is challenging to implement on standard smartphones.
  • The complexity of echo signal analysis increases the technical barriers for 3D acoustic positioning.

• Significance:

  • High-precision 3D tracking can unlock new interactive application scenarios, including VR/AR tracking and 3D input, potentially enhancing user experience and interaction.

• Research Motivation and Related Work:

  • Addressing the limitations of existing acoustic tracking methods, such as requiring multiple microphones or additional hardware, this paper proposes a novel method for 3D acoustic position tracking using only dual-microphone smartphones by introducing reflective surfaces.
  • The research improves frequency-modulated continuous wave (FMCW)-based acoustic ranging techniques and extends them to utilize sound reflections to create a "virtual microphone" from a single microphone for 3D tracking.

Solution

• Method/Solution:

  • A 3D acoustic position tracking method named "ReflecTrack" is proposed.
  • Common speakers emit FMCW signals in the inaudible frequency range, and the smartphone's two microphones receive both direct path signals and reflected path signals.
  • Everyday flat reflective surfaces are introduced as key supporting elements, leveraging reflected signals to establish virtual microphones.
  • An "echo-aware FMCW" technique is proposed, which improves the handling of multipath acoustic signals through signal pattern adjustments (e.g., triangular wave modulation) and enhanced target detection processes.

• Innovations:

  • Addresses the limitations of traditional FMCW techniques in handling multipath effects and motion effects.
  • By leveraging "virtual microphones," enables 3D tracking functionality on standard smartphones with only dual microphones, offering greater versatility and scalability.
  • Reduces the time cost of signal processing and enhances robustness through techniques such as CFAR (Constant False Alarm Rate) peak detection.

• Implementation Steps and Key Technologies:

  • During the initialization phase, the clock offset between the speaker and smartphone is calibrated.
  • Direct distances and reflected distances are obtained from each microphone, and the 3D position of the sound source is calculated using 3D triangulation methods.
  • A real-time processing software and hardware framework is implemented:
    • The speaker emits triangular wave-modulated FM signals.
    • Python is used to extract effective distances based on FFT and CFAR for position estimation.
    • Filtering and smoothing are optimized to enhance the fluidity of tracking data.

Research Outcomes

• Specific Results:

  • In a 60cm × 60cm × 60cm space, ReflecTrack achieves a median error of 28.4mm; in a high-precision 30cm × 30cm × 30cm space, the median error is 22.1mm.
  • The system supports both horizontal and vertical reflective surfaces and various reflective materials.

• Advantages Over Existing Solutions:

  • ReflecTrack does not require specialized hardware and can achieve 3D tracking using everyday reflective surfaces.
  • Compared to existing systems (e.g., CAT, MilliSonic), it is more cost-effective and easier to deploy.
  • Triangular wave FMCW and CFAR target detection demonstrate strong robustness in complex acoustic environments.

• Experimental or Evaluation Results:

  • Impact of Environmental Noise: ReflecTrack exhibits strong anti-interference capabilities even in the presence of conversational noise or phone ringing.
  • Reflective Materials: Reflective surfaces made of acrylic, wood, cardboard, etc., perform stably; additional multipath effects can be mitigated by configuring sound-absorbing materials.
  • User Impact: User motion speed and speaker placement significantly affect errors, with slower, uniform movements resulting in lower errors.
  • Tracking Coverage Area: For configurations involving the distance between reflective surfaces and microphones, a separation distance of 16cm yields optimal results.

• Limitations and Future Directions:

  • Current multipath effects may cause FFT peak overlap, reducing tracking accuracy. Future work should improve peak separation algorithms or adjust signal patterns.
  • Multi-reflective surface scenarios are not yet supported, and further exploration of multi-virtual microphone development potential is needed.
  • Enhancing robustness: A deeper understanding of interference issues from reflected signals and addressing challenges posed by multiple reflections and environmental randomness in multipath scenarios is required.