Hong Z Tan

Generating Real-Time, Selective, and Multimodal Haptic Effects from Sound for Gaming Experience Enhancement

We propose an algorithm that generates a vibration, an impact, or a vibration+impact haptic effect by processing a sound signal in real time. Our algorithm is selective in that it matches the most appropriate type of haptic effects to the sound using a machinelearning classifier (random forest) that is built on expert…