Wynonna H. Y. Fong

Can You Move These Over There? Exploring an LLM-based VR Mover to Support Natural Multi-object Manipulation

In our daily lives, we naturally convey instructions for spatially manipulating objects using words and gestures. Transposing this form of interaction into virtual reality (VR) object manipulation can be beneficial. We propose VR Mover, an LLM-empowered multimodal interface that can understand and interpret the user’s…