SwipeSense: Exploring the Feasibility of Back-of-Device Swipe Interaction Using Built-In IMU Sensors
Authors
The growing dimensions of smartphones have intensified the challenges associated with screen reachability. Back-of-device (BoD) interaction expands the range of reachability and offers a promising solution to mitigate screen occlusion while enhancing one-handed interactions. However, much of the existing research relies on incorporating additional hardware components. In this paper, we present SwipeSense a technique for exploring the feasibility of directional swipe interactions on the back of devices, utilizing built-in inertial measurement unit (IMU) sensors and machine learning models. We conducted a user study with 12 participants who performed 9600 BoD swipes in 8 distinct directions while holding the device naturally. The results of our machine learning models indicate that various directional swipes on the back of the device can be accurately distinguished using only the built-in IMU sensors of the phone, achieving a range of model accuracy between 72% and 95%. Furthermore, we showcase potential applications for these gestures.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 67%
Change Blindness in Proximity-Aware Mobile Interfaces
CHI '18· Context-Aware Computing +1
- 67%
Designing Consistent Gestures Across Device Types: Eliciting RSVP Controls for Phone, Watch, and Glasses
CHI '18· Hand Gesture Recognition +1
- 67%
SmartObjects: Sixth Workshop on Interacting with Smart Objects
CHI '18· Context-Aware Computing +1
- 67%
Explicating "Implicit Interaction": An Examination of the Concept and Challenges for Research
CHI '19· Context-Aware Computing +1
- 67%
Evaluation of Machine Learning Techniques for Hand Pose Estimation on Handheld Device with Proximity Sensor
CHI '20· Hand Gesture Recognition +1
- 67%
AdHocProx: Sensing Mobile, Ad-Hoc Collaborative Device Formations using Dual Ultra-Wideband Radios
CHI '23· Context-Aware Computing +1
- 67%
Pixel Memories: Do Lifelog Summaries Fail to Enhance Memory but Offer Privacy-Aware Memory Assessments?
CHI '25· Context-Aware Computing +1
- 67%
Vision-Based Multimodal Interfaces: A Survey and Taxonomy for Enhanced Context-Aware System Design
CHI '25· Context-Aware Computing +1
- 67%
PackquID: In-packet Liquid Identification Using RF Signals
UbiComp '23· Context-Aware Computing +1
- 67%
GPS-assisted Indoor Pedestrian Dead Reckoning
UbiComp '23· Context-Aware Computing +1
Based on Jaccard similarity of research subtopics & professions (≥60%)