I Know Your Intent: Graph-enhanced Intent-aware User Device Interaction Prediction via Contrastive Learning
Authors
"With the booming of smart home market, intelligent Internet of Things (IoT) devices have been increasingly involved in home life. To improve the user experience of smart homes, some prior works have explored how to use machine learning for predicting interactions between users and devices. However, the existing solutions have inferior User Device Interaction (UDI) prediction accuracy, as they ignore three key factors: routine, intent and multi-level periodicity of human behaviors. In this paper, we present SmartUDI, a novel accurate UDI prediction approach for smart homes. First, we propose a Message-Passing-based Routine Extraction (MPRE) algorithm to mine routine behaviors, then the contrastive loss is applied to narrow representations among behaviors from the same routines and alienate representations among behaviors from different routines. Second, we propose an Intent-aware Capsule Graph Attention Network (ICGAT) to encode multiple intents of users while considering complex transitions between different behaviors. Third, we design a Cluster-based Historical Attention Mechanism (CHAM) to capture the multi-level periodicity by aggregating the current sequence and the semantically nearest historical sequence representations through the attention mechanism. SmartUDI can be seamlessly deployed on cloud infrastructures of IoT device vendors and edge nodes, enabling the delivery of personalized device service recommendations to users. Comprehensive experiments on four real-world datasets show that SmartUDI consistently outperforms the state-of-the-art baselines with more accurate and highly interpretable results." https://doi.org/10.1145/3610906
Research Questions / Practical Problems
Question signals indexed for this paper.
- 100%
Design Considerations for Interactive Office Lighting: Interface Characteristics, Shared and Hybrid Control
CHI '19· Context-Aware Computing +1
- 100%
Inhabiting Interconnected Spaces: How Users Shape and Appropriate their Smart Home Ecosystems
CHI '23· Context-Aware Computing +1
- 100%
Design and Field Trial of Tunee in Shared Houses: Exploring Experiences of Sharing Individuals’ Current Noise-level Preferences with Housemates
CHI '23· Context-Aware Computing +1
- 67%
FLUID-IoT : Flexible and Fine-Grained Access Control in Shared IoT Environments via Multi-user UI Distribution
CHI '24· Context-Aware Computing +2
- 67%
Direction-of-Voice (DoV) Estimation for Intuitive Speech Interaction with Smart Device Ecosystems
UIST '20· Voice User Interface (VUI) Design +2
- 67%
Neighbor-Environment Observer: An Intelligent Agent for Immersive Working Companionship
UIST '23· Context-Aware Computing +2
Based on Jaccard similarity of research subtopics & professions (≥60%)