lightbulbPractical problemGUI/IoT 任务自动化与界面生成用户在PBD系统中难以完成复杂任务,因其无法识别操作间的认知依赖。CHI '25From Operation to Cognition: Automatic Modeling Cognitive Dependencies from User Demonstrations for GUI Task Automation
lightbulbPractical problemGUI/IoT 任务自动化与界面生成用户难以动态调整界面以满足多变的任务需求。CHI '25Generative and Malleable User Interfaces with Generative and Evolving Task-Driven Data Model
lightbulbPractical problemGUI/IoT 任务自动化与界面生成智能家居难以精准响应用户的模糊指令,导致操作复杂化。UbiComp '24Sasha: Creative Goal-Oriented Reasoning in Smart Homes with Large Language Models
lightbulbPractical problemGUI/IoT 任务自动化与界面生成普通用户难以创建智能家居规则,需要学习复杂的编程指令。UbiComp '24ChatIoT: Zero-code Generation of Trigger-action Based IoT Programs
lightbulbPractical problemGUI/IoT 任务自动化与界面生成智能家居中短时和低频活动的识别精度差,难以满足用户需求。UbiComp '24Game of LLMs: Discovering Structural Constructs in Activities using Large Language Models
lightbulbPractical problemGUI/IoT 任务自动化与界面生成用户需要多步操作完成任务,移动应用中难以高效提取宏任务。CHI '24Automatic Macro Mining from Interaction Traces at Scale
lightbulbPractical problemGUI/IoT 任务自动化与界面生成现有移动UI数据集缺乏现代风格且存在大量噪声,影响建模精度。CHI '24MUD: Towards a Large-Scale and Noise-Filtered UI Dataset for Modern Style UI Modeling
lightbulbPractical problemGUI/IoT 任务自动化与界面生成开发者难以高效实现复杂的语音与触控结合的多模态交互。CHI '24ReactGenie: A Development Framework for Complex Multimodal Interactions Using Large Language Models
lightbulbPractical problemGUI/IoT 任务自动化与界面生成普通用户很难用自然语言编写IoT设备的场景规则。UIST '23From Gap to Synergy: Enhancing Contextual Understanding through Human-Machine Collaboration in Personalized Systems
lightbulbPractical problemGUI/IoT 任务自动化与界面生成用户在智能家居中难以用自然语言快速修改IoT服务组合。CHI '22A Conversational Approach for Modifying Service Mashups in IoT Environments