Beyond Translation: Design and Evaluation of an Emotional and Contextual Knowledge Interface for Foreign Language Social Media Posts
Authors
Although many social media sites now provide machine translation (MT) for foreign language posts, translation of a post may not suffice to support understanding of, and engagement with, that post. We present SenseTrans, a tool that provides emotional and contextual annotations generated by natural language analysis in addition to machine translation. We evaluated SenseTrans in a laboratory experiment in which native English speakers browsed five Facebook profiles in foreign languages. One group used the SenseTrans interface while the other group used MT alone. Participants using SenseTrans reported significantly greater understanding of the posts, and greater willingness to engage with the posts. However, no additional cognitive load was associated with using an interface that provided more information. We discuss the implications of our findings for the design of tools to support multilingual sense making and interaction on social media.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 100%
Creating Inclusive Voices for the 21st Century: A Non-Binary Text-to-Speech for Conversational Assistants
CHI '23· Multilingual & Cross-Cultural Voice Interaction +1
- 67%
Voice as a Design Material: Sociophonetic Inspired Design Strategies in Human-Computer Interaction
CHI '19· Voice User Interface (VUI) Design +2
- 67%
Conversational Futures: Emancipating Conversational Interactions for Futures Worth Wanting
CHI '21· Multilingual & Cross-Cultural Voice Interaction +2
- 67%
Understanding Public Perceptions of AI Conversational Agents: A Cross-Cultural Analysis
CHI '24· Conversational Chatbots +2
- 67%
The Sound of Support: Gendered Voice Agent as Support to Minority Teammates in Gender-Imbalanced Team
CHI '24· Intelligent Voice Assistants (Alexa, Siri, etc.) +2
- 67%
Inter(sectional) Alia(s): Ambiguity in Voice Agent Identity via Intersectional Japanese Self-Referents
CHI '25· Intelligent Voice Assistants (Alexa, Siri, etc.) +2
- 67%
Hearing Ambiguity: Exploring Beyond-Gender Impressions of Artificial Ambiguous Voices
CUI '25· Voice User Interface (VUI) Design +2
Based on Jaccard similarity of research subtopics & professions (≥60%)