Investigating the Effects of Simulated Eye Contact in Video Call Interviews

Research Background and Issues

• What problems or challenges did the authors identify?
  Video calls lack critical non-verbal cues present in face-to-face communication (e.g., eye contact), especially in remote work and interview scenarios. While it is widely believed that staring at the camera can simulate eye contact, thereby enhancing trust and communication quality, there is currently no scientific evidence to support this claim.

• Why is this issue important?
  Eye contact has been proven to be a key factor in building trust, attractiveness, and intimacy in face-to-face communication, which is crucial for the success of recruitment, sales, and remote work. If effective eye contact simulation can be achieved in video call environments, it could significantly improve the effectiveness of remote communication.

• Research Motivation and Related Work
  Through a literature review, the authors found that while existing studies have explored hardware or software solutions to achieve real eye contact, there is a lack of in-depth research on whether behavioral simulation (e.g., staring at the camera) is effective. This study aims to validate the widely held belief that simulated eye contact can improve interview performance in virtual settings.

Solution

• What methods or solutions did the authors propose?
  The authors designed two studies to explore the impact of simulated eye contact:

  1. Study 1: Eye-tracking Experiment—Participants acted as interviewers in simulated interviews with the experimenter, who implemented simulated eye contact during half of the sessions. Eye-tracking devices were used to analyze participants' gaze patterns.
  2. Study 2: Online Survey—Participants with interview experience were recruited to rate interviewee performance by watching recorded videos featuring simulated and non-simulated eye contact scenarios.

• What is innovative about this solution?
  The research shifts focus from "technological implementation of eye contact" to "behavioral simulation of eye contact" and attempts to quantify the effects of this behavior through experimental and large-scale survey methods. Additionally, the two studies address both real-time interaction and recorded video scenarios, enhancing the reliability of the findings from multiple perspectives.

• What are the implementation steps and key technologies used?

  1. Study 1:
     • Tobii Pro Nano eye-tracking device was used to measure participants' gaze fixation during specific time intervals.
     • Simulated interviews were conducted under two conditions (simulated eye contact and non-simulated eye contact), and participants rated the interviewee's performance.
     • Mixed-effects models were employed to analyze interview ratings and gaze patterns.
  2. Study 2:
     • Dual-camera setups were used to record interviews featuring simulated and non-simulated eye contact.
     • Participants with professional interview experience rated each video across multiple dimensions via an online survey.
     • Aligned Rank Transform was applied to process non-parametric data, followed by two-way ANOVA for statistical analysis.

Research Findings

• What specific results were achieved?

  1. Results from Study 1 showed that simulated eye contact did not significantly affect interviewers' evaluations of interviewees. Participants' gaze patterns also did not exhibit significant differences (e.g., increased focus on the interviewee's video).
  2. Study 2 revealed marginal significance (p ≤ 0.1) in the "gaze evaluation" dimension, but overall results did not show significant effects of simulated eye contact on any evaluation metrics.

• What advantages does this solution have compared to existing ones?
  This study is the first to systematically analyze the effects of behavioral simulation of eye contact by combining real-time experiments and large-scale online surveys. The methodology is more rigorous, exploring multiple evaluation dimensions (e.g., background, attitude, collaboration ability) rather than focusing solely on eye contact.

• What were the experimental or evaluation results?

  • Simulated eye contact did not significantly improve interviewees' overall performance ratings, including "background skills," "collaboration ability," "attitude," and "overall evaluation."
  • Simulated eye contact only showed significant reductions in self-fixation time (Fixation on self) and rapid gaze shift duration (Saccade duration).

• Limitations and Future Directions

  1. Limitations:
     • Participants in Study 1 were primarily students, lacking professional interview experience.
     • Videos used in Study 2 were pre-recorded, and the lack of real-time interaction may have influenced the results.
     • The study did not control for influencing variables such as social anxiety, gender, and cultural background.
  2. Future Directions:
     • Investigate the performance of simulated eye contact in more complex and informal scenarios (e.g., group meetings, remote therapy).
     • Explore whether modern users' needs for eye contact in video calls have changed, especially in the context of widespread remote work post-pandemic.
     • Develop eye contact assistance systems that integrate behavioral and technological approaches, balancing user-initiated actions, non-verbal expressions, and technological implementation.

In summary, this study challenges the widely held belief that behavioral simulation of eye contact in video interviews necessarily improves performance. It provides a new perspective on defining the actual role of non-verbal cues in remote communication and calls for further research.