Re-Examining the Examiners: Changes in Privacy and Security Perceptions of Exam Proctoring

Paper Title

Re-Examining the Examiners: Changes in Privacy and Security Perceptions of Exam Proctoring

Publication Info

• Topic area: Privacy and security perceptions of remote exam proctoring software.
• Keywords: Exam proctoring, privacy, security, remote learning, COVID-19, surveillance, academic integrity, usability, edtech, user perceptions.

Background and Problem

• Problem / challenge: Remote exam proctoring software, widely adopted during the COVID-19 pandemic, raises significant privacy and security concerns due to its invasive monitoring methods. Previous studies found discomfort among test-takers, but it is unclear how perceptions have evolved post-pandemic.
• Significance: Understanding changes in user attitudes is critical for balancing academic integrity with privacy and security, especially as remote proctoring continues to be used in educational and professional contexts.
• Motivation and related work: Prior research, such as Balash et al. (2020), highlighted privacy concerns and discomfort with proctoring methods. However, the pandemic's normalization of remote technologies may have shifted user attitudes, necessitating a re-evaluation of these tools.

Solution

• Proposed approach: A replication of Balash et al.’s 2020 study, including a survey of 127 participants and an analysis of browser extensions used for proctoring, to assess changes in privacy perceptions and proctoring trends.
• Novelty:
  1. Updated analysis of proctoring software and user perceptions post-pandemic.
  2. Inclusion of both students and non-student test-takers for broader insights.
  3. Examination of shifts in comfort and acceptance of invasive proctoring methods.
  4. Exploration of the transition from browser extensions to standalone proctoring software.
• Procedure and key techniques:
  • Re-administered Balash et al.’s survey with additional questions about post-2022 experiences.
  • Analyzed browser extensions for permissions and privacy policies.
  • Conducted statistical tests (Mann-Whitney U, χ²) and qualitative coding of survey responses and extension reviews.

Results

• Concrete findings:
  • 77% of participants believe proctoring software offers a reasonable privacy-integrity trade-off, up from 41% in 2020.
  • Comfort with invasive methods like eye tracking and browser history monitoring increased significantly.
  • 53% of participants prefer online exams over traditional ones, a notable rise from prior studies.
• Advantage over baselines:
  • Increased acceptance of proctoring software despite unchanged privacy invasiveness.
  • Higher perceived convenience and normalization of surveillance methods.
• Experiments / evaluation:
  • Surveyed 127 participants with prior proctoring experience.
  • Analyzed 13 browser extensions, finding no major changes in permissions but a shift toward standalone software.
  • Reviewed 3,500 extension reviews, revealing persistent dissatisfaction (average rating: 1.5/5).
• Limitations and future work:
  • Limited to U.S.-based participants, potentially reducing generalizability.
  • Recall bias and self-reported data may affect accuracy.
  • Future work should explore privacy-preserving proctoring methods, alternative evaluation strategies, and institutional decision-making frameworks.

Summary

This study replicates and extends prior work to assess how perceptions of remote exam proctoring software have evolved since the COVID-19 pandemic. Findings indicate increased acceptance of these tools, driven by convenience and normalization of surveillance, despite persistent privacy concerns and technical issues. The shift from browser extensions to standalone software reflects evolving proctoring ecosystems. Future research should focus on privacy-preserving solutions, alternative assessment methods, and institutional transparency to address ongoing challenges.