How Language Formality in Security and Privacy Interfaces Impacts Intended Compliance

Document Title

How Language Formality in Security and Privacy Interfaces Impacts Intended Compliance

Document Information

• Subject Area: User interface design, language formality, and security/privacy interaction
• Keywords: Information privacy, security, language formality, compliance behavior, interface design, user perception, data analysis, experimental research, language coding, platform differences

Research Background and Problem

• Identified Problems or Challenges:

  • Users often fail to adopt optimal security measures, potentially due to a lack of knowledge or misunderstanding of the consequences of their actions.
  • Companies use language communication to encourage users to adopt advanced security and privacy practices, but the impact of language formality in existing security recommendations remains unclear.

• Significance of the Research:

  • Improving how platforms convey security recommendations can not only protect user privacy but also enhance user trust.
  • Language style, as a controllable design element, has a subtle but significant influence on user behavior, such as attention, perception, and compliance.

• Motivation and Related Work:

  • Language formality has been shown to influence the effectiveness of information dissemination (e.g., trust, authority, behavior guidance).
  • Methods to increase user adoption of privacy and security recommendations require further exploration, including adjustments to interface design and language style.

Solution

• Proposed Methods or Solutions:

  • Collect and analyze a dataset of language used in security and privacy interfaces across platforms, using coding methods to quantify the relationship between language characteristics and formality.
  • Conduct online experiments to investigate user perceptions of language formality and its connection to compliance intentions.

• Innovations:

  • Proposed language formality as a key design variable to drive user security behaviors.
  • Created a publicly available dataset containing 1,817 security and privacy interface texts, accompanied by in-depth analysis.
  • Conducted online experiments (512 participants) to further explore factors influencing user perceptions of language formality and compliance behavior.

• Implementation Steps and Key Techniques:

  1. Data Collection Phase: Manually recorded key security and privacy operation page information from 13 platforms (including desktop and mobile interfaces).
  2. Language Feature Coding: Iteratively developed a coding scheme to extract text attributes (e.g., professionalism, command tone, technical terminology).
  3. User Experiment: Designed an online survey to study the impact of language formality on user perception and compliance intentions, randomly assigned samples, and analyzed data using mixed-effects models.

Research Findings

• Specific Findings:

  • Significant differences in language style were observed across platforms (e.g., Amazon exhibited high language formality, while Instagram exhibited low formality).
  • Prompts with higher language formality were positively correlated with stronger compliance intentions, with participants more likely to follow recommendations presented in formal styles.
  • User age and education level significantly influenced judgments of language formality, with older participants more likely to perceive language as insufficiently formal.

• Advantages Compared to Existing Solutions:

  • The data-driven language coding method provides precise quantification of interface language formality.
  • Combined with real user studies, the research validates the potential link between language formality and security behavior, offering a new perspective for user interface design.

• Experimental or Evaluation Results:

  • Formality was strongly correlated with compliance with privacy recommendations (p < .001), with more formal language significantly increasing compliance intentions.
  • Specific prompt types, such as two-factor authentication and password strength suggestions, also influenced compliance intentions.

• Limitations and Future Directions:

  • Limitations: Experimental data relied on self-reports rather than real-world scenarios, which may not fully reflect actual behavior; external variables may have influenced results.
  • Future Directions:
    1. Extend research to different languages and cultural contexts to study the applicability of language formality in multilingual environments.
    2. Conduct in-depth studies on the interaction between language formality and other interface design elements (e.g., color, font).
    3. Validate whether high language formality can genuinely improve user adherence to security recommendations in real-world systems.

Dataset and Resources

• Two resource datasets are provided:

  1. The complete dataset of coded language strings.
  2. Participant ratings of language formality and compliance intentions.

  The datasets are available at LabintheWild.