Home Is Where the Smart Is: Development and Validation of the Cybersecurity Self-Efficacy in Smart Homes (CySESH) Scale

Title of the Paper

Home Is Where the Smart Is: Development and Validation of the Cybersecurity Self-Efficacy in Smart Homes (CySESH) Scale

Paper Information

• Research Area: Cybersecurity in smart homes, development and validation of self-efficacy scales
• Keywords: Self-efficacy, cybersecurity, smart homes, scale development, validation

Research Background and Problem Statement

• Identified Problems or Challenges:

  1. The widespread adoption of smart home devices has raised concerns about security and privacy, yet users' security behaviors have not significantly improved, a phenomenon referred to as the "privacy paradox."
  2. There is a lack of standardized cybersecurity self-efficacy (CSE) scales specifically tailored to the smart home domain. Existing tools are often informally developed, lack validation, and may lead to misleading conclusions.
  3. The complexity of smart home systems, the involvement of multiple user roles, and the high data security demands of automated devices pose challenges for researchers and users.

• Significance:

  1. Self-efficacy plays a critical role in how users choose and execute security behaviors, serving as a psychological indicator for predicting safer practices.
  2. Developing a self-efficacy scale specific to the smart home context can help understand and improve users' cybersecurity behaviors, supporting empirical research and policy implementation.

• Research Motivation and Related Work: The authors, drawing on Social Cognitive Theory (SCT), hypothesize the importance of cybersecurity self-efficacy in influencing user security behaviors in smart homes. They call for standardized tools to reduce inconsistencies in research and speculative biases in interpreting results.

Proposed Solution

• Proposed Solution:

  1. Development and validation of a 12-item scale named "Cybersecurity Self-Efficacy in Smart Homes (CySESH)" focusing on self-efficacy in the smart home cybersecurity domain.
  2. The scale was designed following SCT principles and psychometric standards, with rigorous steps from item generation to pilot testing and final validation.

• Innovations:

  1. The first validated scale dedicated to cybersecurity in smart homes.
  2. Strict adherence to psychometric and scale development practices, addressing objectivity, reliability, and validity.
  3. Enhanced content and construct validity through multiple rounds of pilot studies and analyses, ensuring clear differentiation from other psychological constructs.

• Implementation Steps and Key Techniques:

  1. Item Development:
     • Conducted a systematic review of existing literature to identify relevant contexts.
     • Organized expert workshops to determine core representative issues and generated an initial pool of 45 items.
  2. Scale Development:
     • Optimized the initial scale through pilot testing, removing ambiguous or poorly performing items.
     • Adjusted items to ensure coverage of five cybersecurity application stages: purchasing, setup, daily use, maintenance, and disposal.
  3. Scale Validation:
     • Data collection and validation analysis (two independent studies, total sample size of 971 participants).
     • Reliability testing (Cronbach’s α=0.90) and validity analysis (including convergent and discriminant validity).

Research Findings

• Specific Findings:

  1. Successfully developed the 12-item CySESH scale to measure users' cybersecurity self-efficacy in smart homes.
  2. The scale demonstrated excellent reliability, content validity, and construct validity:
     • Reliability: Cronbach’s α of 0.90.
     • Convergent Validity: High correlation with the Information Security Self-Efficacy Scale (r=0.64, p<.001).
     • Discriminant Validity: Significantly lower correlations with self-esteem (r=0.17), optimism (r=0.18), and outcome expectancy (r=0.26).

• Comparison with Existing Solutions:

  1. Compared to studies using unvalidated, informally developed scales, CySESH offers a standardized, efficient, and low-cost measurement tool.
  2. Greater focus on domain specificity, addressing the overgeneralization limitations of existing tools.

• Experiment or Evaluation Results:

  1. Data analysis confirmed the scale's unidimensional design and strong performance (high CFA fit indices).
  2. Four validity analyses supported the scale's characteristics, though validity related to outcome expectancy was slightly lower than anticipated.

• Limitations and Future Directions:

  1. Limitations:
     • Samples were sourced from the Prolific platform, primarily English-speaking users, which may not represent other cultural groups.
     • Limited testing of applicability across diverse user backgrounds (e.g., IT professionals).
     • Gender imbalance in the dataset may affect the generalizability of certain analyses.
  2. Future Directions:
     • Conduct broader cross-cultural validation and explore applicability beyond the smart home domain.
     • Develop a shorter version of the scale for large-scale applications.
     • Investigate the scale's predictive validity for long-term behaviors, particularly the relationship between self-efficacy and actual behavioral practices.
     • Explore applications in specific populations (e.g., children, elderly users).