The U in Crypto Stands for Usable: An Empirical Study of User Experience with Mobile Cryptocurrency Wallets

Title of the Paper

The U in Crypto Stands for Usable: An Empirical Study of User Experience with Mobile Cryptocurrency Wallets

Bibliographic Information

• Subject Area: Human-Computer Interaction and Cryptocurrency User Experience
• Keywords: Cryptocurrency, User Experience, Mobile Wallets, Natural Language Processing, Thematic Analysis, Review Analysis

Research Background and Problems

• Problems and Challenges:
  • The user experience (UX) of current mobile cryptocurrency wallets faces numerous general and domain-specific issues.
  • Users' misunderstandings of cryptocurrency and wallet operations can lead to significant errors and irreversible financial losses.
  • Users often approach cryptocurrency usage with expectations shaped by conventional payment systems, despite the distinct characteristics of cryptocurrencies (e.g., irreversibility of transactions).
• Significance:
  • With the rapid growth of cryptocurrency users (now exceeding 60 million), optimizing user experience can increase usage frequency and reduce errors.
  • Errors and poor experiences not only lead to user churn but also result in irretrievable financial losses.
• Research Motivation and Related Work:
  • Existing studies indicate that cryptocurrency wallets are complex, abstract, and unfriendly to users.
  • To date, no detailed research has systematically uncovered the specific features, causes, and scope of these issues.

Solution

• Research Methods:
  • Data Collection:
    • Developed a web crawler to collect 45,821 user reviews of popular mobile cryptocurrency wallets from the Apple App Store and Google Play Store.
    • Used Natural Language Processing (NLP) and Machine Learning (ML) techniques to filter 6,859 reviews related to UX.
  • Data Analysis:
    • Conducted qualitative thematic analysis on the filtered reviews to identify users' experiences with wallets.
• Key Techniques and Steps:
  1. Data Preprocessing: Cleaned review text and removed irrelevant fields.
  2. Feature Extraction and Machine Learning Classification: Used a Random Forest model to classify which reviews were UX-related (achieving high classification accuracy).
  3. Thematic Analysis: Manually coded and categorized reviews to summarize UX issues.
• Innovations:
  • Employed a hybrid data-driven approach combining automated classification and qualitative analysis, significantly improving data analysis efficiency.
  • For the first time, revealed extensive and in-depth UX issues with cryptocurrency wallets and proposed design recommendations.

Research Findings

• Findings:

  • Common UX Issues:
    • Performance issues (e.g., app crashes, lag) causing users to lose access to their assets.
    • Interface issues (e.g., missing buttons, double-submitting transactions) leading to severe financial losses.
  • Domain-Specific UX Issues:
    • Users struggle to understand transaction fee structures and transparency, mistakenly believing wallet developers set high fees.
    • Widespread misunderstandings of certain cryptocurrency features (e.g., dynamic addresses, irreversible transactions).
    • Poor recovery functionality (e.g., inability to retrieve funds after losing mnemonic phrases).
    • Lack of guidance during payment processes, such as transaction fees, wallet initialization, and private key imports.
  • User Misunderstandings:
    • Users compare cryptocurrency transactions to traditional payment systems, expecting similar features (e.g., transaction reversal, adjustments).
    • Misconceptions that wallet developers have direct control over transaction status and fees.
  • Trust and Privacy Issues:
    • Users question the motives of wallets and developers, perceiving insufficient security features or even potential scams.
    • Concerns about privacy violations related to features such as mnemonic phrase management and app permissions.

• Experiments and Evaluation:

  • The automated classification method was highly effective, with the classifier's high accuracy significantly reducing the burden of manual review.
  • Data indicated that a lack of understanding of UX and user expectations could significantly impact user trust and wallet usage.

• Advantages:

  • Compared to existing research, provided a more comprehensive categorization and deeper insights into cryptocurrency wallet UX issues.
  • Established a strong connection between user misunderstandings and technical realities, offering practical design improvement suggestions.

• Limitations and Future Directions:

  • Limitations:
    • Only analyzed reviews of five non-custodial mobile wallets, excluding desktop wallets or all cryptocurrency types.
    • Automated classification may have missed some potentially important issues.
  • Future Directions:
    • Further exploration of UX in other types and platforms of cryptocurrency wallets.
    • Design domain-specific usability heuristics for cryptocurrencies.
    • Investigate the relationship between building user trust and improving UX.

The analysis is clear and reveals the challenges of optimizing user experience in mobile cryptocurrency wallets. It emphasizes providing practical and actionable design recommendations, offering significant theoretical and practical value.