Scraps: Enabling Mobile Capture, Contextualization, and Use of Document Resources

Document Title

Scraps: Enabling Mobile Capture, Contextualization, and Use of Document Resources

Document Information

• Subject Area: Human-Computer Interaction and Information Management Tool Design
• Keywords: Mobile devices, microtasks, writing, information fragments, user study, information capture, cross-device interaction, document creation, contextualization

Research Background and Problem

• Identified Problem: Current mobile information capture tools result in fragmented information lacking context, making it difficult to efficiently utilize this information in subsequent document creation. This issue not only affects information organization and retrieval but also disrupts users' creative workflows.
• Research Significance: With the widespread use of mobile devices, people often need to capture information on mobile devices and create documents in desktop environments. However, existing tools do not adequately support this process. Addressing this challenge is crucial for improving the productivity of information workers.
• Research Motivation: Based on an analysis of existing literature and commercial tools (e.g., Evernote and Google Keep), the authors found that these tools fail to effectively link captured information with document creation tasks and lack flexible contextual organization support.
• Related Work:
  1. Research on information fragments has revealed the content, roles, and methods of information capture but focuses on desktop environments.
  2. Studies on mobile information capture highlight the diversity of capture methods but focus more on storage rather than task support.
  3. Commercial tools have shortcomings in storage and organization, particularly in linking information with tasks and supporting contextualization.

Solution

• Proposed Solution: The Scraps tool, consisting of a mobile application and a Microsoft Word sidebar, supports users in capturing information (e.g., images, text, and bookmarks) on mobile devices, adding context and organizational metadata to the information. In the desktop environment, the relevant information is automatically displayed as part of the document, allowing users to directly insert and utilize it.
• Innovations:
  1. Integrated Design: Combines mobile information capture with desktop information usage, providing a seamless capture-organization-usage workflow.
  2. Contextualization Support: In addition to user-provided contextual notes, Scraps can automatically infer environmental attributes of the captured information (e.g., time, location, nearby landmarks).
  3. Efficient Integration: Scraps simplifies the process of inserting information, reducing the need for users to switch between applications, thereby improving the writing flow.
• Implementation Steps and Technical Details:
  1. Information Capture: Scraps supports adding information using the camera, voice input, text input, and bookmark functionality; it uses the Bing API and mobile GPS to infer context.
  2. Contextualization and Organization: Users can add notes and metadata (e.g., project name, status), and Scraps provides intelligent context inference.
  3. Information Transfer: All captured information is stored in OneDrive and Azure, with the Word sidebar on the desktop synchronizing and displaying relevant information via API.
  4. Information Usage: Users can directly insert text or images from Scraps into Word, enabling rapid document creation.

Research Outcomes

• Specific Outcomes:
  1. Scraps enables users to seamlessly capture information on mobile devices and quickly use it on desktop environments.
  2. The tool significantly improves the efficiency of capturing, organizing, and integrating document resources.
  3. Users in the experiment generally gave positive feedback and high usability scores for Scraps (average SUS score of 73.86).
• Advantages Compared to Existing Tools: Compared to commercial tools like Google Keep, Scraps enhances the linkage between information and tasks, supports contextualization, and offers greater flexibility in usage.
• Experimental Evaluation Results:
  1. Participants captured a large amount of information resources (mainly photos, bookmarks, and text notes).
  2. Approximately 55% of captured information was associated with contextual notes, which were considered more valuable over time.
  3. Scraps effectively reduced the fragmentation of captured information and optimized the information integration process.
• Limitations and Future Directions:
  1. Limited User Scenarios: The experiment tested a single task (creating a guidebook), not covering broader information work needs.
  2. Importance of Contextualization: Currently, contextual features are less significant for short-term tasks but may prove more valuable over long-term use.
  3. Expansion Potential: Future work could extend Scraps' functionality to other application scenarios (e.g., slide creation, spreadsheet editing) and integrate intelligent recommendation systems to enhance task relevance.

Conclusion

Scraps is a comprehensive tool designed to address the gap between mobile information capture and desktop information usage. By optimizing information capture and contextualization and efficiently integrating it with document creation tasks, Scraps enhances the productivity of information workers. This research provides important insights for the development of cross-device information management and productivity-focused tools.