Breaking Out of the Ivory Tower: A Large-scale Analysis of Patent Citations to HCI Research

Title of the Paper

Breaking Out of the Ivory Tower: A Large-scale Analysis of Patent Citations to HCI Research

Paper Information

• Subject Area: Industrial impact and technology transfer of Human-Computer Interaction (HCI) research
• Keywords: Human-Computer Interaction, technology transfer, translational science, patents, citation analysis, industrial impact

Research Background and Problem

• Identified Problems or Challenges:

  • The industrial impact of HCI research has been a focal point of study and debate. Some studies argue that HCI research struggles to translate into practice, while others suggest that HCI has a significant impact on industry.
  • There is currently a lack of comprehensive quantitative metrics to evaluate the industrial impact of HCI research, particularly in terms of technology transfer as measured by patent citations to academic research.

• Importance:

  • HCI is a highly applied field, with many studies aiming to provide design prototypes and practical guidance. However, the industrial translation of research in this field and the pathways it follows remain unclear. This raises questions about the efficiency of connections between academia and practice.

• Research Motivation and Related Work:

  • The motivation lies in bridging the gap between research and practice by using patent citation analysis to measure the extent to which HCI research attracts industrial attention.
  • Related work includes qualitative analyses of technology transfer (e.g., interviews, case studies) and studies that use patent citations to quantify the technological impact of research. However, no prior large-scale quantitative analysis has been conducted in the HCI field.

Solution

• Proposed Research Method or Solution:

  • Employ a novel approach that spans scientific and technological innovation literature, quantifying the practical impact of HCI research on a large scale by analyzing the citation relationships between U.S. patents and academic research.
  • Data sources include Microsoft Academic Graph, Semantic Scholar, and the U.S. Patent and Trademark Office (USPTO), which are combined to construct a citation graph linking patents to academic papers.

• Innovative Aspects:

  • This is the first attempt to use patent citation data as a quantitative metric to conduct a large-scale analysis of how HCI research connects with industry.
  • A cross-disciplinary method is proposed to measure the translation of academic outcomes, offering open data support for future research.

• Implementation Steps and Key Techniques:

  • Data Preprocessing: Filter HCI conferences within the scope of analysis (e.g., CHI, CSCW, UIST, UbiComp) and clean the data to ensure accuracy.
  • Data Integration: Match patents, academic papers, and citation network data.
  • Patent Citation Analysis: Perform statistical analysis of patent citation rates for HCI papers, time lags between papers and patents, popular research topics, and characteristics of citing organizations.

Research Findings

• Specific Findings:

  • Across the four major HCI conferences analyzed (CHI, CSCW, UIST, UbiComp), 20.1% of academic papers were cited by patents, significantly exceeding the overall citation rate of 1.5% in science and 7.7% in biomedical fields.
  • The average time lag for HCI research papers to be cited by patents was 10.5 years, and this lag has been increasing over time.

• Advantages Over Existing Solutions:

  • The industrial impact of HCI research is far higher than that of most scientific fields. Certain areas, such as user interface technology (UIST), exhibit citation rates as high as 80%, demonstrating strong practical relevance.
  • By quantifying patent citations, the study identifies specific HCI research topics that attract industrial attention (e.g., system interaction, input technologies) and those that have less impact (e.g., theory, social design).

• Experimental or Evaluation Results:

  • Analysis of cited topics revealed that patents are more likely to reference research related to system interaction and input technologies rather than theoretical or socially-oriented design research.
  • Patent systems tend to cite older research, while the impact of the latest studies has yet to fully materialize.

• Limitations and Future Directions:

  • Limitations: Patent citations cannot perfectly capture industrial impact, as they may overlook industry practices not expressed through patents. Additionally, patent data primarily covers the U.S., which may limit global applicability.
  • Future Directions: Explore additional metrics (e.g., design patterns, open-source contributions) to quantify the industrial impact of HCI research; further evaluate patent quality (e.g., frequency of patents being cited by other patents); and enhance qualitative validation of the translation process.

The above summary organizes the key information and core contributions of the paper in a structured manner, facilitating further understanding and research.