Challenges of Music Score Writing and the Potentials of Interactive Surfaces

Title of the Paper

Challenges of Music Score Writing and the Potentials of Interactive Surfaces

Bibliographic Information

• Domain: Human-Computer Interaction (HCI), Music Composition Technology
• Keywords: Digital pen, multi-touch interaction, handwriting input, music engraving, music composition support tools

Research Background and Issues

• Issues or Challenges:

  • Current music notation software is geared towards structured editing, enforcing notation rules, which supports music engraving well but lacks flexibility during the creative process.
  • Composers often face constraints when using existing desktop software, especially during the drafting phase. Additionally, they frequently switch between paper and digital tools, causing transitional friction.
  • Some professional composers believe that existing software fails to effectively support the iterative creative process, such as expressing intermediate ideas, quickly modifying, and editing certain notation elements.

• Significance:

  • Modern music composition requires balancing structured notation rules with flexible creative needs. Addressing these issues is crucial for enhancing composers' creative processes and significantly improving work efficiency and quality.

• Research Motivation and Related Work:

  • Previous studies (e.g., the application of the "Cognitive Dimensions of Notations" framework) have revealed the cognitive burden of music notation systems.
  • Some literature has explored system designs based on pen interaction to support creative ideation and notation efficiency, but their functionality is limited, such as merely simplifying symbol input without addressing bottlenecks in overall interaction modes.

Proposed Solution

• Method and Innovations:

  • Utilizing interactive surfaces (supporting pen and multi-touch input) combined with a novel interaction mode design to resolve the contradiction between flexibility and structure in notation software.
  • Advocating for temporarily breaking the inherent structure of notation software to enhance flexibility, such as allowing handwritten annotations, audio recordings, and more granular manipulation of score elements.

• Implementation Steps and Key Techniques:

  • Phase 1: Conduct interview-based analysis research (interviewing 9 professional composers) to uncover their experiences and challenges in using notation software during the creative process.
  • Phase 2: Systematically analyze composers' workflows using the "Cognitive Dimensions of Notations" framework to extract structural issues and operational efficiency bottlenecks.
  • Design Directions:
    1. Deconstruct Music Elements: Enable composers to more precisely select and manipulate notation elements, such as copying specific segments by rhythm or pitch.
    2. Break Homogeneity of Scores: Provide nonlinear content insertion options (e.g., handwritten annotations, audio clips) to capture a broader range of creative ideas.
    3. Disrupt Linear Structure of Scores: Design a free canvas mode to facilitate comparison, version management, and integration testing of different segments.

Research Outcomes

• Specific Outcomes:

  • The paper proposes a redesign of notation software through interactive surfaces, temporarily breaking the inherent structure of scores to support composers' creative needs.
  • It provides three core design directions, each addressing different creative issues (e.g., lack of flexibility, insufficient tools for creative expression).

• Advantages:

  • Compared to existing solutions (such as traditional desktop software or handwriting-based software), the new interactive system can simultaneously support structured output and flexible creative input.
  • The proposal removes overly rigid operational steps while accommodating composers' unique workflows.

• Experimental or Evaluation Results:

  • Feedback from composer interviews indicates that current tools severely lack support for creative work, and the proposed design directions are considered feasible and highly promising solutions.

• Limitations and Future Directions:

  • Limitations:
    1. Potential technical challenges of interactive surfaces, such as precision and responsiveness of pen and multi-touch inputs.
    2. Compatibility of the design with current notation software's user cognitive habits and training costs.
  • Future Directions:
    1. Further exploration of voice interaction possibilities to support seamless music composition recording.
    2. Integration of the new design into existing software ecosystems while strengthening research on multimodal interaction systems.
    3. Expansion into collaborative research in other artistic creation fields to validate the design's universality.

Overall, this study proposes significant directions to overcome the limitations of traditional music notation and composition tools, offering forward-looking insights and practical implementation suggestions for the future development of music composition technology.