DeepFlow: A Flow-Based Visual Programming Tool for Deep Learning Development
Visual programming tools have recently been introduced to enable Deep Learning (DL) development without the need for expertise in traditional programming languages and frameworks. However, these tools often exhibit limitations in scalability for complex architectures and lack real-time debugging capabilities. This paper introduces DeepFlow, a flow-based visual programming tool (VPT) designed to address these challenges by leveraging the inherently visual nature of DL models as sequences of learnable functions. DeepFlow incorporates hierarchical abstraction mechanisms through ``supernodes'' to support model scalability, which is crucial for modern, complex architectures. Additionally, it introduces interactive debugging in the model design phase, allowing developers to validate network architectures before execution. We conducted a user study with 16 DL developers, involving typical DL model design tasks. We assessed DeepFlow using quantitative usability metrics, and post-task interviews to evaluate user perceptions and workflow integration across different expertise levels. Results demonstrated high usability and user satisfaction, and highlighted DeepFlow's effectiveness for rapid model iteration and as a learning aid for complex DL architectures, while also identifying areas for improvement.
Research Questions / Practical Problems
Question signals indexed for this paper.
Research Questions
3- How can visual programming tools address scalability and real-time debugging limitations in deep learning model development?Category: Deep Learning Visual Programming and Architecture DebuggingSimilar questionsarrow_forward
- How can hypernode mechanisms help users simplify management and reuse of complex network architectures?Category: Deep Learning Visual Programming and Architecture DebuggingSimilar questionsarrow_forward
- Can real-time architecture validation and error feedback improve deep learning model design efficiency and accuracy?Category: Deep Learning Visual Programming and Architecture DebuggingSimilar questionsarrow_forward
Practical Problems
1- Experts outside computer science struggle to conveniently develop deep learning models.Category: Deep Learning Visual Programming and Architecture DebuggingSimilar questionsarrow_forward
- 100%
Skyline: Interactive In-Editor Computational Performance Profiling for Deep Neural Network Training
UIST '20· Interactive Data Visualization +1
- 80%
Towards Effective Foraging by Data Scientists to Find Past Analysis Choices
CHI '19· Interactive Data Visualization +1
- 80%
Emblaze: Illuminating Machine Learning Representations through Interactive Comparison of Embedding Spaces
IUI '22· Interactive Data Visualization +1
- 80%
CGAT-Net: Context-Aware Graph Attention Transformer Network for Scene Sketch Recognition
IUI '25· Interactive Data Visualization +1
- 80%
On-Device Interaction Mining
MobileHCI '25· Interactive Data Visualization +1
- 75%
Enabling Data-Driven API Design with Community Usage Data: A Need-Finding Study
CHI '20· Computational Methods in HCI
- 75%
Taking ASCII Drawings Seriously: How Programmers Diagram Code
CHI '24· Interactive Data Visualization +1
- 67%
Crystalline: Lowering the Cost for Developers to Collect and Organize Information for Decision Making
CHI '22· Human-LLM Collaboration +2
- 60%
Visualizing API Usage Examples at Scale
CHI '18· Interactive Data Visualization +1
- 60%
MultiTrack: Multi-User Tracking and Activity Recognition Using Commodity WiFi
CHI '19· Human Pose & Activity Recognition +1
Based on Jaccard similarity of research subtopics & professions (≥60%)