Search papers, labs, and topics across Lattice.
This study surveys over 200 VIS4ML papers to elucidate how human knowledge is integrated into machine learning workflows through visual analytics. By employing a coding scheme that categorizes contributions from four perspectives鈥攃haracteristics of ML, visualization, interaction, and actions鈥攖he authors reveal distinct pathways for knowledge transfer facilitated by interactive visualization. The findings underscore the advantages of visual analytics in enhancing the effectiveness of ML workflows, supported by a conceptual model and an information-theoretic cost-benefit analysis.
Human knowledge injection into ML workflows via visual analytics is not just beneficial; it reshapes how we understand model building and optimization.
Visual analytics (VA) plays an increasingly important role in supporting machine learning (ML) workflows. In the field of visualization, such approaches and techniques are referred to as VIS4ML. While ML models are mostly learned automatically, the corresponding ML workflows receive a variety of human inputs, such as data labelling, feature engineering, model architecture designing, hyper-parameter tuning, and so on. In this work, we surveyed over 200 VIS4ML papers to gain an understanding of how humans inject their knowledge into ML workflows through interactive visualization. We collected a corpus of VIS4ML papers from the IEEE VIS conferences in the past decade. We developed a coding scheme to facilitate the literature research from four perspectives: characteristics of ML, visualization, interaction, and actions. The analysis of the coded dataset allows us to observe different pathways that transfer human knowledge to ML workflows via interactive visualization. Building on the analysis, we explain the phenomena of VIS4ML using the conceptual model that views VA as model building and the information-theoretic cost-benefit analysis that reasons VA as for optimizing ML workflows. This work provides unequivocal evidence showing the merits of using VA in ML workflows. The full list of surveyed papers, along with all analysis results and figures, is available at https://vis4ml4hd.github.io/ml-knowledge-inject-va/.
