Search papers, labs, and topics across Lattice.
This study introduces VEIL, a systematic investigation into how chart encodings affect the learned representations of CNN-based models in time-series classification. By analyzing similarity, transferability, and attribution, the authors reveal that models often rely on visual cues from chart design rather than underlying temporal patterns. Attention-guided training can reduce encoding sensitivity when identified, but may be ineffective or detrimental in its absence, suggesting that visualization design significantly influences model learning and necessitates a reevaluation of chart-based TSC methodologies.
Chart design can mislead vision models into learning visual cues instead of actual temporal patterns, fundamentally altering their performance.
Rendering time series as chart images for CNN-based classification has become increasingly common in time-series classification (TSC). However, it remains unclear whether models learn underlying temporal patterns or rely on encoding-specific visual cues introduced by chart design. We present VEIL: a systematic study examining how chart encodings influence learned representations through complementary analyses of similarity, transferability, and attribution. Attention-guided training appears to mitigate this effect when encoding sensitivity is consistently identified across diagnostics, but provides limited or negative benefit when such signals are absent. These findings position VEIL within the broader question of how machines perceive visualizations -- extending graphical perception from human readers to vision models -- and show that visualization design choices shape learned representations in ways that warrant treating chart-based TSC as a representation and measurement problem rather than a simple modeling decision.
