Search papers, labs, and topics across Lattice.
SAFE-Cascade is an interactive system designed for cost-adaptive chart question answering that intelligently decides when to invoke a vision-language model (VLM) based on the complexity of the query. By first extracting text from charts using OCR and providing provisional answers through a text-only model, it routes queries to a VLM only when necessary, achieving a balance between accuracy and cost-efficiency. In a test of 375 examples, SAFE-Cascade matched the performance of a full-VLM approach while reducing VLM usage by 26.9% and estimated costs by 9.3%, demonstrating the potential for more efficient multimodal systems.
Achieving nearly identical accuracy to full-VLM systems while slashing invocation rates and costs by nearly 30% could redefine efficiency in multimodal AI applications.
Vision-language models (VLMs) are powerful for chart question answering, but invoking a VLM for every query can be unnecessarily expensive when many questions are answerable from OCR text and lightweight language reasoning. We demonstrate SAFE-Cascade, an interactive system for cost-adaptive chart question answering. Given a chart image and a natural-language question, SAFE-Cascade first extracts chart text with OCR, obtains a provisional answer from a text-only language model, and then uses a learned router to decide whether to accept the text answer or escalate to a VLM. The demo exposes this decision process to users: OCR evidence, text-only answer, routing probability, escalation decision, final answer, estimated cost, and estimated latency are shown side by side. SAFE-Cascade is designed as a transparent interface for understanding when visual grounding is actually needed. Users can upload or select charts, ask questions, inspect the evidence used by each pathway, compare text-only and VLM answers, and adjust the escalation threshold to explore the accuracy-cost frontier. The system is implemented with Azure Document Intelligence for OCR, gpt-5-mini as the text-only model, gemini-2.5-flash-image as the VLM, and a Random Forest router trained on inference-time features. On a held-out ChartQA test split of 375 examples from a 2,500-example experiment, SAFE-Cascade achieves 69.1% unified accuracy with 73.1% VLM invocation, compared with 67.7% accuracy and 100% VLM invocation for the full-VLM baseline. The observed +1.4 percentage-point difference is statistically uncertain, so we interpret SAFE-Cascade as matching full-VLM performance while reducing VLM calls by 26.9% and estimated cost by 9.3%. The demonstration shows how selective modality routing can make multimodal knowledge systems more transparent, tunable, and cost-aware.
