Search papers, labs, and topics across Lattice.
This study evaluates the performance of the Qwen2.5-VL-7B-Instruct model for reading analog gauges through zero-shot prompting, in-context learning, and parameter-efficient fine-tuning using Quantized Low-Rank Adaptation (QLoRA). The findings reveal that while the model achieves low mean percentage errors (MPE) on various datasets, significant transfer degradation occurs when applied to held-out data, and robustness tests indicate that Gaussian blur is a critical challenge. The research underscores the model's potential for specialized gauge reading but highlights its limitations in reliability for safety-critical applications.
Despite achieving impressive accuracy, the model's performance falters significantly on unseen data, raising concerns about its reliability in real-world applications.
Analog gauges remain common in industrial environments where manual inspection is costly or hazardous. The engineering application addressed here is direct numerical reading of single-target analog-gauge images, while the artificial-intelligence contribution is a systematic evaluation of specialization, transfer, robustness and reliability for a general-purpose vision-language model (VLM) without an explicit pointer-segmentation and geometric-reading pipeline. The Qwen2.5-VL-7B-Instruct model is evaluated using zero-shot prompting, in-context learning (ICL) and parameter-efficient fine-tuning with Quantized Low-Rank Adaptation (QLoRA) on a public synthetic dataset, a video-derived Pressure Gauge dataset and a proprietary industrial dataset. All fine-tuning experiments use a fixed 20-epoch protocol with the final epoch used for analysis; separate models with and without supplied gauge ranges remove prompt-setting confounds. The primary metric is range-normalized mean percentage error (MPE). The best fine-tuned MPE values are 2.39% on the synthetic dataset, with a 95% bootstrap confidence interval (CI) of 1.43-3.90%; 2.61% on the Pressure Gauge dataset, with a CI of 1.66-3.80%; and 4.43% on the proprietary industrial dataset, with a CI of 2.31-7.14%. Leave-one-dataset-out experiments reveal substantial transfer degradation on held-out synthetic and proprietary data, while robustness tests identify Gaussian blur as the strongest tested corruption. Reliability analysis shows that high-confidence errors remain possible, motivating abstention and independent validation in safety-critical use. These results support QLoRA-specialized VLMs for direct single-gauge reading but not yet a deployment-ready plant-monitoring pipeline.
