Search papers, labs, and topics across Lattice.
This paper introduces a decoupled vision-language pipeline for automated industrial inspection, specifically for wind turbine blade defects, comprising a YOLO-based detector, a spatial encoding module, and a QLoRA-fine-tuned Qwen-2.5-1.5B model for structured report generation. The system uses Retrieval-Augmented Fine-Tuning (RAFT) to ground recommendations in indexed maintenance procedures. Experiments demonstrate that this specialized pipeline significantly outperforms a monolithic vision-language model in terms of BLEU-4 score (0.41 vs 0.07), hallucination rate (4% vs 65%), and expert evaluation (8.6/10 vs 3.3/10), while running efficiently on a single GPU.
A small, fine-tuned language model can generate higher-quality industrial inspection reports than a massive generalist model, given the same visual evidence.
Automated industrial inspection requires both precise defect localization and structured maintenance report generation; in current practice these tasks are handled separately, with linguistic interpretation left to human experts. This paper describes a decoupled, edge-deployable pipeline for wind turbine blade inspection built from three components that each handle a distinct sub-task. The Eyes a YOLO26-x-obb oriented bounding-box detector localizes defects at dataset-native resolution. The Bridge a deterministic, parameter-free encoding module maps each detected bounding box to grid-referenced spatial tokens embedded in a structured prompt. The Brain a 4-bit quantized Qwen-2.5-1.5B model adapted with Quantized Low-Rank Adaptation (QLoRA) on 947 synthetically generated maintenance reports generates a structured JSON report from that prompt. Retrieval-Augmented Fine-Tuning (RAFT) further grounds each recommendation in indexed maintenance procedures. Five ablation experiments, scored by BLEU-4, ROUGE-L, Hallucination Rate (HR), and an LLM-as-a-Judge rubric, compare the pipeline against a monolithic vision-language model (VLM) baseline and against partial configurations in which one component is removed. The complete system achieves BLEU-4 0.41, HR=4%, and Expert Score = 8.6/10 compared with 0.07, 65%, and 3.3/10 for the zero-shot VLM baseline. The QLoRA-adapted 1.5B model generates higher-quality reports than a 671B-parameter generalist API model given identical detection evidence, at 47 tokens per second on a single T4-class GPU. The results show that purpose-built decoupled architecture with a small domain-specific training corpus outperforms a generalist end-to-end model on this structured generation task.