Search papers, labs, and topics across Lattice.
This paper investigates the use of prompt-side preprocessing to enhance the accuracy of local language models (LLMs) in interpreting IoT sensor data for environmental monitoring. By transforming raw sensor readings into enriched textual representations, the authors demonstrate significant improvements in local model accuracy, achieving increases from 50.9% to 81.7% indoors and from 63.7% to 89.3% outdoors. The findings indicate that this lightweight preprocessing approach effectively narrows the performance gap between local and cloud models while maintaining low latency for real-time analytics.
Local LLMs can achieve cloud-level accuracy with prompt-side preprocessing, dramatically boosting performance while keeping latency low.
Large language models (LLMs) offer a natural-language interface for interpreting Internet of Things (IoT) sensor data in smart environments; however, cloud deployment introduces latency, privacy, and connectivity concerns. Local LLMs can reduce these limitations, but compact edge-deployable models often show weaker numerical reasoning when raw sensor readings are provided directly. This paper investigates whether prompt-side preprocessing can improve the accuracy-latency trade-off of local LLMs for environmental monitoring. We propose a structured prompt construction framework that transforms raw air-quality and thermal-comfort measurements into progressively enriched textual representations: raw sensor values, threshold-aware descriptions, and compact environmental summary flags. The approach is evaluated using indoor Raspberry Pi/BME680 datasets from Tampere University and outdoor air-quality datasets from Helsinki, Katowice, and Warsaw. We construct a binary LLM query dataset covering air quality, thermal comfort, and joint environmental conditions, and evaluate five local and five cloud LLMs across three prompt variants and two inference modes, with and without chain-of-thought prompting. Results show that prompt enrichment substantially improves local-model accuracy. In No-CoT mode, local accuracy increases from 50.9% to 81.7% indoors and from 63.7% to 89.3% outdoors from the raw to the most enriched prompt. Local No-CoT inference is the fastest configuration, with mean latency close to 0.22 s, while CoT substantially increases inference time. These findings suggest that lightweight prompt-side preprocessing can narrow the local--cloud performance gap and support low-latency IoT analytics in smart environments.
