Search papers, labs, and topics across Lattice.
This study introduces a vision-POI fusion framework that enhances residential building health assessments by integrating multi-view visual inspection with point-of-interest (POI) neighborhood context. By evaluating multiple object detection models and aggregating image outputs, the research identifies and categorizes housing-related issues across a dataset of over 25,000 inspection images from 3,237 buildings in Qingdao, China. The findings reveal that while multi-view aggregation significantly improves assessment accuracy (Macro-F1 score from 60.84% to 74.95%), the inclusion of POI context provides only modest additional benefits, highlighting its role as a supplementary rather than primary source of information.
Multi-view aggregation boosts building health assessment accuracy by over 14%, but neighborhood context only adds a modest improvement, revealing its limited role in inspection.
Housing-level urban physical examination is essential for identifying residential building problems and supporting targeted urban renewal. Existing automated inspection studies primarily rely on individual images and rarely examine whether surrounding urban functional context can provide supplementary information for building-level assessment. This study proposes a vision-POI fusion framework that combines multi-view visual inspection with POI-derived neighborhood context for residential building health assessment. The empirical dataset covers 92 old residential communities, 3,237 residential buildings, and 25,608 field-acquired inspection images in Qingdao, China, encompassing seven categories of housing-related issues. First, multiple object detection models are evaluated to extract issue locations, categories, and confidence scores from individual images. The image-level outputs are subsequently aggregated across multiple views to construct interpretable building-level representations. Second, POI features are extracted within 500m, 1,000m, and 1,500m neighborhood buffers to characterize surrounding functional environments. Pearson and Spearman correlation analyses, combined with false discovery rate correction, are used to identify candidate contextual features. Finally, visual and POI features are integrated using a cost-sensitive Random Forest classifier under community-isolated spatial cross-validation. The results show that multi-view aggregation provides the main performance improvement, increasing the building-level Macro-F1 from 60.84% under Direct Detection to 74.95%. Incorporating POI context further increases Macro-F1 to 76.79%, although the additional gain is modest and category-dependent. POI information therefore functions as a supplementary contextual prior rather than a substitute for direct visual evidence or a causal determinant of building condition.
