Search papers, labs, and topics across Lattice.
This paper introduces the Hilti-Trimble-Oxford Dataset, a comprehensive visual-inertial benchmark designed for Simultaneous Localization and Mapping (SLAM) and localization in construction environments. Collected over eight months at an active construction site, the dataset includes thirty sequences that capture real-world challenges such as variable lighting and dynamic workers, with ground truth trajectories established using a high-quality LiDAR-inertial SLAM system. The accompanying research challenge attracted 62 teams for SLAM, underscoring the dataset's potential to advance the field despite the noted difficulties in achieving accurate localization in construction settings.
A new dataset reveals that even state-of-the-art SLAM systems struggle with localization accuracy in dynamic construction environments, highlighting ongoing challenges in the field.
Automated progress monitoring on construction sites is an active area of research and development. Robot and human-carried mapping systems have been developed to build 3D maps of building and infrastructure projects. While LiDAR-based mapping systems achieve high accuracy, the cost of LiDAR can be prohibitive. Consumer-grade cameras with wide field of view ("360 cameras") combined with embedded inertial measurement units (IMUs) provide a cost-effective alternative. To support change detection and progress monitoring, highly accurate visual Simultaneous Localization and Mapping (SLAM) and floor plan-referenced localization systems are required. In this paper we present a high-quality dataset collected at an active construction site, which captures realistic challenges such as variable lighting conditions, moving workers, fast motions, and repetitive structures. The dataset offers thirty visual-inertial sequences recorded across seven floors over an eight-month period of the construction project. Ground truth trajectories were collected using a high quality LiDAR-inertial SLAM system rigidly attached to the 360 camera. Additionally, we report the results of an open research challenge evaluating the best visual SLAM and localization systems from around the world. The Challenge attracted substantially higher participation in SLAM, with 62 teams compared to 22 in floor-plan-referenced localization, reflecting the broader maturity of SLAM methods. The higher errors in localization further highlight the difficulty of this task in construction and point to the need for continued research, which this dataset is intended to support. The dataset and the benchmark are publicly available at: https://hilti-trimble-challenge.com/dataset-2026.
