Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the limitations of Semantic Web of Things (SWoT) platforms in expressing similarity beyond strict ontological equivalence by introducing a multimodal embedding layer that encodes 3D point clouds, temporal attributes, and semantic labels into latent vector representations. The proposed framework allows for hybrid ontology-vector queries, effectively combining graph-based filtering with multimodal similarity search, particularly in the context of 3D digital twins for telecom infrastructure and industrial IoT. Evaluation on the S3DIS dataset shows that this approach not only enhances search capabilities under temporal and relational constraints but also provides sufficient representations for downstream predictive tasks using general-purpose pretrained encoders.
Hybrid ontology-vector queries can revolutionize how we search and analyze 3D digital twins in rapidly evolving IoT environments.
Semantic Web of Things (SWoT) platforms model physical infrastructure as knowledge graphs typed against domain ontologies, enabling expressive structural and logical queries. However, they lack native mechanisms to express similarity beyond strict ontological equivalence, which represents a critical gap for 3D digital twins in domains such as telecom infrastructure and industrial IoT, where queries must combine ontological constraints with multimodal similarity search over heterogeneous, temporally-evolving scene data. We propose a framework that extends SWoT platforms with a multimodal embedding layer: ontology-typed entities comprising 3D point clouds, temporal attributes, and semantic labels are encoded into latent vector representations stored alongside the knowledge graph, enabling hybrid ontology-vector queries that combine graph-based filtering with similarity search. Implemented on Orange Research's Thing'in platform with the Clock-G temporal graph database, a feasibility evaluation on S3DIS demonstrates that graph filtering effectively restricts the search pool under temporal and relational constraints, and that general-purpose pretrained encoders produce representations sufficient for similarity retrieval and as a preliminary encoding step for downstream predictive tasks.