Search papers, labs, and topics across Lattice.
The paper introduces Neural Electromagnetic Fields (NEMF), a framework for reconstructing spatially-varying material properties of a scene to create functional digital twins. NEMF disentangles the ill-posed inverse problem of material parameter estimation by first using high-fidelity geometry from images to resolve the ambient electromagnetic field. This disentanglement, combined with a differentiable physics-based reflection model, allows a decoder to learn a continuous representation of material parameters from RF signals. Experiments on synthetic datasets demonstrate accurate material parameter reconstruction and high-fidelity physical simulation using the resulting functional digital twin.
Unlock functional digital twins: NEMF disentangles the notoriously ill-posed problem of reconstructing spatially-varying material properties from remote signals by anchoring on image-derived geometry, enabling accurate material map reconstruction and high-fidelity physical simulation.
Creating functional Digital Twins, simulatable 3D replicas of the real world, is a central challenge in computer vision. Current methods like NeRF produce visually rich but functionally incomplete twins. The key barrier is the lack of underlying material properties (e.g., permittivity, conductivity). Acquiring this information for every point in a scene via non-contact, non-invasive sensing is a primary goal, but it demands solving a notoriously ill-posed physical inversion problem. Standard remote signals, like images and radio frequencies (RF), deeply entangle the unknown geometry, ambient field, and target materials. We introduce NEMF, a novel framework for dense, non-invasive physical inversion designed to build functional digital twins. Our key insight is a systematic disentanglement strategy. NEMF leverages high-fidelity geometry from images as a powerful anchor, which first enables the resolution of the ambient field. By constraining both geometry and field using only non-invasive data, the original ill-posed problem transforms into a well-posed, physics-supervised learning task. This transformation unlocks our core inversion module: a decoder. Guided by ambient RF signals and a differentiable layer incorporating physical reflection models, it learns to explicitly output a continuous, spatially-varying field of the scene's underlying material parameters. We validate our framework on high-fidelity synthetic datasets. Experiments show our non-invasive inversion reconstructs these material maps with high accuracy, and the resulting functional twin enables high-fidelity physical simulation. This advance moves beyond passive visual replicas, enabling the creation of truly functional and simulatable models of the physical world.
