Search papers, labs, and topics across Lattice.
The paper introduces a Neural Operator-grounded Continuous Tensor Function Representation (NO-CTR) to overcome the limitations of discrete and linear mode-$n$ products in existing continuous tensor function representations. NO-CTR employs neural operators to directly map continuous core tensor functions to continuous target tensor functions, enabling a genuinely continuous representation and reducing discretization artifacts. The authors demonstrate NO-CTR's superior performance in multi-dimensional data completion across various data types, including multi-spectral images, color videos, Sentinel-2 images, and point clouds, and theoretically prove its ability to approximate any continuous tensor function.
Unlock the potential of continuous tensor representations with neural operators, achieving more faithful representations of complex real-world data and outperforming classic discrete and continuous tensor methods.
Recently, continuous tensor functions have attracted increasing attention, because they can unifiedly represent data both on mesh grids and beyond mesh grids. However, since mode-$n$ product is essentially discrete and linear, the potential of current continuous tensor function representations is still locked. To break this bottleneck, we suggest neural operator-grounded mode-$n$ operators as a continuous and nonlinear alternative of discrete and linear mode-$n$ product. Instead of mapping the discrete core tensor to the discrete target tensor, proposed mode-$n$ operator directly maps the continuous core tensor function to the continuous target tensor function, which provides a genuine continuous representation of real-world data and can ameliorate discretization artifacts. Empowering with continuous and nonlinear mode-$n$ operators, we propose a neural operator-grounded continuous tensor function representation (abbreviated as NO-CTR), which can more faithfully represent complex real-world data compared with classic discrete tensor representations and continuous tensor function representations. Theoretically, we also prove that any continuous tensor function can be approximated by NO-CTR. To examine the capability of NO-CTR, we suggest an NO-CTR-based multi-dimensional data completion model. Extensive experiments across various data on regular mesh grids (multi-spectral images and color videos), on mesh girds with different resolutions (Sentinel-2 images) and beyond mesh grids (point clouds) demonstrate the superiority of NO-CTR.
