Search papers, labs, and topics across Lattice.
This paper introduces a novel hypernetwork architecture that simultaneously generates latent features and the weights and biases for a Multi-Layer Perceptron (MLP) decoder, eliminating the need for per-material gradient descent optimization in neural texture compression. The authors demonstrate that their method achieves comparable quality to existing state-of-the-art texture compressors while significantly improving efficiency. Additionally, the hypernetwork can infer multiple decoders simultaneously and facilitate super-resolution, showcasing its versatility in texture representation tasks.
A single hypernetwork can replace complex optimization processes in texture compression, achieving high-quality results while enabling simultaneous decoder inference and super-resolution.
Recent work on neural texture compression has demonstrated that it is possible to learn small, per-material texture representations (composed of latent textures and a small Multi-Layer Perceptron decoder) that can be decoded in real-time during shading to reproduce the input to a physically based shading model. However, existing methods require performing gradient-descent optimization per material for a given MLP and latent configuration. In this work, we train a single hypernetwork that outputs both the latent features and the MLP's weights and biases. Though the solution space is high-dimensional, this approach produces results comparable in quality to the current reference neural texture compressors. We further extend this approach to infer multiple decoders at once or even produce decoders that learn super-resolution.