Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a novel unsupervised learning approach for generating visual textures using a maximum entropy model constrained by learned statistics, rather than relying on hand-designed features or pretrained networks. By employing generative diffusion techniques, the authors demonstrate that their model, which utilizes only 512 statistics, can produce texture images of comparable or superior quality to existing models that use approximately 177,000 statistics. The study further reveals that the representation space of their model allows for smooth interpolation between texture features, highlighting its advantages over traditional methods.
A compact model with just 512 learned statistics can outperform traditional texture generation methods that rely on 177,000 hand-crafted features.
Visual textures -- spatially homogeneous image regions containing repeated elements (e.g. a field of grass, the bark of a tree) -- are ubiquitous in visual scenes and provide important cues for recognizing and analyzing materials and objects. A number of existing texture models extract essential statistics from a single texture image, and can then generate high-quality samples that are visually similar to the original by matching these statistics. However, their statistics are either hand-designed or based on a network pretrained for another purpose (e.g., object recognition). Here, we develop the first principled method for unsupervised learning of a set of statistics that are used to constrain a maximum entropy probability model. We leverage methods developed for generative diffusion models to derive training and sampling procedures, and compare these to the traditional method of sampling via matching the statistics. Despite the compactness of our trained model (512 statistics), it generates texture images whose quality is as good as or better than the current state-of-the-art model (~177k statistics). A more direct comparison of the two models, obtained by synthesizing images that are indistinguishable for one model but maximally different for the other, reveals their relative strengths and weaknesses. Finally, we show that unlike previous statistical texture models, a straight trajectory in the representation space of our model generates homogeneous texture samples that interpolate smoothly between the features of the two end points.