Search papers, labs, and topics across Lattice.
CoBrush addresses the limitations of single-shot and reactive robotic painting by framing multi-round human-robot co-painting as a decoupled semantic, spatial, and stroke-level execution pipeline. This hierarchical decomposition is critical because evolving human intent and iterative canvas modifications typically degrade the spatial coherence of monolithic or single-turn generative models. Real-world acrylic canvas experiments and user studies show that the framework yields significantly stronger semantic alignment, stable spatial progression, and higher perceived action plausibility over conventional single-turn baselines.
Physical robots can finally sustain coherent, multi-turn creative collaboration by decoupling evolving semantic intent from spatial grounding and stroke execution rather than relying on reactive single-shot rendering.
Embodied co-painting requires a robot to repeatedly update a shared physical canvas while human intent evolves over interaction. Existing reference-driven painters or reactive assistants are typically optimized for single-shot rendering or sketch completion, limiting their ability to sustain coherent multi-round collaboration or to construct complex, content-rich scenes over time. We present CoBrush, a hierarchical framework that formulates multi-round co-painting as a coordinated semantic, spatial, and execution process. By separating high-level intent inference from spatial grounding and stroke-level control, the system supports progressive scene development on real acrylic canvases. We evaluate the framework through real human-robot painting sessions, stress tests, and user studies. Compared to single-turn baselines, our approach achieves stronger semantic alignment, more stable spatial progression, and higher perceived plausibility of robot actions. These results demonstrate that structured multi-stage reasoning improves the coherence and robustness of interactive painting and supports the progressive development of content-rich physical artworks.