Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Generative Animations, a system that leverages LLMs and SAM to automate the creation of animations from natural language prompts. The pipeline parses prompts with LLMs, grounds them visually using SAM, and generates motion paths that consider scene geometry, occlusions, and perspective. The system is demonstrated through contour-following, orbital, and perspective-aligned animation use cases, showcasing its ability to produce production-ready animations directly from text.
Forget tedious Bézier curves: this system crafts complex, production-ready animations directly from natural language prompts, automatically handling occlusions and perspective.
Animation elevates digital documents into immersive experiences, yet creating custom motion paths remains cumbersome, requiring designers to manually select presets, plot Bézier points, and configure timing properties. We introduce Generative Animations, a system that transforms natural language prompts into production-ready animations. By chaining Large Language Models (LLMs) for semantic parsing with the Segment Anything Model (SAM) for visual grounding, our pipeline automatically generates motion paths that respect scene geometry, handle depth-based occlusions, and honor 3D perspective transforms. We demonstrate the system through three use cases: contour-following trajectories, orbital animations with z-order awareness, and perspective-aligned motion on transformed objects.