Search papers, labs, and topics across Lattice.
This paper introduces ShutterMuse, a multimodal large language model (MLLM) designed to enhance real-time photography guidance by addressing both camera framing and subject pose recommendations. The authors create CaptureGuide-Bench, a benchmark that evaluates the model's performance on photographer-side composition decisions and subject-side pose recommendations, revealing that while general-purpose MLLMs excel in composition, they struggle with precise localization and actionable pose guidance. ShutterMuse outperforms existing baselines in photographer-side tasks and offers competitive subject-side recommendations at a lower inference cost, highlighting its potential as an interactive photography assistant during capture.
ShutterMuse redefines photography guidance by combining composition and pose recommendations, outperforming existing models while cutting inference costs.
Real-world photography requires capture-time guidance for both camera framing and subject pose. Yet existing aesthetic cropping benchmarks mainly evaluate post-hoc crop prediction and overlook subject-side recommendations, leaving the capture-time guidance capabilities of multimodal large language models (MLLMs) underexplored. To address this gap, we introduce CaptureGuide-Bench, a benchmark with two complementary tasks: photographer-side composition decision and refinement, and subject-side scene-conditioned pose recommendation. Our evaluation reveals limitations: general-purpose MLLMs can make composition decisions but lack precise refinement localization, while specialized aesthetic cropping models localize crops effectively but are limited to refinement; neither provides actionable pose guidance. To support model development, we further construct CaptureGuide-Dataset, comprising 130K samples with textual rationales and structured visual annotations, and develop ShutterMuse, a unified MLLM trained with supervised and reinforcement fine-tuning. Experiments on CaptureGuide-Bench show that ShutterMuse achieves the best overall photographer-side performance among evaluated baselines and competitive subject-side pose recommendation with substantially lower inference cost, demonstrating the potential of MLLMs as interactive assistants for photography during image capture.
