Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Brain-Grasp, a novel fMRI-based image reconstruction framework that leverages graph-informed saliency priors to improve object-level structure and semantic fidelity. The method extracts structural cues from brain signals using graph-based saliency to generate spatial masks, which are then combined with semantic embeddings to condition a single, frozen diffusion model. Results demonstrate improved conceptual alignment and structural similarity compared to existing multi-stage diffusion pipelines, offering a more efficient and interpretable approach to brain decoding.
Unlock more faithful fMRI-based image reconstructions by incorporating graph-informed saliency priors that capture the spatial arrangement of salient objects.
Recent progress in brain-guided image generation has improved the quality of fMRI-based reconstructions; however, fundamental challenges remain in preserving object-level structure and semantic fidelity. Many existing approaches overlook the spatial arrangement of salient objects, leading to conceptually inconsistent outputs. We propose a saliency-driven decoding framework that employs graph-informed saliency priors to translate structural cues from brain signals into spatial masks. These masks, together with semantic information extracted from embeddings, condition a diffusion model to guide image regeneration, helping preserve object conformity while maintaining natural scene composition. In contrast to pipelines that invoke multiple diffusion stages, our approach relies on a single frozen model, offering a more lightweight yet effective design. Experiments show that this strategy improves both conceptual alignment and structural similarity to the original stimuli, while also introducing a new direction for efficient, interpretable, and structurally grounded brain decoding.