Search papers, labs, and topics across Lattice.
This paper introduces CABLE, a cloud-assisted encoding framework that optimizes communication between edge devices and cloud-hosted large multimodal models (LMMs) for Vehicle-to-Everything (V2X) systems. By leveraging ego-motion compensation and residual-motion cues, CABLE efficiently transmits only relevant region-of-interest (ROI) images, significantly reducing bandwidth usage and improving prefill latency. Experiments demonstrate that CABLE achieves a 73-87% reduction in ROI pixel coverage while maintaining a reasonable trade-off in detection quality, resulting in a 5-8x speedup in LMM prefill times across multiple datasets.
CABLE slashes communication overhead by up to 87% while accelerating cloud-side processing for V2X perception systems.
Cloud-hosted large multimodal models (LMMs) can provide strong open-vocabulary perception for Vehicle-to-Everything systems, but naively transmitting full-resolution frames from edge to cloud causes severe communication overhead and high cloud-side prefill latency. We present CABLE, a cloud-assisted bandwidth-efficient LMM-based encoding framework for edge-cloud perception. CABLE propagates the previous cloud segmentation mask on the edge using ego-motion compensation, refines it with residual-motion cues, and consolidates disconnected regions via a corridor envelope to form a robust region of interest (ROI). Only ROI-masked images are uploaded, while the cloud segmentation output is fed back as the prior for the next frame, forming a mask-to-ROI-to-LMM feedback loop. Experiments on five datasets (nuScenes, WOD-ZB, Waymo, KITTI, and CADC) show consistent communication savings while largely preserving perception, achieving $73$--$87\%$ ROI pixel-coverage reduction with $5$--$8\times$ estimated LMM prefill speedup at a modest detection-quality trade-off relative to full-frame inference.
