Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Addressing the hardware barriers of deploying attention mechanisms on resource-constrained orbital edge devices, the authors develop TriCCOT, a hybrid detection architecture that unifies a convolutional proposal network, a conformal box-expansion module, and an FPGA-optimized attention classifier. The pipeline employs conformal prediction to provide distribution-free probabilistic coverage guarantees over candidate crops before passing them to Aper-GATES, which replaces softmax self-attention with convolutional projections and channel-gated operations. Evaluated on the DIOR and VDVRaw benchmarks, the model exhibits heightened robustness to blur and raw sensor noise while achieving zero-modification deployment on an off-the-shelf Xilinx Versal VCK190 DPU.
Transformers no longer require specialized silicon to run in orbit: reformulating self-attention into gated convolutional projections enables robust, noise-resilient visual attention directly on off-the-shelf CNN edge accelerators.
Onboard object detection in Earth observation is constrained by limited computational resources and the absence of fully corrected imagery. While convolutional detectors are hardware-efficient, they often struggle to extract robust representations from raw and noisy data. Conversely, transformer-based models provide stronger global reasoning capabilities but remain difficult to deploy on FPGA accelerators due to quadratic attention complexity and non-compatible operations. We introduce TriCCOT, a tri-part architecture for robust and deployable onboard object detection. TriCCOT combines a convolutional region proposal network, a conformal prediction stage, and Aper-GATES, our hardware-friendly attention-based classifier. The region proposal network generates candidate bounding boxes, which are subsequently enlarged via conformal prediction, providing a distribution-free probabilistic coverage guarantee. The resulting crops are processed by Aper-GATES, which reformulates self-attention through convolutional projections, global channel statistics, and hardware-friendly gating operations, avoiding standard transformer operations that are poorly suited to CNN-oriented accelerators. Experiments on the DIOR and VDVRaw datasets demonstrate competitive detection performance and improved robustness to spatial blur and signal-dependent noise when compared to FPGA-compatible architectures. Finally, we report full deployment on a Xilinx Versal VCK190 FPGA without modifying the underlying DPU architecture, enabling unified CNN-Transformer inference for spaceborne embedded applications.