Search papers, labs, and topics across Lattice.
This paper introduces HeteroViT, a compact single-layer Vision Transformer designed for efficient real-time data reduction in next-generation X-ray detectors, addressing the challenge of managing terabytes of data generated by the LCLS-II facility. The model demonstrates versatility by successfully tackling both supervised classification tasks and self-supervised rare-event detection across different detector modalities, all while maintaining a uniform architecture that facilitates integration with existing hardware. The findings suggest that a single, adaptable model can significantly streamline data processing workflows, potentially reducing storage costs and improving scientific utility.
A single-layer Vision Transformer can effectively reduce terabyte-scale data from X-ray detectors in real-time, proving that less can be more in high-speed scientific environments.
Next-generation X-ray detectors generate data faster than any system can affordably store or process. LCLS-II, the upgraded Linac Coherent Light Source at SLAC, produces data on the order of terabytes per second, with raw-data transfer and storage projected to be prohibitively costly, even though much of the data is not scientifically useful. This concept paper focuses on two major points. The first is versatility: a deliberately tiny, single-layer Vision Transformer (ViT) is enough to serve distinct scientific quick-evaluation tasks. We demonstrate this on two very different problems: (a) a supervised hit/miss/maybe classification on the CSPAD dataset, made to resemble ePixUHR-like detector frames, and (b) a self-supervised latent space for rare-event detection in X-ray diffraction spanning two learning paradigms, two output types, and two detector modalities, with one small backbone. The second is hardware co-design: because the ViT's blocks are structurally uniform, the model maps cleanly onto the heterogeneous hardware already present in the LCLS detector pipeline (ASIC -> FPGA -> GPU) under a simple rule one ASIC is one token so the data is reduced progressively at each stage and a keep/discard decision is produced in real time at the edge. The two claims reinforce each other: versatility is precisely what justifies freezing the front-end in silicon, since a reusable front-end is only worth committing to hardware if it serves many tasks. We are explicit that this is a concept supported by early software analysis, not a hardware demonstration. The natural and primary next phase is the hardware implementation of this distributed pipeline. The decisive evidence still owed an end-to-end latency budget, ASIC feasibility of the in-sensor embedding, and the false-negative behavior that matters for a data veto defines that program. HeteroViT is our first step toward it.
