Search papers, labs, and topics across Lattice.
This paper outlines a network-centric architecture designed for on-premises access to Earth observation data, addressing the limitations faced by institutions with constrained connectivity and resources. The architecture, implemented at the AIR Data Centre, integrates a MinIO object storage cluster and a PostGIS metadata catalogue, and is evaluated for its performance under various network conditions. Key findings reveal that network bandwidth is the primary constraint on storage throughput for bulk data access, with a critical threshold identified at 10 Gbps per server, beyond which memory topology becomes the limiting factor.
Network bandwidth emerges as the key bottleneck for on-premises Earth observation data access, with implications for infrastructure investment strategies.
Earth observation (EO) programmes generate data at volumes that exceed the transfer and storage capacity of most institutional networks. Public cloud platforms address this for well-resourced organisations, but institutions across the Atlantic basin face constraints in connectivity, sovereignty and funding that make on-premises infrastructure the only viable path. Cloud-native data formats enable efficient partial reads, yet their performance depends on the bandwidth of the underlying network fabric, a dependency rarely measured in isolation. This paper presents a replicable, network-centric architecture for on-premises EO data access, evaluated at its first operational deployment: the AIR Data Centre, founding node of the Atlantic Cloud. The system comprises a MinIO object storage cluster on a 100 GbE fabric, a PostGIS metadata catalogue and an OGC API-EDR access layer. We characterise the fabric under sustained parallel load, evaluate object storage throughput for EO-representative workloads, and compare measured performance against throttled baselines on identical hardware, isolating network bandwidth as the sole variable. Multi-site replication benchmarks with partner institutions characterise the federation primitive the model depends on. Network bandwidth is the dominant constraint on storage throughput for bulk EO data access up to a threshold; beyond it, endpoint memory topology rather than capacity governs how much bandwidth a system can use. For this hardware class that threshold lies above 10 Gbps per server. Below it, network capacity alone sets what the facility can deliver; above it, the return on further network investment depends on endpoint memory provisioning, which can be deferred and bought later.
