Search papers, labs, and topics across Lattice.
This paper introduces SOCI (Seekable OCI), a lazy-loading architecture that significantly reduces container image pull times in Kubernetes environments by enabling containers to start without downloading the entire image. By creating an external index that maps files to byte ranges within compressed layers, SOCI allows for efficient HTTP range requests, achieving a remarkable 7.4x speedup in cold-start times for a 1.3 GB Python web service image. The method is compatible with unmodified images and standard registries, demonstrating its practical applicability and scalability in production environments like Amazon EKS and ECS Fargate.
SOCI slashes cold-start pull times from 20 seconds to just 2.8 seconds, revolutionizing container deployment efficiency without requiring any changes to existing image formats.
Container image pulling accounts for the majority of pod startup time in Kubernetes environments. Standard pull downloads the entire image before the container can start, even when the application accesses only a fraction of the image content at startup. We present SOCI (Seekable OCI), a lazy-loading architecture that enables containers to start without downloading the full image. SOCI builds an external index over standard OCI images, mapping files to byte ranges within compressed layers. At runtime, a FUSE filesystem intercepts file accesses and serves them via HTTP range requests. Unlike prior approaches that require image format conversion, SOCI works with unmodified images and standard registries. The index is stored as an OCI referrer artifact, requiring no changes to images, registries, or deployment tooling. On a 1.3 GB Python web service image, SOCI reduces cold-start pull time from 20 seconds to approximately 2.8 seconds (7.4x speedup), with pull time independent of image size. Larger images see larger speedups (9.3x on a 2.5 GB image) because SOCI pull time is constant while standard pull scales linearly. We measure a crossover at 80% access density: below this, lazy loading wins; above, parallel full pull is faster. SOCI lazy loading is deployed in production on Amazon EKS and Amazon ECS Fargate (which launched 18.4 million tasks per day during Prime Day 2025), and has been serving lazy-load requests since 2023. EKS Auto Mode uses SOCI's parallel pull mode for GPU instances.
