Search papers, labs, and topics across Lattice.
This paper introduces SNAS, a robust architecture for secure external communication in Snowpark's sandboxed environments, addressing the challenge of maintaining multi-tenant isolation while enabling necessary external API access. By integrating eBPF packet filtering, GENEVE overlay networks, and distributed egress proxies, SNAS achieves policy-driven egress control with minimal performance overhead. The architecture has been successfully deployed across all Snowflake regions, demonstrating effective management of petabyte-scale data transfers and latency-sensitive integrations.
SNAS enables secure, efficient external communication in multi-tenant environments without compromising isolation or performance.
Snowpark enables data engineering and AI/ML workloads in Snowflake by executing user-defined functions in secure sandboxes. Many of these workloads require external connectivity to access cloud APIs, external databases, or feature stores, creating a dependability challenge: how to provide transparent network access while preserving strict multi-tenant isolation and resource fairness. This paper presents Secure Network Access in Snowpark (SNAS), a production architecture for secure external communication from sandboxed workloads. SNAS combines Extended Berkeley Packet Filter (eBPF) packet filtering, Generic Network Virtualization Encapsulation (GENEVE) overlay networks, and distributed egress proxies for policy-driven egress control with low overhead. We describe the design, deployment, and measured production behavior of SNAS, including an eBPF-based bandwidth limiter using the Earliest Departure Time (EDT) algorithm, dual-tier policy enforcement, and safeguards for connection limiting and port exhaustion. SNAS is deployed across all Snowflake regions and supports large-scale production workloads including petabyte-scale data transfer and latency-sensitive external integrations.
