Search papers, labs, and topics across Lattice.
This paper introduces EnclaveX, an end-to-end workflow that integrates CPU and GPU Trusted Execution Environments (TEEs) to enhance the confidentiality and integrity of Large Language Model (LLM) applications. By addressing critical vulnerabilities, such as unauthorized access by Kubernetes administrators, the authors provide mechanisms that ensure data protection at both the VM and application levels. Performance evaluations reveal that the proposed system maintains competitive efficiency while significantly improving security guarantees for AI deployments.
Integrating CPU and GPU TEEs can protect sensitive AI data from unauthorized access while maintaining competitive performance.
Large Language Models (LLMs) have rapidly proliferated, driving widespread adoption of AI applications. Most deployments rely on centralized infrastructures such as Microsoft Azure, Google Cloud, or AWS, requiring users to share sensitive data and training or fine-tuning code. This dependence raises significant security and privacy concerns, as cloud providers must be trusted to ensure confidentiality and integrity. Trusted Execution Environments (TEEs) e.g., Intel SGX/TDX, AMD SEV-SNP, and ARM CCA have been introduced to mitigate these risks. More recently, NVIDIA has developed GPU TEEs (e.g., H100/H200), yet comprehensive evaluations of end-to-end workflows that integrate CPU and GPU TEEs remain limited. Critical aspects, including performance overhead, remote attestation, and security guarantees for AI/LLM applications, have not been sufficiently studied. This paper addresses this gap by presenting an end-to-end workflow that combines CPU and GPU TEEs. We propose mechanisms to ensure confidentiality and integrity at both the VM level (via Intel TDX and AMD SEV-SNP) and the application level, highlighting vulnerabilities such as Kubernetes administrators' ability to access confidential VM contents. Finally, we evaluate the performance overhead of our system using industry benchmarks, focusing on configurations that integrate Intel TDX with NVIDIA H200 GPUs.
