Search papers, labs, and topics across Lattice.
3
0
6
OTRO reduces tokenizer latency to just 4.5% overhead while effectively safeguarding against side-channel attacks in LLMs.
A novel differentially private RAG algorithm, DP-KSA, achieves a strong privacy-utility tradeoff by extracting and augmenting prompts with differentially private keywords derived from an ensemble of LLM responses.
Decomposing linear layers in MPC inference can actually speed things up, but only if you carefully manage the extra communication rounds and truncation steps.
