Search papers, labs, and topics across Lattice.
The paper introduces Hierarchical Long-Term Semantic Memory (HLTM), a framework for organizing textual data into a schema-aligned memory tree to improve LLM agent performance in real-world applications. HLTM addresses challenges like scalability, low-latency retrieval, and privacy by structuring semantic knowledge at multiple granularities and incorporating an adaptation mechanism for cross-domain generalization. Evaluations on LinkedIn's Hiring Assistant demonstrate that HLTM improves answer correctness and retrieval F1 by over 10% while also improving query and indexing latency.
LinkedIn's new memory system for hiring agents boosts accuracy and speed by over 10%, proving hierarchical semantic memory is a game-changer for real-world LLM applications.
Large Language Model (LLM) agents are increasingly used in real-world products, where personalized and context-aware user interactions are essential. A central enabler of such capabilities is the agent's long-term semantic memory system, which extracts implicit and explicit signals from noisy longitudinal behavioral data, stores them in a structured form, and supports low-latency retrieval. Building industrial-grade long-term memory for LLM agents raises five challenges: scalability, low-latency retrieval, privacy constraints, cross-domain generalizability, and observability. We introduce the Hierarchical Long-Term Semantic Memory (HLTM) framework, which organizes textual data into a schema-aligned memory tree that captures semantic knowledge at multiple levels of granularity, enabling scalable ingestion, privacy-aware storage, low-latency retrieval, and transparent provenance; HLTM further incorporates an adaptation mechanism to generalize across diverse use cases. Extensive evaluations on LinkedIn's Hiring Assistant show that HLTM improves answer correctness and retrieval F1 significantly by more than 10%, while significantly advancing the Pareto frontier between query and indexing latency. HLTM has been deployed in LinkedIn's Hiring Assistant to power core personalization features in production hiring workflows.
