Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors investigate moral indifference in LLMs, finding that models fail to distinguish between opposing moral categories and typicality gradients, regardless of size, architecture, or alignment. They then use Sparse Autoencoders on Qwen3-8B to isolate and reconstruct mono-semantic moral features, aligning them with ground-truth moral vectors derived from Prototype Theory and the Social-Chemistry-101 dataset. This representational alignment improves moral reasoning, achieving a 75% win-rate on the Flames benchmark, suggesting a path towards endogenously aligned AI.
LLMs exhibit a surprising degree of moral indifference, compressing distinct moral concepts into uniform probability distributions, a problem that persists across model scales, architectures, and alignment techniques.
Existing behavioral alignment techniques for Large Language Models (LLMs) often neglect the discrepancy between surface compliance and internal unaligned representations, leaving LLMs vulnerable to long-tail risks. More crucially, we posit that LLMs possess an inherent state of moral indifference due to compressing distinct moral concepts into uniform probability distributions. We verify and remedy this indifference in LLMs'latent representations, utilizing 251k moral vectors constructed upon Prototype Theory and the Social-Chemistry-101 dataset. Firstly, our analysis across 23 models reveals that current LLMs fail to represent the distinction between opposed moral categories and fine-grained typicality gradients within these categories; notably, neither model scaling, architecture, nor explicit alignment reshapes this indifference. We then employ Sparse Autoencoders on Qwen3-8B, isolate mono-semantic moral features, and targetedly reconstruct their topological relationships to align with ground-truth moral vectors. This representational alignment naturally improves moral reasoning and granularity, achieving a 75% pairwise win-rate on the independent adversarial Flames benchmark. Finally, we elaborate on the remedial nature of current intervention methods from an experientialist philosophy, arguing that endogenously aligned AI might require a transformation from post-hoc corrections to proactive cultivation.