Search papers, labs, and topics across Lattice.
The paper investigates whether LLMs possess an inherent "moral indifference" by examining their ability to distinguish between opposed moral categories and fine-grained typicality gradients within those categories. Analyzing 23 models, the authors find that LLMs struggle to represent moral distinctions, irrespective of model scale, architecture, or explicit alignment. They then use Sparse Autoencoders to isolate and reconstruct mono-semantic moral features in Qwen3-8B, achieving a 75% pairwise win-rate on the Flames benchmark, suggesting representational alignment can improve moral reasoning.
LLMs exhibit a surprising "moral indifference," failing to internally distinguish between opposed moral concepts regardless of size, architecture, or alignment, but this can be partially remedied by representational alignment using sparse autoencoders.
Existing behavioral alignment techniques for Large Language Models (LLMs) often neglect the discrepancy between surface compliance and internal unaligned representations, leaving LLMs vulnerable to long-tail risks. More crucially, we posit that LLMs possess an inherent state of moral indifference due to compressing distinct moral concepts into uniform probability distributions. We verify and remedy this indifference in LLMs' latent representations, utilizing 251k moral vectors constructed upon Prototype Theory and the Social-Chemistry-101 dataset. Firstly, our analysis across 23 models reveals that current LLMs fail to represent the distinction between opposed moral categories and fine-grained typicality gradients within these categories; notably, neither model scaling, architecture, nor explicit alignment reshapes this indifference. We then employ Sparse Autoencoders on Qwen3-8B, isolate mono-semantic moral features, and targetedly reconstruct their topological relationships to align with ground-truth moral vectors. This representational alignment naturally improves moral reasoning and granularity, achieving a 75% pairwise win-rate on the independent adversarial Flames benchmark. Finally, we elaborate on the remedial nature of current intervention methods from an experientialist philosophy, arguing that endogenously aligned AI might require a transformation from post-hoc corrections to proactive cultivation.
