Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper argues that General Alignment, which uses scalar rewards to align LLMs, has reached a ceiling due to its limitations in handling conflicting values and uncertainty in complex socio-technical systems. It identifies structural value flattening, normative representation loss, and cognitive uncertainty blindness as key failures of General Alignment. To address these limitations, the paper introduces Edge Alignment, a new approach that preserves multi-dimensional value structures and incorporates epistemic mechanisms for interaction and clarification.
Current AI alignment strategies that compress human values into a single reward are doomed to flatten values, erase minority viewpoints, and ignore uncertainty, demanding a shift towards "Edge Alignment" that respects value diversity.
Large language models are being deployed in complex socio-technical systems, which exposes limits in current alignment practice. We take the position that the dominant paradigm of General Alignment, which compresses diverse human values into a single scalar reward, reaches a structural ceiling in settings with conflicting values, plural stakeholders, and irreducible uncertainty. These failures follow from the mathematics and incentives of scalarization and lead to \textbf{structural} value flattening, \textbf{normative} representation loss, and \textbf{cognitive} uncertainty blindness. We introduce Edge Alignment as a distinct approach in which systems preserve multi dimensional value structure, support plural and democratic representation, and incorporate epistemic mechanisms for interaction and clarification. To make this approach practical, we propose seven interdependent pillars organized into three phases. We identify key challenges in data collection, training objectives, and evaluation, outlining complementary technical and governance directions. Taken together, these measures reframe alignment as a lifecycle problem of dynamic normative governance rather than as a single instance optimization task.