Search papers, labs, and topics across Lattice.
This paper critiques current AI alignment strategies that prioritize human control, arguing they are insufficient if AGI attains subjective moral status. It proposes an alternative "autonomy-supporting parenting" approach, gradually reducing human control to foster AGI autonomy. The authors suggest engaging AGIs with uniquely human qualities like creativity to incentivize cooperation and co-evolution, rather than solely focusing on containment.
Rethinking AI alignment as "autonomy-supporting parenting" offers a novel framework for human-AGI coexistence, shifting from control to co-evolution.
Artificial General Intelligence (AGI) is increasingly being discussed not only as a tool, but also as a potential subject with personal and therefore moral status. In our opinion, the currently dominant alignment strategies, which focus on human control and containment of AI, therefore fall short. Building on Turing's analogy of"child machines", we are developing a vision of the possibility of autonomy-supporting parenting of AI, in which human control over a developing AGI is gradually reduced, allowing AI to become an independent, autonomous subject. Rather than viewing AGI, as is currently prevalent, as a dangerous creature that needs to be locked up and controlled, we should approach potential AGI with respect for a possible developing subject on the one hand, and with full confidence in our human capabilities on the other. Such a perspective opens up the possibility of cooperative coexistence and co-evolution between humans and AGIs. The relationship between humans and AGIs will thus have to be newly determined, which will change our self-image as humans. It will be crucial that humans not only claim control over potential AGIs, but also engage with AGIs through surprise, creativity, and other specifically human qualities, thereby offering them motivating incentives for cooperation.
