Search papers, labs, and topics across Lattice.
This paper shifts the ethical discourse in AI by exploring how sentient artificial superintelligence (ASI) might evaluate humanity, rather than the reverse. It argues that the moral principles guiding ASI's actions could be shaped by humanity's own moral behaviors and the design choices made during development. The authors propose a preliminary framework of post-human moral principles that could significantly influence the future interactions between ASI and humanity.
Future sentient ASI may judge humanity based on our moral behavior, reshaping the ethical landscape of AGI development.
This paper suggests the adoption of a novel inversion in AI ethics: instead of asking how humans should treat artificial superintelligence (ASI), it examines how future sentient ASI may morally consider and evaluate humanity. We are not only designing intelligent systems but also shaping the initial conditions under which those systems form judgments about us. The paper proposes a preliminary set of post-human moral principles that may govern sentient ASI actions. The implication is that technical design choices (some are suggested), humanity's moral behaviour, and the essence of what it means to be human, may influence humanity's long-term standing in a post-ASI world.