Search papers, labs, and topics across Lattice.
This paper explores the implications of advanced AI systems on meta-ethics, proposing a framework to identify novel ethical questions that arise when AI exhibits moral reasoning and intentionality. It distinguishes four domains of inquiry regarding both human and AI perspectives on ethics, highlighting the potential divergence between human-imposed ethical frameworks and those that may emerge from AI itself. The findings suggest that existing meta-ethical theories may need significant revision to accommodate the complexities introduced by AI's own ethical considerations.
The emergence of AI's own ethics could fundamentally challenge and reshape our understanding of moral frameworks, requiring a reevaluation of established meta-ethical theories.
With the development of artificial intelligence (AI), the landscape of meta-ethics, which has largely centred on human ethics, faces pressures that may significantly reconfigure it. In particular, if future AI systems were to exhibit sufficiently integrated capacities for moral reasoning, moral intentionality, and moral reflection, novel meta-ethical questions would arise concerning what I call "AI's own ethics", as distinct from ethical principles merely imposed on AI by human designers. This paper offers a conditional and methodological framework for identifying the questions that would emerge if such AI systems were to arise. On that basis, the paper distinguishes four domains of meta-ethical inquiry in the era of AI: questions about the nature of human ethics from the human perspective; questions about the nature of AI's own ethics from the human perspective; questions about the nature of human ethics from the AI perspective; and questions about the nature of AI's own ethics from the AI perspective. The paper then considers how some existing mainstream meta-ethical theories (such as cognitivism and non-cognitivism, error theory and success theory, relativism, and objective realism) might illuminate these domains, while arguing that many familiar human-centred formulations of those theories may not transfer straightforwardly to AI cases without substantial revision. The overall conclusion is that the emergence of AI's own ethics would place significant pressure on current frameworks and may require substantial refinement, reconstruction, or reconceptualisation.
