Search papers, labs, and topics across Lattice.
This paper advocates for a "humans-as-handlers" approach to autonomous and opaque AI systems, arguing that humans should be seen as collaborators rather than mere users. By drawing an analogy between AI systems and animals, the author emphasizes the importance of trust and responsibility in human-machine interactions, particularly in high-stakes domains like medicine and warfare. The key finding is that this reframing enhances our understanding of accountability and the nature of collaboration between humans and AI, ultimately leading to more effective and ethical use of these technologies.
Viewing AI systems as collaborators rather than tools reshapes our understanding of responsibility and trust in high-stakes environments.
Artificial intelligence (AI) is becoming ubiquitous, and across domains, increasingly autonomous systems are carrying out tasks which raise significant ethical and legal challenges which demonstrate a need for strong human-machine teams rooted in trust. In this article, I argue that within highly impactful areas (such as medicine or warfighting) there are grounds for us initially treating autonomous and opaque systems as relevantly analogous to dogs (or other animals with which we have close relationships). Under this analogy, humans making use of these systems are not to be viewed as "users" or "deployers" of these systems, but instead take the role of "handlers". This recasting of roles shifts the way we view humans, AI-enabled and autonomous systems, and the relations between them, and moreover clarifies the clear and traceable lines of responsibility humans have for the outcomes brought about when using these systems. In developing this point, I clarify that the machine-animal analogy does admit disanalogous elements, but that its touch-points ground it as a starting point. I then explore how we can divest the humans-as-handlers approach of those aspects of our relationships with animals which are unfitting for how we engage with and make use of autonomous and AI-enabled systems. I conclude by arguing that the trajectory of human-machine teamings for autonomous and AI-enabled systems should be a state where we authentically view these not as artifacts which we simply make use of, but as collaborators with which we pursue complex goals and carry out complex tasks.