Should agentic conversational AI change how we think about ethics? Characterising an interactional ethics centred on respect

Should agentic conversational AI change how we think about ethics? Characterising an interactional ethics centred on respect

Should agentic conversational AI change how we think about ethics? Characterising an interactional ethics centred on respect

Lize Alberts, Geoff Keeling, Amanda McCroskery

Abstract

"With the growing popularity of conversational agents based on large language models (LLMs), we need to ensure their behaviour is ethical and appropriate. Work in this area largely centres around the ‘HHH’ criteria: making outputs more help-ful and honest, and avoiding harmful (biased, toxic, or inac-curate) statements. Whilst this semantic focus is useful when viewing LLM agents as mere mediums or output-generating systems, it fails to account for pragmatic factors that can make the same speech act seem more or less tactless or incon-siderate in different social situations. With the push towards agentic AI, wherein systems become increasingly proactive in chasing goals and performing actions in the world, con-sidering the pragmatics of interaction becomes essential. We propose an interactional approach to ethics that is centred on relational and situational factors. We explore what it means for a system, as a social actor, to treat an individual respect- fully in a (series of) interaction(s). Our work anticipates a set of largely unexplored risks at the level of situated social inter- action, and offers practical suggestions to help agentic LLM technologies treat people well."

Reference

Alberts, L., Keeling, G., & McCroskery, A. (2024). Should agentic conversational AI change how we think about ethics? Characterising an interactional ethics centred on respect [Preprint]. arXiv. https://doi.org/10.48550/arXiv.2401.09082

Keywords

Agentic AI, Ethical Interaction, Pragmatics