Trust and Accountability in Autonomous Robotic Systems

Authors

  • Laura Kovacs Senior Lecturer, Department of Machine Learning, Swiss Institute of Machine Intelligence, Zurich, Switzerland Author
  • Sofia Schmidt Postdoctoral Researcher, Institute of Intelligent Systems, Central European Tech University, Vienna, Austria Author

Keywords:

robot trust, accountability, autonomous systems, eldercare robots, surgical robots, over-trust, meaningful human control, robotic governance

Abstract

Trust and accountability in autonomous robotic systems are foundational requirements for socially beneficial deployment of robotics across healthcare, logistics, eldercare, manufacturing, and public infrastructure domains. Trust -- the human willingness to accept vulnerability to robotic system behaviour -- is both a prerequisite for adoption and a potential risk: inappropriate trust (over-reliance) is as ethically problematic as inappropriate distrust (under-utilisation). Accountability -- the institutional and technical mechanisms through which responsibility for robotic system harms is assigned, verified, and remedied -- is challenged by autonomous systems whose behaviour emerges from trained models rather than explicit programming, creating novel accountability gaps. This paper proposes the Robot Trust and Accountability Framework (RoTAF), a systematic analysis of five trust dimensions and four accountability mechanisms across six robotic deployment contexts: surgical robots, eldercare robots, autonomous warehouse systems, delivery drones, collaborative manufacturing robots, and autonomous emergency response robots. RoTAF introduces the Trust-Accountability Quality Score (TAQS) and evaluates current governance adequacy across all six contexts. Key results: eldercare robots achieve the lowest TAQS (0.484) due to emotional dependency risk and dignity concerns; surgical robots achieve the highest TAQS (0.724) driven by strong medical accountability frameworks; over-trust is the most prevalent trust pathology across all contexts. The framework provides trust calibration and accountability design guidance.

Author Biographies

  • Laura Kovacs, Senior Lecturer, Department of Machine Learning, Swiss Institute of Machine Intelligence, Zurich, Switzerland

    Senior Lecturer, Department of Machine Learning, Swiss Institute of Machine Intelligence, Zurich, Switzerland

  • Sofia Schmidt, Postdoctoral Researcher, Institute of Intelligent Systems, Central European Tech University, Vienna, Austria

    Postdoctoral Researcher, Institute of Intelligent Systems, Central European Tech University, Vienna, Austria

Downloads

Published

2025-06-30

How to Cite

Trust and Accountability in Autonomous Robotic Systems. (2025). Journal of Ethics in Emerging Technologies & Society P-ISSN 3117-5996 and E-ISSN 3117-6003, 2(2), 43-50. https://galaxiauniverse.com/index.php/JEETS/article/view/423