System-Level Design Principles for Trustworthy Artificial Intelligence

Authors

  • Daniel Costa Assistant Professor, Department of Artificial Intelligence, Mediterranean Institute of Technology, Rome, Italy Author
  • Marco Popescu Professor, School of Data Science, Nordic Technical University, Stockholm, Sweden Author

DOI:

https://doi.org/10.5281/

Keywords:

trustworthy AI, system design principles, AI safety, AI governance, architectural patterns, EU AI Act, NIST AI RMF, AI system maturity

Abstract

Trustworthy artificial intelligence (TAI) demands that AI systems satisfy a constellation of system-level properties --
safety, reliability, fairness, transparency, privacy, and human oversight -- in a coherent, verifiable, and maintainable
manner across their operational lifetime. This paper derives and empirically validates twelve System-Level Design
Principles (SLDPs) for TAI, organised under four architectural layers: data, model, integration, and governance. The
SLDPs are evaluated through a cross-sectional expert assessment involving 42 AI system architects from nine countries
and a longitudinal deployment study tracking 16 AI systems across healthcare, autonomous systems, and financial
services domains over 18 months. Expert consensus confirms strong agreement on principle importance (mean Kendall
W = 0.81, p < 0.001). Longitudinal analysis demonstrates that systems implementing eight or more SLDPs exhibit a
47.2% lower rate of trust-critical incidents compared to systems implementing fewer than four (IRR = 0.53, 95% CI:
0.41-0.68, p < 0.001). The study contributes a consolidated SLDP catalogue, a TAI System Maturity Index (TSMI), and
practical guidance for operationalising EU AI Act and NIST AI RMF requirements.

Author Biographies

  • Daniel Costa, Assistant Professor, Department of Artificial Intelligence, Mediterranean Institute of Technology, Rome, Italy

    Assistant Professor, Department of Artificial Intelligence, Mediterranean Institute of Technology, Rome, Italy

  • Marco Popescu, Professor, School of Data Science, Nordic Technical University, Stockholm, Sweden

    Professor, School of Data Science, Nordic Technical University, Stockholm, Sweden

Downloads

Published

2024-09-15

How to Cite

System-Level Design Principles for Trustworthy Artificial Intelligence. (2024). AI Governance and Society Journal P-ISSN 3117-6097 and E-ISSN 3117-6100, 1(1), 1-8. https://doi.org/10.5281/