Inclusion of Clinicians in the Development and Evaluation of Clinical Artificial Intelligence Tools: A Systematic Literature Review

Frontiers in Psychology 13 (2022)
  Copy   BIBTEX

Abstract

The application of machine learning and artificial intelligence in healthcare domains has received much attention in recent years, yet significant questions remain about how these new tools integrate into frontline user workflow, and how their design will impact implementation. Lack of acceptance among clinicians is a major barrier to the translation of healthcare innovations into clinical practice. In this systematic review, we examine when and how clinicians are consulted about their needs and desires for clinical AI tools. Forty-five articles met criteria for inclusion, of which 24 were considered design studies. The design studies used a variety of methods to solicit and gather user feedback, with interviews, surveys, and user evaluations. Our findings show that tool designers consult clinicians at various but inconsistent points during the design process, and most typically at later stages in the design cycle. We also observed a smaller amount of studies adopting a human-centered approach and where clinician input was solicited throughout the design process. A third of all studies reported on clinician trust in clinical AI algorithms and tools. The surveyed articles did not universally report validation against the “gold standard” of clinical expertise or provide detailed descriptions of the algorithms or computational methods used in their work. To realize the full potential of AI tools within healthcare settings, our review suggests there are opportunities to more thoroughly integrate frontline users’ needs and feedback in the design process.

Other Versions

No versions found

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 103,401

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Shaping Tomorrow: The Impact of AI on Architectural History and Interior Design Education.Dalia Hafiz - forthcoming - Evolutionary Studies in Imaginative Culture:357-367.

Analytics

Added to PP
2022-04-09

Downloads
17 (#1,196,561)

6 months
5 (#702,808)

Historical graph of downloads
How can I increase my downloads?