Core thesis

Technology alone does not transform an organization. Successful AI implementation in healthcare rarely fails because of technology - but rather because of trust deficits, a lack of digital literacy, cultural resistance and unclear governance. This visualization and the associated concept systematically address this gap.

The special thing about healthcare: The consequences of poor AI adoption are directly relevant to patients. Alarm fatigue due to uncalibrated systems, automation bias[1] in medical decisions and unclear liability for AI errors are real risks - not theoretical ones.

Digitalization means, above all, cultural change – that is my main practical experience. The most common reaction to impulses for change: "Yes but..." I know this resistance well - and I know how to address it constructively, take it seriously and transform it into real adoption.

Visualization

Change Management & AI Adoption

+
Change Management and AI Adoption – Overview of the Approach
Barriers to adoption

Why AI Adoption Fails

Trust Gap

(Clinical) employees do not accept AI systems if their functionality remains opaque. Explainability (XAI) is a prerequisite for adoption - not an additional feature.

📚

Skills gap

Without basic AI knowledge, employees cannot assess strengths and limitations. Training is not a nice-to-have, but a safety requirement.

🏛️

Cultural resistance

AI introduction changes workflows and role models. Involve clinical champions early on – change management begins before the first pilot.

Automation bias

Even well-trained employees adopt AI recommendations uncritically.[1] Override rate monitoring and calibration training are mandatory.

Success factors

What enables sustainable adoption

1

Phased rollout – pilot first

Start with LOW and MEDIUM risk applications that quickly show added value. HIGH-risk systems only after a proven compliance structure and human-in-the-loop processes.[4]

2

Explainability as a prerequisite for adoption

Explainable AI (XAI) builds trust – especially in clinical settings. Transparent models are used more frequently and more responsibly than black box systems.[2]

3

Involve clinical champions early on

Internal multipliers accelerate adoption and increase acceptance. Change management begins before the first pilot - not after the go-live.

4

Measurable KPIs & continuous monitoring

Override rate, alarm fatigue, frequency of use and clinical outcomes must be systematically recorded. What is not measured is not controlled.[3]

5

Governance & clear distribution of liability

Roles, responsibilities and escalation paths must be defined before deployment. For high-risk AI systems, the EU AI Act requires human oversight — and it is ethically imperative.

Foundation Vision for humane AI use Adoption succeeds when people and AI work together effectively: AI takes on routine, people retain judgement and responsibility. The orientation framework for this is the vision.
To the vision →
Sources & Basis

Sources

  1. Goddard K, Roudsari A, Wyatt JC. Automation bias: a systematic review of frequency, effect mediators, and mitigators. J Am Med Inform Assoc. 2012;19(1):121–127. DOI: 10.1136/amiajnl-2011-000089
  2. Arrieta AB, et al. Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Inf Fusion. 2020;58:82–115. DOI: 10.1016/j.inffus.2019.12.012
  3. Greenhalgh T, et al. Beyond Adoption: A New Framework for Theorizing and Evaluating Nonadoption, Abandonment, and Challenges to the Scale-Up, Spread, and Sustainability of Health and Care Technologies. J Med Internet Res. 2017;19(11):e367. DOI: 10.2196/jmir.8775
  4. Magrabi F, et al. Artificial intelligence in clinical decision support: challenges for evaluating AI and practical implications. Yearb Med Inform. 2019;28(1):128–134. DOI: 10.1055/s-0039-1677903

Own representation and conceptual framework: Kawaschinski K., Karolinska Institutet, Spring 2026. Sources checked as of: April 2026.

Enlarged view
⚠ Disclaimer

This material was prepared with the greatest care. It does not replace legal, medical or professional advice. No warranty for completeness or timeliness.

AI-assisted creation

Parts of this document were created with the support of generative AI and editorially reviewed. This content is not a substitute for legal, medical or professional advice. (EU AI Act Art. 50)