Journal Article

·2026 OPEN ACCESS

Explainable Artificial Intelligence (XAI): Concepts, Applications, Challenges, and Future Perspectives

Osman Kaya YTU , A. F. M. Shahen Shah YTU , Muhammet Ali Karabulut YTU , Sumeye Nur Karahan , Mustafa Serdar Osmanca , Nurettin Acır

IEEE Access

Abstract

The aim of explainable artificial intelligence (XAI) is to address the black-box problem in high-stakes applications. However, transparency alone does not guarantee trust. This review examines a critical paradox in XAI research. While explanation methods can generate insights, three main challenges limit their effectiveness. Firstly, adversarial manipulations can exploit explanations by creating new attack surfaces with over ninety percent success while preserving model accuracy. Secondly, evaluation practices remain primarily computational. Only twenty-six percent of user studies follow human-centered protocols and fewer than twenty-three percent involve domain experts. Thirdly, regulatory requirements, such as the GDPR right to explanation, lack clear technical implementations, complicating compliance. We analyzed the literature across finance, healthcare, and cybersecurity and found that current research emphasizes algorithmic innovation over practical deployment. Moving toward reliable AI requires shifting from simple explanation methods (XAI 1.0) to systems that are aligned with human understanding, resistant to adversarial attacks, and compliant with legal requirements (XAI 2.0). This review provides guidance on key technical advances, evaluation strategies and regulatory clarifications necessary for deployment. trustworthy AI.

Keywords

Adversarial system Transparency (behavior) Exploit Trustworthiness Key (lock) Domain (mathematical analysis) Simple (philosophy) Computer science Artificial intelligence

Subject Areas

Explainable Artificial Intelligence (XAI) ·Artificial Intelligence ·Physical Sciences
Adversarial Robustness in Machine Learning ·Artificial Intelligence ·Physical Sciences
Artificial Intelligence in Healthcare and Education ·Health Informatics ·Health Sciences

OpenAlex SDG Match

SDGs auto-classified by OpenAlex (score ≥ 0.4 shown).

Decent work and economic growth 50%