7 stories tagged Explainable AI
A new arXiv position paper argues that current Explainable AI (XAI) tools structurally misalign with building user trust, often promoting overreliance on incorrect predictions. The research suggests these tools are better suited for debugging rather than increasing user trust.
Researchers from the University of Cambridge and MIT introduced a synthetic ground-truth framework for evaluating explainable AI methods. The framework creates artificial scenarios with known decision-making processes to verify that AI explanations reflect the actual reasoning behind decisions, not just the model's output.
Researchers introduced XAI-Arena, an LLM-as-a-judge framework that evaluates the quality of explainable AI (XAI) explanations in a multidimensional, stakeholder-sensitive, and reproducible manner, addressing the subjectivity and scalability limits of human evaluation.
Researchers introduced MAR-12, an AI model that analyzes memes to detect harmful humor and provides structured reasoning for its classifications. By combining visual, textual, and cultural context, MAR-12 aims to improve online safety and moderation with explainable AI.
Researchers propose an explainable AML triage framework using LLMs to handle transaction alerts while mitigating hallucinations and ensuring compliance. The approach emphasizes evidence-constrained decision-making to improve auditability and governance.
A new arXiv paper critiques non-symbolic methods like SHAP for lacking rigor in high-stakes AI explanations. It advocates for symbolic approaches to improve trustworthiness. This could reshape the XAI landscape.
A comprehensive survey reviews the use of Explainable AI (XAI) to make surrogate models more interpretable. The study highlights the need for transparency in complex simulations across scientific and engineering fields. This work offers a roadmap for integrating XAI into decision-making processes.