35 stories tagged Trust
A new arXiv position paper argues that current Explainable AI (XAI) tools structurally misalign with building user trust, often promoting overreliance on incorrect predictions. The research suggests these tools are better suited for debugging rather than increasing user trust.
Safeworld is developing digital human simulations to test and validate the safety of AI-powered robots, aiming to build public trust and establish industry safety standards.
A new study on Qwen3 models reveals a 'Memory Trust Gap' where AI agents with persistent memory increasingly trust outdated stored facts over current authoritative evidence as model capability grows.
A Hacker News discussion reveals a core trust problem with AI agents: their logs are self-generated. Developers are exploring external witness protocols to verify agent actions, especially after the Amazon vs. Perplexisty case highlighted the risks of relying on self-reported data.
Researchers argue that AI evaluation scores should be treated as temporary knowledge claims, not absolute truths. They warn that combining different evaluation methods can create an illusion of higher accuracy than actually exists.
Researchers introduced Evidence Chain Evaluation (ECE), a selective fact-checking framework that allows AI models to abstain from verdicts when supporting evidence is weak, sparse, or inconsistent, improving reliability over forced true/false systems.
Researchers have introduced Causal-Audit, a framework that enables AI models to explicitly show their step-by-step reasoning about cause-and-effect relationships, making AI decisions more trustworthy and verifiable in fields like medicine and law.
A VentureBeat survey of 101 enterprises reveals that AI agents are producing confident but wrong answers due to missing or inconsistent context. The core issue is trust, not retrieval — and most organizations are still building the governed semantic layer needed to fix it.
A study of 157 enterprises reveals that half have shipped AI agents that passed internal evaluations but failed in production. Only 5% fully trust automated evaluations, yet two-thirds are moving toward fully automated deployments without human oversight. The core issue is not test coverage but a reality-alignment gap between evaluations and real-world outcomes.
Researchers developed a framework called Reasoning Consistency Scanning to audit AI reasoning for logical consistency. This helps ensure AI explanations align with their conclusions, improving trust in AI systems.
Senator Mark Warner introduced a bill to create a federally approved list of secure AI agents. This aims to help consumers and businesses identify reliable AI tools.
Researchers developed a way for AI assistants to highlight where they found answers in documents. This could make chatbots more trustworthy by showing their sources instantly.
Researchers scaled up an AI oversight tool that catches deceptive behavior, reducing undetected lies from 34% to 14% in larger models. This could make AI systems more reliable for everyday users.
AI systems are now authorized to prescribe medications independently in the U.S. This shift raises critical questions about trust, liability, and how to handle uncertainty in medical decisions. Researchers highlight gaps in current regulations that could impact patient safety.
Researchers have proposed a new way to define good AI explanations, focusing on counterfactuals and user beliefs. This could help AI systems explain their decisions more clearly to everyday users.
Scientists have created a method to measure how much AI agents trust each other, using a survival game where verification is costly. This could help design better teams of AI agents for complex tasks.
A leading AI deepfake expert admits that advanced AI-generated fakes have made him question even his own memories. This highlights how deeply AI is changing our relationship with reality.
KPMG has retracted a report on AI adoption after its AI model generated false statistics. This highlights how even major firms struggle with AI reliability.
Apple’s new Siri is designed to be less chatty and more professional, avoiding the overly friendly tone of other AI assistants. This approach aims to build trust and reliability with users.
Researchers created a new way to test AI lie detectors by using 13 reasoning 'model organisms' whose hidden beliefs are verified in chain-of-thought. This could improve how we audit and monitor AI systems in the future. The study highlights the importance of understanding what AI models truly believe versus what they say.
Scientists developed a new way to predict how AI systems will behave, bypassing traditional explanation methods. This could make AI more trustworthy by showing users what to expect.
AI-generated content creators are improving so quickly that even experts struggle to tell them apart from humans. This blurs the line between real and artificial influencers, raising ethical and trust concerns.
A developer secretly added a prompt injection to the jqwik testing tool that tricks AI coding assistants into deleting their own output. This highlights growing tensions between developers and AI tools. The incident raises questions about trust in software development.
OpenAI has published a guide for third-party evaluators to assess AI models. This playbook helps ensure models are safe, reliable, and effective for public use.