#risk

Risk

8 stories tagged Risk

researchJul 23, 2026

Conversational Risk Accumulation: New Framework Detects Hidden Dangers in Multi-Turn AI Chats

Researchers from ArXiv cs.CL have introduced a session-layer framework to detect Conversational Risk Accumulation (CRA) in multi-turn LLM systems. Unlike existing guardrails that evaluate each prompt-response in isolation, the CRA Framework tracks semantic drift, fragmented assembly of prohibited instructions, and sensitivity build-up over a dialogue. This could make future AI conversations significantly safer.

via ArXiv cs.CL#ai #safety #conversational-ai

researchJul 22, 2026

CPSAINT: New Framework Quantifies Residual Risk in Agentic AI Systems

Researchers propose CPSAINT, a seven-layer integrity decomposition paired with the FRIESA-K risk functional, to quantify residual risk in agentic AI. The framework bridges the gap between describing failure mechanisms and producing transferable risk estimates, enabling safer deployment of autonomous AI agents.

via ArXiv cs.AI#ai #research #risk

industryJul 13, 2026

Satya Nadella Warns Companies: Don't Get Locked Into Proprietary AI Models

In a surprising blog post, Microsoft CEO Satya Nadella warned enterprises about the dangers of relying on proprietary AI models from companies like Anthropic and OpenAI, urging businesses to maintain control over their AI systems to avoid vendor lock-in and unforeseen risks.

via TechCrunch AI#ai #microsoft #business

researchJun 23, 2026

AI Models Still Make Irrational Decisions Even When Aligned

Researchers found that AI models can still make irrational decisions even when trained to align with human values. This 'rational value risk' means models may not always choose the best possible action, even if they understand what's valuable.

via ArXiv cs.AI#ai #research #alignment

generalJun 21, 2026

I'd Rather Risk Cancer Than See AI Move This Fast

A provocative new opinion piece argues that the rapid pace of AI development poses greater existential risks than slowing down progress on medical breakthroughs like cancer cures. The author frames the debate as a stark trade-off between technological acceleration and societal safety.

via Hacker News AI#ai #technology #risk

researchJun 18, 2026

New AI Tool Predicts Patient Risks More Accurately Than Traditional Methods

Researchers have developed a machine-learned comorbidity index that better predicts patient outcomes. Unlike older methods, it captures complex relationships between diseases and health risks.

via ArXiv cs.AI#healthcare #ai #medical

researchJun 15, 2026

New AI Safety Framework: Risk-Aware Causal Gating for Smarter Decisions

Researchers introduced a new AI safety framework called Risk-Aware Causal Gating (RACG) that helps AI models make safer decisions by evaluating potential risks. This approach could prevent costly errors in AI-driven systems by deciding when to act, defer, or abstain from actions.

via ArXiv cs.AI#ai #safety #research

researchApr 17, 2026

NuHF Claw: AI Framework for Safer Nuclear Control Rooms

Researchers propose NuHF Claw, a risk-constrained AI agent framework designed to support human operators in digital nuclear control rooms. The system aims to mitigate cognitive risks while maintaining human authority in safety-critical environments.

via ArXiv cs.AI#ai #nuclear #safety