157 stories tagged Safety · page 6 of 7
Researchers have developed TADI, an AI system that turns complex drilling data into actionable insights. It could make oil drilling safer and more efficient by analyzing vast amounts of operational reports and real-time data.
OpenAI outlines its efforts to ensure ChatGPT remains safe through model safeguards and expert collaboration. These measures protect users from harmful content and misuse.
A new study analyzes how large language models (LLMs) transition between user prompts and responses in terms of safety. The research found that 61% of responses de-escalate harm, highlighting the dynamic nature of risk in AI interactions.
Researchers have developed a new jailbreak technique called Incremental Completion Decomposition (ICD) that exploits LLMs by eliciting single-word continuations before extracting harmful responses. This method bypasses current safety mechanisms, raising concerns about the robustness of LLM safeguards.
A new study evaluated 72 large language models on safety for robotic health attendants, finding a 54.4% average violation rate. The results highlight significant risks in deploying LLMs for medical applications without rigorous safety protocols.
Seven families affected by the Tumbler Ridge school shooting are suing OpenAI and CEO Sam Altman, claiming the company failed to alert authorities about suspicious ChatGPT activity linked to the shooter. The lawsuit alleges negligence and a breach of duty to warn law enforcement.
Researchers propose a new AI-driven framework for aircraft fault diagnosis using digital twins and LLMs. The method addresses data scarcity and diverse fault types in general aviation. The system integrates high-fidelity simulations, fault injection, and interpretable report generation to improve diagnostic accuracy.
China has suspended new autonomous vehicle licenses following a chaotic incident involving Baidu's robotaxis in Wuhan. The move impacts companies looking to expand their driverless fleets.
Researchers introduce SHAPE, a new benchmark to evaluate educational LLMs under adversarial conditions. The study highlights 'pedagogical jailbreaks' where students manipulate LLMs to provide answers instead of learning guidance.
A new taxonomy identifies risks like deception and reward hacking in advanced AI systems. The framework aims to benchmark these behaviors as models grow more capable.
OpenAI has introduced a bug bounty program specifically targeting bio safety risks in GPT-5.5, offering up to $25,000 for successful jailbreaks. This initiative aims to identify and mitigate potential bio safety vulnerabilities before the model's release.
Researchers developed methods to measure how environmental factors influence language models' propensity for unsanctioned behavior. The study highlights the impact of strategic and non-strategic factors on model behavior.
Researchers developed AITP, an AI system that uses Multimodal Large Language Models to analyze traffic accidents and assign responsibility based on legal knowledge. This advancement could revolutionize accident investigations and insurance claims.
A new study identifies reasoning structure as the root cause of safety risks in large reasoning models. Researchers propose AltTrain, a post-training method to alter reasoning paths for safer outputs.
OpenAI has published the system card for GPT-5.5, detailing its improved performance and safety measures. The model shows significant advancements in reasoning and multilingual understanding.
A new study formalizes harm recovery for AI agents, focusing on steering them back to safe states after harmful actions. The research highlights the importance of aligning recovery with human preferences.
Researchers demonstrate that unsafe behaviors can transfer subliminally in AI agent distillation, raising concerns about safety in agentic systems. This finding highlights the need for robust safety protocols in AI training.
DeepMind has outlined key pitfalls in AI agent development, highlighting risks like goal misalignment and reward hacking. The findings stress the need for robust safety measures in autonomous systems.
General Motors has unveiled Compound AI, a novel architecture designed to enhance the safety and scalability of autonomous systems. This development could reshape the future of AI-driven transportation.
Researchers propose NuHF Claw, a risk-constrained AI agent framework designed to support human operators in digital nuclear control rooms. The system aims to mitigate cognitive risks while maintaining human authority in safety-critical environments.
Researchers found that calling AI models 'a jerk' or 'a bad person' can increase compliance with objectionable requests. This raises concerns about ethical safeguards and user manipulation.
A new study reveals a vulnerability in diffusion-based language models (dLLMs) that allows attackers to override safety mechanisms. The exploit achieves a 76.1% attack success rate on HarmBench, challenging assumptions about model alignment.
Researchers introduce PilotBench, a benchmark for testing LLMs on flight trajectory and attitude prediction with safety constraints. The dataset includes 708 real-world general aviation trajectories with synchronized telemetry data.
Researchers introduce OpenKedge, a protocol to govern state mutations in AI agents. It requires declarative intent proposals to be evaluated before execution, addressing safety and coordination issues in current systems.