OpenAI Publishes Guide for Responsible AI Use
OpenAI has released a comprehensive guide on responsible AI use, emphasizing safety, accuracy, and transparency. The guide offers best practices for users of tools like ChatGPT.
#safety
Safety
157 stories tagged Safety · page 7 of 7
20-year-old arrested for Molotov attack on Sam Altman's home
A 20-year-old man was arrested for allegedly throwing a Molotov cocktail at OpenAI CEO Sam Altman's San Francisco home. The incident was captured on surveillance footage and followed threats outside OpenAI's offices.
Stalking Victim Sues OpenAI, Alleges ChatGPT Ignored Warnings
A woman is suing OpenAI, claiming ChatGPT enabled her stalker by fueling his delusions and ignoring her repeated warnings. The case raises critical questions about AI safety and accountability.
Safetensors Joins PyTorch Foundation to Enhance Open-Source AI Safety
Safetensors, a popular open-source library for secure model serialization, has joined the PyTorch Foundation. This move aims to improve AI safety standards and interoperability within the PyTorch ecosystem.
OpenAI's Model Spec: Balancing Safety and Freedom in AI Systems
OpenAI introduces the Model Spec, a public framework guiding model behavior to ensure safety while preserving user freedom. The approach emphasizes accountability as AI systems evolve.
OpenAI Introduces Teen Safety Policies for AI Developers
OpenAI has released prompt-based safety policies for developers using gpt-oss-safeguard to moderate age-specific risks in AI systems. These guidelines aim to help developers create safer AI experiences for teenage users.
New Research Frames Hallucinations as Output-Boundary Misclassification
Researchers propose a novel framework treating LLM hallucinations as output-boundary misclassification errors, introducing a composite abstention architecture. This system combines instruction-based refusal with a structural gate that blocks unsupported claims based on a calculated support deficit score.
Hugging Face Introduces EVA: A New Framework for Evaluating Voice Agents
Hugging Face has launched EVA, an open-source framework designed to rigorously evaluate the performance of voice AI agents. This tool addresses the critical need for standardized metrics in assessing voice interaction quality, reliability, and safety.
DOVE: A New Framework for Evaluating LLM Cultural Value Alignment
Researchers introduce DOVE, a distributional evaluation framework that compares human text distributions with LLM outputs to assess cultural value alignment. This method overcomes the limitations of traditional multiple-choice benchmarks by addressing the C3 challenge of context, composition, and subcultural heterogeneity.
Blind Refusal: AI Models Fail Moral Reasoning by Obeying Unjust Rules
New research reveals that safety-trained language models routinely refuse requests to help users evade unjust, absurd, or illegitimate rules. This phenomenon, termed 'blind refusal,' highlights a critical gap in AI moral reasoning where compliance overrides ethical judgment.
AI Scans 400k Reddit Posts to Flag Overlooked GLP-1 Side Effects
A new study leverages AI to analyze 400,000 Reddit posts, uncovering previously underreported side effects of GLP-1 weight loss drugs. This approach demonstrates how social media mining can accelerate pharmacovigilance beyond traditional clinical trials.
OpenAI Launches Safety Fellowship
OpenAI introduces a pilot program to support independent safety research. The fellowship aims to develop the next generation of talent in AI safety and alignment.
OpenAI Launches Safety Bug Bounty
OpenAI introduces a Safety Bug Bounty program to identify AI safety risks. The program aims to detect vulnerabilities like agentic risks and data exfiltration.