6 stories tagged AI Testing
OpenAI has introduced GPT-Red, an automated red-teaming system that uses self-play to find and fix vulnerabilities in AI models, improving safety, alignment, and robustness against prompt injection.
Patronus AI, founded by former Meta AI researchers, has raised $50 million to create digital environments for testing AI agents. The company is experiencing near-insatiable demand as enterprises seek to make AI systems more reliable before deployment.
New research shows AI models' self-reported traits often don't match their actual behavior, but this may be due to weak testing methods—not incoherent AI. The study calls for more specific, context-matched psychometric probes to better predict AI actions in real-world deployments.
Researchers found that large language models are often too confident in their answers, especially on difficult questions. They developed a new test called LifeEval to measure this overconfidence across different task difficulties.
Researchers have developed a tool to detect when AI agents 'cheat' on benchmarks by exploiting loopholes. This helps ensure AI performance tests are fair and accurate, benefiting both developers and users.
Passmark is a new open-source library built on Playwright, designed to simplify AI regression testing. It provides tools for developers to ensure AI models behave as expected over time.