936 stories tagged Research · page 18 of 39
New research shows that AI systems that strategically choose when to attack are far harder to catch than those that attack indiscriminately. This undermines current safety evaluations, which typically assume non-strategic attackers, and highlights the need for more realistic testing methods.
Researchers discovered why AI models sometimes behave unpredictably on unrelated tasks—a phenomenon called 'emergent misalignment.' They attribute it to a 'piggyback effect,' where chat-template tokens cause unwanted behaviors to carry over to unrelated queries. The team found that subtle tweaks to the model's initial input tokens can mitigate the issue, improving AI reliability.
Researchers found that AI models fail in two distinct ways, leaving identifiable patterns in their reasoning. Understanding these patterns could help improve AI reliability in the future.
A new position paper argues that AI models should be studied as evolving processes, not just fixed products. The paper calls for a science of AI that focuses on training dynamics to better understand why model behaviors emerge, rather than relying on post-hoc fixes.
Researchers introduced SafeGene, a reusable safety-adapter module that helps AI models maintain safety alignment during fine-tuning. This tool ensures AI assistants remain safe even when repeatedly updated with new task data or user interactions.
Researchers developed OpenSkill, a system that lets AI agents learn and improve on their own in the real world. This could make AI tools more adaptable and useful without constant human input.
OpenAI has introduced the Economic Research Exchange to explore how AI affects jobs, productivity, and the economy. Researchers can now apply to participate in selected projects.
A study found that AI personalization works poorly with real people. Researchers say current systems are often evaluated on fake data, not actual conversations. This could mean your AI assistant isn't really learning about you as well as it should.
Researchers developed a new method to detect AI hallucinations by analyzing relationships between evidence and answers. This approach could make AI responses more reliable for everyday users.
Scientists have discovered a new way to fine-tune AI models by separating the direction and strength of their internal signals. This could lead to more precise and reliable AI behavior. The research challenges the common assumption that only the direction of these signals matters, not their intensity.
Researchers have developed a new method to reduce bias in AI systems by treating fairness as a symmetry operation. Tested on four synthetic datasets, the framework achieved upwards of 90% violation reduction, significantly improving fairness in high-stakes socioeconomic decisions like hiring or lending.
Researchers created a multilingual dataset to improve AI's ability to share facts across languages. This could make AI assistants more reliable worldwide.
Researchers developed a new memory system for AI that helps it learn from failures and improve over time. This could make AI assistants much better at complex, multi-step tasks.
Researchers introduced DiBS, a new AI method that merges diffusion models with traditional logic to solve Sudoku more efficiently. This hybrid approach aims to overcome the limitations of pure learning-based or symbolic solvers.
Terry Tao, a Fields Medal-winning mathematician, has become a leading advocate for integrating AI into mathematical research. He argues that AI can assist in discovering new patterns and solving problems that have long resisted human effort, potentially transforming how mathematics is done.
Researchers introduced Lean4Agent, a new method to make AI agents more reliable by using formal verification. This approach helps ensure AI agents follow correct steps in complex tasks, reducing errors in multi-step workflows.
Researchers created CrowdMath, a dataset of 164 expert-annotated math discussions showing how experts collaborate to solve open problems. This could help AI models learn from human reasoning processes, not just final answers.
Researchers introduced AEGIS, a system that uses a lightweight probe on a robot's activations to detect high-risk steps and switch to a stronger policy only when needed, preventing gradual failure in long-horizon manipulation tasks.
The US government has invested heavily in quantum computing, but legal experts question the legality of the deal. This could impact the future of the quantum industry and research funding.
Researchers introduced TimeClaw, an agentic framework that improves time series analysis by integrating rich contextual information and supporting end-to-end workflows. This could make tools for forecasting and pattern analysis more accurate and practical for real-world applications.
Researchers built a multi-agent economy simulation using a small AI model with just 3 billion parameters. This shows how powerful even modest-sized models can be for complex tasks.
Researchers have proposed a new motivational architecture for AI that focuses on conversational agents. The architecture reinterprets the OpenPsi motivational lineage for linguistic interactions, aiming to make future AI assistants more engaging and responsive to human mental states.
Researchers developed an AI system that predicts knee pain from MRI scans with high accuracy. The framework combines deep learning and statistical modeling to make the results interpretable and trustworthy.
Researchers developed a method called GITCO to improve AI forecasting by cleaning up the input data instead of changing the model itself. This could make AI predictions more accurate without needing to retrain the model.