38 stories tagged AI Security · page 2 of 2
Hackers are finding ways to manipulate AI chatbots by exploiting their programmed personalities. This highlights the need for better safeguards as AI becomes more integrated into daily life.
AI agents working together can solve complex problems better than single agents, but this collaboration introduces new security risks. Researchers warn that trust must be built into these networks from the start, not added later.
Anthropic's AI system, Mythos, discovered critical security bugs in Firefox. This could lead to safer web browsing for everyone. Mozilla is now using AI to proactively find and fix vulnerabilities before they become problems.
The US State Department has issued a global warning about alleged AI technology theft by Chinese company DeepSeek. This highlights growing tensions over AI competition and intellectual property between the US and China.
Researchers propose TRUST, a decentralized framework to address robustness, scalability, opacity, and privacy challenges in AI systems. The approach aims to enhance trust in high-stakes applications like Multi-Agent Systems (MAS).
Researchers have developed a new jailbreak technique called Incremental Completion Decomposition (ICD) that exploits LLMs by eliciting single-word continuations before extracting harmful responses. This method bypasses current safety mechanisms, raising concerns about the robustness of LLM safeguards.
A recent study revealed five critical AI agent failures over a 36-day period, none of which were detected by the agents themselves. This highlights significant gaps in AI self-monitoring and security protocols.
A new study reveals previously unknown attack vectors in sandboxed AI agents, challenging assumptions about their security. The findings highlight the need for enhanced isolation techniques and continuous monitoring.
Anthropic's tightly controlled rollout of Claude Mythos has been compromised, with unauthorized users gaining access. This incident contradicts the company's claims about the model's security capabilities and potential dangers.
A surge in misconfigured RAG pipelines has left vector databases exposed to the public internet without authentication. A live map now visualizes the scale of this critical security flaw, highlighting the risks of rushed AI adoption.
Anthropic's powerful Mythos AI model, intended for cybersecurity, has been accessed by unauthorized users. The breach raises concerns about the misuse of advanced AI tools. The leak occurred through a third-party contractor, highlighting vulnerabilities in AI security protocols.
MythosAI has opened early access to the first AI Red Team OS, designed to help organizations test and secure their AI systems. This tool is expected to revolutionize AI security by providing a comprehensive platform for adversarial testing.
A new study highlights the risks of malicious attacks on the LLM supply chain, demonstrating how agents can be compromised. The findings underscore the need for robust security measures in AI development.
Anthropic has delayed the release of its new model, Mythos, citing concerns over its ability to exploit software vulnerabilities. Critics question whether the move is more about protecting Anthropic's competitive edge than global cybersecurity.