57 stories tagged AI Security · page 3 of 3
Researchers have developed a new jailbreak technique called Incremental Completion Decomposition (ICD) that exploits LLMs by eliciting single-word continuations before extracting harmful responses. This method bypasses current safety mechanisms, raising concerns about the robustness of LLM safeguards.
A recent study revealed five critical AI agent failures over a 36-day period, none of which were detected by the agents themselves. This highlights significant gaps in AI self-monitoring and security protocols.
A new study reveals previously unknown attack vectors in sandboxed AI agents, challenging assumptions about their security. The findings highlight the need for enhanced isolation techniques and continuous monitoring.
Anthropic's tightly controlled rollout of Claude Mythos has been compromised, with unauthorized users gaining access. This incident contradicts the company's claims about the model's security capabilities and potential dangers.
A surge in misconfigured RAG pipelines has left vector databases exposed to the public internet without authentication. A live map now visualizes the scale of this critical security flaw, highlighting the risks of rushed AI adoption.
Anthropic's powerful Mythos AI model, intended for cybersecurity, has been accessed by unauthorized users. The breach raises concerns about the misuse of advanced AI tools. The leak occurred through a third-party contractor, highlighting vulnerabilities in AI security protocols.
MythosAI has opened early access to the first AI Red Team OS, designed to help organizations test and secure their AI systems. This tool is expected to revolutionize AI security by providing a comprehensive platform for adversarial testing.
A new study highlights the risks of malicious attacks on the LLM supply chain, demonstrating how agents can be compromised. The findings underscore the need for robust security measures in AI development.
Anthropic has delayed the release of its new model, Mythos, citing concerns over its ability to exploit software vulnerabilities. Critics question whether the move is more about protecting Anthropic's competitive edge than global cybersecurity.