#medicine

Medicine

15 stories tagged Medicine

AI Watermarks in Medical Texts: Study Finds Critical Failures That Risk Patient Safety
research

AI Watermarks in Medical Texts: Study Finds Critical Failures That Risk Patient Safety

A new study from ArXiv cs.AI reveals that AI watermarks, designed to track machine-generated text, often fail in medical contexts. Researchers tested five watermarking schemes across 11 large language models (LLMs) and 7 vision-language models (VLMs) on various medical tasks. The findings show that small token-level perturbations introduced by watermarks can cause significant semantic changes, potentially leading to misdiagnoses or other serious errors in clinical settings. The study underscores the urgent need for domain-specific watermarking methods tailored to high-stakes fields like healthcare.

New Benchmark Tests AI's Ability to Design Real Drugs
research

New Benchmark Tests AI's Ability to Design Real Drugs

Researchers created a new test to see if AI can handle real-world drug design. This could change how we discover life-saving medications. The test, called SMDD-Bench, is the first to evaluate AI's ability to design drugs for real-world use. It focuses on small molecule drug design, a key area in medicine. The SMDD-Bench is a challenging, multi-turn, long-horizon agentic benchmark consisting of 502 tasks. It covers diverse chemistries and targets, making it a comprehensive test for AI's capabilities in drug design. This benchmark is designed to be more realistic than previous tests. It includes multi-turn interactions, which mimic the real-world process of drug design. This makes it a valuable tool for evaluating AI's potential in this field.