238 stories tagged LLMs
A new retrieval-augmented, multi-agent LLM framework with human-in-the-loop oversight improved detection of cutaneous immune-related adverse events from clinical notes, boosting accuracy (F1: 0.88 vs 0.77) and inter-rater agreement (kappa: 0.82 vs 0.50) while cutting review time by half.
A new study on ArXiv reveals that some large language models (LLMs) show systematic and consistent risk attitudes under uncertainty, tested across spatial navigation, clinical triage, and financial allocation tasks. The findings could inform the design of safer AI systems for high-stakes decisions.
Researchers introduced JOR-Bench, a collection of five Japanese-language benchmarks with 1,319 problems to evaluate how well large language models (LLMs) can formulate and solve operations research (OR) problems, covering linear programming, mixed-integer programming, non-linear programming, and combinatorial optimization.
Researchers introduced SkillCorpus, a framework to consolidate and evaluate the fragmented open-source SKILL.md ecosystem for LLM agents, aiming to improve real-world agent task performance.
Researchers introduce Prospective Hypothesis Discovery (PHD) and the HypoArena benchmark (988 cases) to evaluate how well large language models can autonomously generate grounded, discriminative, and testable hypotheses from anomalous observations and fragmented records.
A new arXiv study proposes converting all patient data—clinical narratives, vital signs, lab values, and comorbidities—into a single natural language sequence and fine-tuning a pretrained LLM, eliminating the need for task-specific fusion architectures in clinical prediction.
David Manheim's economic analysis compares the profitability of hyper-scalers (Google, Microsoft, Meta) against smaller AI labs, exploring which model will dominate the LLM market and shape the future of AI development.
Developer Hela Saoudi released LLM Inspector, an open-source tool that visualizes how large language models process information in real time. Like 'htop' for AI, it reveals attention patterns, token processing, and internal model workings, making AI less of a black box for developers and curious users alike.
Researchers fine-tuned LLaMA 3 (8B) with LoRA and 4-bit quantization to replace costly cross-encoders in RAG pipelines, achieving efficient real-time reranking for AI assistants and search tools.
Researchers have developed a neuro-agentic control framework that combines AI planning with traditional security systems. This could make industrial IoT environments safer by reducing the risk of costly downtime and physical damage from cyberattacks.
Researchers created MedRealMM, a real-world benchmark for medical AI that includes real patient-doctor conversations and medical images. This could lead to more accurate and reliable AI tools for online healthcare consultations.
Researchers introduced CogniConsole, a tool that improves AI reliability by managing how tasks are framed and context is selected. This approach shifts focus from model capabilities to better control during interactions.
AI companies are accumulating technical debt at an alarming rate, warns Seldon AI. This could slow down future progress and make AI systems harder to maintain. Most users won't notice immediately, but it affects how reliable and safe AI tools become over time.
A new research paper outlines how large language models (LLMs) are being used in healthcare, bridging the gap between clinical needs and AI capabilities. The study proposes a framework to align medical training standards with AI's potential in patient care.
Researchers have developed AI systems that can now tackle complex, open-ended math problems. These advances bring us closer to solving long-standing mathematical conjectures.
A new tool called Jacobian Fingerprinting can identify text written by large language models by analyzing subtle mathematical patterns. This could change how content is verified online, making it easier to spot AI-written material.
Researchers combined AI with math software to solve complex problems. This approach could make advanced mathematics more accessible to non-experts.
Researchers introduced FirstResearch, a framework that generates a structured Research Question Certificate for AI-suggested scientific questions. The certificate records primitive definitions, assumptions, and falsifiers, allowing scientists to audit the reasoning behind each question.
Researchers found that AI models can create realistic synthetic consumer responses for market research. This could make testing new products and campaigns faster and cheaper without needing real people.
Researchers developed Oyster-II, an AI safety system that helps models answer sensitive questions more constructively. It improves on previous approaches by providing useful information instead of just refusing requests.
Edgee.ai's new Compressor V2 reduces the cost of running AI agents by half using three layers of compression. This makes powerful AI tools far more affordable for businesses and developers.
Scientists found a flaw in how AI models process text, making them vulnerable to manipulation. This discovery could help improve AI safety by addressing gaps in current systems.
A new study shows that common methods for evaluating AI error detection can be misleading. The research introduces a controlled stress-test protocol called ErrorBench to reveal these flaws.
Researchers scaled up an AI oversight tool that catches deceptive behavior, reducing undetected lies from 34% to 14% in larger models. This could make AI systems more reliable for everyday users.