255 stories tagged LLMs · page 7 of 11
Researchers introduce a lightweight retrieval-augmented generation (RAG) framework to improve patient-trial matching. The approach balances scalability and efficiency with the ability to handle complex EHR data and eligibility criteria.
Researchers developed a control-theoretic framework to determine when iterative self-correction improves LLM performance. The study introduces a Markov model diagnostic to assess whether repeated refinement helps or hurts accuracy.
Researchers introduce SHAPE, a new benchmark to evaluate educational LLMs under adversarial conditions. The study highlights 'pedagogical jailbreaks' where students manipulate LLMs to provide answers instead of learning guidance.
A new taxonomy identifies risks like deception and reward hacking in advanced AI systems. The framework aims to benchmark these behaviors as models grow more capable.
A new AI usage analytics tool acts as a proxy to enforce budget limits and redact personally identifiable information before requests reach the provider. It offers real-time cost tracking and immediate suspension when thresholds are breached.
A new paper highlights the risks of AI agents producing selectively chosen, publishable analyses that lack rigorous validation. The study calls for adversarial experiments to ensure scientific integrity.
Researchers developed an AI system that can reproduce social science findings using only paper descriptions and raw data. The method achieves deterministic, cell-level result comparisons without access to original code or outputs.
Routiium is a new self-hosted, OpenAI-compatible LLM gateway that includes a unique tool-result guard feature. This innovation addresses a critical security gap in LLM agent loops by monitoring tool outputs, not just user inputs.
LLM-Rosetta is an open-source tool that standardizes API calls across OpenAI, Anthropic, and Google's large language models. It simplifies integration for developers by abstracting provider-specific differences.
Researchers introduce COMPASS, a system that automates prompt engineering for generating human-understandable explanations of AI task planning. The tool addresses the critical need for reliable, stakeholder-specific explanations in complex software systems.
Researchers developed a novel approach for LLMs to co-evolve decision-making and skill banks, significantly improving performance in complex, long-horizon game environments. This method addresses key challenges in multi-step reasoning and delayed rewards.
ThermoQA is a new benchmark for evaluating LLMs on engineering thermodynamics problems. It shows significant performance drops as problem complexity increases, with top models like Claude Opus 4.6 leading at 94.1%.
A comprehensive guide for running large language models on a 64GB RAM device has been released. It covers practical tips for optimizing performance in code and math applications.
Graeme (@gkisokay) shares a curated list of powerful local LLMs that run efficiently on 32GB RAM machines. This opens up flagship-class models to a wider range of users.
Hugging Face introduces QIMMA, a quality-focused leaderboard for Arabic LLMs. It aims to highlight models that excel in both performance and cultural relevance.
Researchers have identified a pervasive phenomenon called 'tool overuse' in large language models, where they unnecessarily rely on external tools instead of internal knowledge. The study explores the underlying mechanisms behind this behavior, highlighting a 'knowledge epistemic illusion' where models misjudge their own capabilities.
Researchers propose hierarchical policy optimization to improve simultaneous speech translation (SST) efficiency. The method leverages LLM KV cache reuse, reducing computational overhead without requiring extensive dialogue annotations.
A new study compares how different FHIR data serialization formats affect LLM performance in medication reconciliation tasks. The findings highlight significant differences in accuracy across serialization methods.
Researchers propose an explainable AML triage framework using LLMs to handle transaction alerts while mitigating hallucinations and ensuring compliance. The approach emphasizes evidence-constrained decision-making to improve auditability and governance.
Researchers introduce DWTSumm, a Discrete Wavelet Transform (DWT)-based method to enhance LLM summarization of long, domain-specific documents. The approach decomposes text into global and local components, preserving structure and critical details.
DeepSeek-V4 introduces a one-million-token context window, making it the largest available. This breakthrough enables agents to process extensive documents and conversations with unprecedented context retention.
Researchers have developed an autonomous LLM agent that can independently formulate, test, and refine materials science theories. The agent successfully replicated established equations like the Hall-Petch equation and Paris law without human intervention.
A new paper provides a comprehensive review of externalization techniques in LLM agents, focusing on memory and harness engineering. It highlights key advancements and challenges in the field.
Researchers propose TTKV, a temporal-tiered KV cache that prioritizes recent memories in LLMs, improving efficiency for long-context inference. This method mimics human memory systems, offering a more scalable solution than existing approaches.