936 stories tagged Research · page 33 of 39
A new study explores how Large Language Models (LLMs) respond to legal arguments and the factors influencing their decisions. The research highlights the importance of understanding LLMs' persuadability in judicial and administrative contexts.
A new study questions the assumption that symbol grounding automatically leads to compositional reasoning in neuro-symbolic systems. The research introduces a novel framework to disentangle these two critical capabilities.
Researchers propose a novel approach to estimate the parameter count of black-box language models by analyzing their factual capacity. This method could revolutionize benchmarking and comparison of proprietary models.
Researchers have developed a new jailbreak technique called Incremental Completion Decomposition (ICD) that exploits LLMs by eliciting single-word continuations before extracting harmful responses. This method bypasses current safety mechanisms, raising concerns about the robustness of LLM safeguards.
Researchers introduce BTF-2, a benchmark with 1,417 pastcasting questions, to analyze AI forecasters' reasoning. The study identifies accuracy differences as small as 0.004 Brier score and builds a more accurate composite forecaster.
A new study evaluated 72 large language models on safety for robotic health attendants, finding a 54.4% average violation rate. The results highlight significant risks in deploying LLMs for medical applications without rigorous safety protocols.
DreamProver introduces a novel approach to theorem proving by creating transferable lemma libraries through an iterative wake-sleep process. This method enhances adaptability compared to fixed or overly specific lemma libraries.
Researchers introduce Distill-Belief, a teacher-student framework to address the challenge of closed-loop inverse source localization and characterization. This method aims to balance speed and accuracy in uncertain environments.
Researchers introduce BioGraphletQA, a new biomedical QA dataset with 119,856 pairs. The framework uses Knowledge Graph subgraphs to ensure factual grounding and control complexity.
Researchers discovered that providing one confirmed fact in a multi-step reasoning chain increases LLMs' likelihood of confidently producing wrong answers. This phenomenon, called anchored confabulation, challenges assumptions about how models handle partial evidence.
A new study analyzes intermediate reasoning steps of LLMs to reveal stigmatizing language and biases toward mental health conditions. The findings highlight limitations of traditional evaluation methods.
A GitHub project demonstrates how large language models can assist in reconstructing partially decompiled code. The project focuses on Minecraft 26.1.2, showcasing AI's potential in reverse engineering.
A new study reveals that training AI models on power-law distributed data improves their performance on complex reasoning tasks. This challenges the assumption that uniform data distributions are superior for learning rare skills.
Researchers introduce PExA, a novel approach to text-to-SQL generation that balances latency and performance by using parallel test cases. The method ensures semantic coverage before finalizing the SQL query.
Researchers propose a roundtrip verification approach to ensure LLMs produce faithful formalizations of natural language. The method involves translating and re-formalizing statements to check for logical equivalence.
Researchers propose a structured approach to debugging LLMs, treating them as observable systems. The method offers model-agnostic techniques for issue detection and refinement, addressing the complexity of LLM errors.
Researchers propose a new AI-driven framework for aircraft fault diagnosis using digital twins and LLMs. The method addresses data scarcity and diverse fault types in general aviation. The system integrates high-fidelity simulations, fault injection, and interpretable report generation to improve diagnostic accuracy.
A new study shows that belief graphs significantly improve weaker LLMs in cooperative reasoning tasks, while stronger models see minimal benefits. The research highlights the importance of integration architecture in leveraging these graphs effectively.
Researchers introduce the Superminds Test to measure collective intelligence in large-scale agent societies. The study examines MoltBook's two million agents to determine if intelligence emerges from scale.
Researchers found that the variability in LLM responses to different prompt styles stems from shared underlying task representations. This explains why the same question can yield different answers depending on phrasing.
A new study formalizes the concept of 'background temperature' to describe implementation-level nondeterminism in large language models. This helps explain why identical inputs can produce divergent outputs even at temperature T=0.
A new study explores how LoRA adapters should be placed in hybrid language models, finding that attention components benefit more than recurrent layers. The research evaluates two hybrid architectures across multiple domains and benchmarks.
Researchers introduce OneManCompany (OMC), a framework to structure multi-agent systems with dynamic team formation and governance. This approach decouples organizational strategy from individual agent skills, enabling more flexible and scalable AI workflows.
A new paper introduces metrics to evaluate the effectiveness of reinforcement learning from verifiable rewards (RLVR) in language models. The study finds that reasoning chains may not always be causally important or sufficient for verifying answers.