#research

Research

936 stories tagged Research · page 3 of 39

DrawingVQA: First AI Benchmark Tests Multimodal Models on Real-World Construction Drawings
research

DrawingVQA: First AI Benchmark Tests Multimodal Models on Real-World Construction Drawings

Researchers introduced DrawingVQA, the first benchmark to evaluate multimodal large language models (MLLMs) on real-world construction drawings — a uniquely complex domain fusing abstract geometry, symbols, tables, and technical text. The benchmark uses 33 professional 'Issued for Construction' drawings and 92 expert-crafted questions to test AI's visual-textual reasoning in architecture and civil engineering.

ArXiv Study: Information-Theoretic Limits Prove AI Reliability Has a Ceiling, Regardless of Scale
research

ArXiv Study: Information-Theoretic Limits Prove AI Reliability Has a Ceiling, Regardless of Scale

A new ArXiv paper proves that large language models (LLMs) have an inherent reliability ceiling that no amount of scaling can overcome. The study decomposes output uncertainty into a resolvable component (closable with more context) and a subjective component (inherent to task ambiguity), and shows that autoregressive generation further degrades this ceiling.

Theory-Level Autoformalization: AI That Formalizes Entire Theories, Not Just Isolated Statements
research

Theory-Level Autoformalization: AI That Formalizes Entire Theories, Not Just Isolated Statements

A new arXiv position paper from researchers argues for a shift in AI autoformalization from single statements to complete theories—including axioms, definitions, and lemmas—to create unified, machine-verifiable formal knowledge bases. This could transform how complex knowledge in mathematics, law, and science is structured and validated.

MAPS: New AI Framework Lets Agents Hold Conversations While Keeping Their Own Perspectives
research

MAPS: New AI Framework Lets Agents Hold Conversations While Keeping Their Own Perspectives

Researchers introduced MAPS (Multi-Agent Perspective Spaces), a framework that enables multiple AI agents to maintain individualized beliefs, emotions, and cognitive styles during dialogue, avoiding the semantic uniformity of current systems. It uses domain-weighted profiles, GRU-based memory, and token-level attention for interpretable, diverse interactions.

via ArXiv cs.CL#ai#research#dialogue