#research

Research

1100 stories tagged Research · page 10 of 46

DrawingVQA: First AI Benchmark Tests Multimodal Models on Real-World Construction Drawings
research

DrawingVQA: First AI Benchmark Tests Multimodal Models on Real-World Construction Drawings

Researchers introduced DrawingVQA, the first benchmark to evaluate multimodal large language models (MLLMs) on real-world construction drawings — a uniquely complex domain fusing abstract geometry, symbols, tables, and technical text. The benchmark uses 33 professional 'Issued for Construction' drawings and 92 expert-crafted questions to test AI's visual-textual reasoning in architecture and civil engineering.

ArXiv Study: Information-Theoretic Limits Prove AI Reliability Has a Ceiling, Regardless of Scale
research

ArXiv Study: Information-Theoretic Limits Prove AI Reliability Has a Ceiling, Regardless of Scale

A new ArXiv paper proves that large language models (LLMs) have an inherent reliability ceiling that no amount of scaling can overcome. The study decomposes output uncertainty into a resolvable component (closable with more context) and a subjective component (inherent to task ambiguity), and shows that autoregressive generation further degrades this ceiling.

MAPS: New AI Framework Lets Agents Hold Conversations While Keeping Their Own Perspectives
research

MAPS: New AI Framework Lets Agents Hold Conversations While Keeping Their Own Perspectives

Researchers introduced MAPS (Multi-Agent Perspective Spaces), a framework that enables multiple AI agents to maintain individualized beliefs, emotions, and cognitive styles during dialogue, avoiding the semantic uniformity of current systems. It uses domain-weighted profiles, GRU-based memory, and token-level attention for interpretable, diverse interactions.