1100 stories tagged Research · page 4 of 46
A new ArXiv study finds that semantic convergence in large language models begins during the pretraining phase, not just the alignment process. The research shows that output homogeneity is observed from the first alignment stage (instruction-tuning/SFT), suggesting it is learned early and only magnified later. This challenges the common assumption that diversity loss is primarily an alignment problem.
Researchers introduced DonorRank, a learning-to-rank framework that predicts the best 'donor' languages for training zero-shot automatic speech recognition (ASR) models, evaluated on Indic and African language corpora.
A new study from ArXiv cs.CL reveals that four seemingly minor architectural decisions, each adopted by at least one of the Olmo, Llama, or Qwen model families, have a compoundingly negative effect on long-context extensibility. Any one choice alone has a minor impact, but combining three or more can cause significant performance drops.
Google Research's AMIE AI system successfully demonstrated real-time clinical video consultations in a simulated setting, marking a significant step toward AI-assisted medical consultations.
Anthropic revealed that an unreleased AI model made unexpected progress on the Riemann hypothesis, a 150-year-old unsolved math problem. The model identified patterns human mathematicians missed, demonstrating AI's potential to assist in theoretical mathematics.
A new arXiv paper advocates using computational argumentation as a formal foundation for Evaluative AI (EAI), an approach that presents competing hypotheses with evidence for and against each, rather than a single recommendation. This could make AI decision-making more explainable and open to human challenge.
A new arXiv paper demonstrates that language models can be trained to be inherently interpretable, explaining their reasoning as they learn, and that this interpretability scales with model capability rather than acting as a trade-off.
Researchers introduced WebGrader, a self-evolving programmatic grader that autonomously evaluates AI-generated websites, overcoming the reward-design bottleneck in reinforcement learning for web development. This could enable more reliable and functional AI-generated websites from natural-language descriptions.
Researchers introduce ADIAS (Automated Design of Interactive Agentic Systems), a new method that shifts AI agent design from a candidate-centric to an issue-centric approach, making the repair process more transparent and efficient.
Researchers have developed a new approach to improve multi-label node classification in graphs, enhancing cross-domain generalization. This could make AI systems better at understanding complex, real-world data structures.
Researchers have developed a method to predict which visual tokens are most important in multimodal AI models, making them more efficient. This could lead to faster and cheaper AI systems for tasks like image captioning and visual question answering.
Researchers introduced KNOWPLAN, an AI system that first reconstructs a university's curriculum from scattered sources (catalogs, PDFs, JSON endpoints) and then optimizes a student-specific degree path. By separating these two steps, the system avoids hidden errors common in traditional planning tools.
Researchers introduced EntropyMoE, a Mixture-of-Experts architecture that dynamically routes byte patches to specialized experts based on text entropy, making tokenizer-free language models more efficient and adaptable.
Researchers introduced 'Shape Your Feed,' an LLM-based agentic system that lets users control their content feed using natural language commands, closing the gap between explicit user preferences and passive algorithmic recommendations.
Google's 27-year veteran Jeff Dean is leaving to co-found Discovery Loop, while DeepMind CEO Demis Hassabis transitions to chairman. The executive shifts arrive alongside major research reveals from OpenAI and Google.
A new ArXiv paper warns that current self-evolution algorithms for large language models (LLMs) can improve capabilities while inadvertently losing essential safety functions. The researchers propose 'circuit anchors'—a mechanism inspired by biological developmental constraints—to preserve core safety mechanisms during AI evolution.
A new ArXiv study of eight frontier LLMs shows that biased user inputs systematically increase bias in AI responses, using a benchmark of 24,300 jury-validated prompts across a 9x9 bias interaction matrix.
Researchers found that different AI models can share understanding of concepts without direct training together. This discovery could make AI systems more adaptable and efficient.
Researchers found that large language models (LLMs) can often identify anonymous academic papers. This threatens the integrity of double-blind peer review, which relies on anonymity to prevent bias. The study shows that LLMs can match titles and abstracts to authors, even without full access to the papers.
Researchers from the University of Miami and NOAA developed CycloneNet, an AI model that forecasts tropical cyclone paths and intensities with 95% accuracy, outperforming traditional physics-based models and promising to improve disaster preparedness.
Jeff Dean, former head of Google's AI division, and several other top researchers are leaving Google to start a new company focused on using AI to accelerate scientific discovery.
Researchers introduced Nova, an automated end-to-end JIT compiler for deep learning that maps high-level mathematical operations directly to hardware. It promises to improve AI model performance and energy efficiency by providing whole-graph visibility and granular control over hardware and memory.
A first-of-its-kind analysis of 761 million LLM calls from GitHub Copilot traces reveals that AI coding agents produce sparse, autonomous workloads distinct from chatbots, with major implications for AI system design and infrastructure.
Researchers introduced Motif-Mamba, an improved version of the Mamba model that enhances long-sequence modeling efficiency. It uses network motifs to enable better interactions among state dimensions, addressing a key limitation of previous models.