#ai

AI

1496 stories tagged AI

Researchers Discover That MoE Routing in AI Models Follows Huffman Coding and a 'Frequency-Diversity Law'
research

Researchers Discover That MoE Routing in AI Models Follows Huffman Coding and a 'Frequency-Diversity Law'

A new study reveals that Mixture-of-Experts (MoE) models like Phi-3.5-MoE and Gemma-4-27B-A4B route tasks using a principle equivalent to Huffman Coding. The 'Frequency-Diversity Law' explains how these models allocate sparse expert resources to common tokens and diverse expert committees to rare tokens, acting as information-theoretic engines.

AlphaAgent: Google DeepMind's Skill-Driven AI for Materials Science Literature Analysis
research

AlphaAgent: Google DeepMind's Skill-Driven AI for Materials Science Literature Analysis

Google DeepMind released AlphaAgent, a skill-driven AI framework that decouples retrieval-based question answering from paper-level report generation for materials science literature analysis. Unlike conventional RAG pipelines, AlphaAgent uses explicit skill contracts to handle composition, processing, characterization, and property relationships simultaneously.