69 stories tagged Efficiency
OpenAI highlights how AI-native companies Basis, Clay, and Exa Labs use AI agents to automate onboarding, account management, and developer integrations, offering lessons for enterprise leaders.
Researchers introduced SchemaRouter, a lightweight routing layer that reduces unnecessary data requests and ensures all needed fields are included when AI agents query heterogeneous tools. This addresses over-fetching and under-fetching in agentic RAG systems, making AI responses faster and more accurate.
IBM Research introduced AltK-Evolve, a method that reduces the number of tokens AI models need to process text by dynamically adapting token allocation based on task complexity, improving efficiency over fixed-token approaches.
Researchers have developed a method to predict which visual tokens are most important in multimodal AI models, making them more efficient. This could lead to faster and cheaper AI systems for tasks like image captioning and visual question answering.
Researchers introduced EntropyMoE, a Mixture-of-Experts architecture that dynamically routes byte patches to specialized experts based on text entropy, making tokenizer-free language models more efficient and adaptable.
Anthropic, the company behind Claude, is assembling a team to design its own AI chips. This move aims to make its AI models run faster and more efficiently by co-designing hardware and software together.
Researchers introduced Motif-Mamba, an improved version of the Mamba model that enhances long-sequence modeling efficiency. It uses network motifs to enable better interactions among state dimensions, addressing a key limitation of previous models.
OpenAI's GPT-5.6 improves AI efficiency across models, inference, and workflows, delivering more useful intelligence per dollar. It offers significant speed and cost improvements over previous versions.
A new arXiv study reveals that frontier reasoning models fail solvable problems due to 'context anxiety'—premature self-doubt caused by an inability to estimate required tokens. This leads to significant efficiency losses and shorter, less accurate responses.
A developer open-sourced jcode, a coding agent harness that boots 245 times faster than Claude Code, rendering its first frame in 14 milliseconds and using only 27.8 MB of RAM per active session.
Stanford researchers introduced AgentKVShift, a training-free technique that reduces the cost of AI memory systems by up to 90% by reusing key-value (KV) caches for structured memory units like summaries and tags, making AI agents significantly more efficient.
New York Governor Kathy Hochul revealed on Bloomberg's Odd Lots podcast that her team is using AI to analyze every state rule, regulation, and policy to identify outdated or ineffective ones. The goal is to streamline government operations, but the initiative also raises questions about privacy and bias in AI decision-making.
Researchers created a way to measure how well AI tools work together. It helps AI assistants use the right tools at the right time, making them faster and more reliable.
Researchers propose TAKE (Trajectory-Aware Knowledge Estimation), a text dataset distillation framework that reduces corpora to as little as 0.1% of their original size while preserving downstream task fidelity, using influence functions to select the most valuable samples.
Researchers fine-tuned LLaMA 3 (8B) with LoRA and 4-bit quantization to replace costly cross-encoders in RAG pipelines, achieving efficient real-time reranking for AI assistants and search tools.
Researchers developed a way to test AI models using smaller, representative subsets of benchmark prompts. This could make AI evaluation faster and more practical without sacrificing accuracy.
Researchers have developed a new method called KV-PRM that makes multi-agent AI systems more efficient. This could lead to faster, more capable AI collaborations in complex scenarios. The technique reduces the computational cost of evaluating long interactions, making it practical for real-world applications.
Researchers introduced HALO, a method to enhance existing AI language models with minimal extra computation. It selectively refines responses, improving accuracy without wasting resources.
Researchers developed a new AI planning method called GATS that reduces computational costs and improves reliability by eliminating LLM calls during inference. It could make AI assistants more efficient at complex tasks.
NVIDIA is creating AI models that are optimized to work seamlessly with their hardware. This approach could make AI systems faster and more efficient for everyone.
A new paper argues that the key to controlling enterprise AI costs lies in the 'harness'—the orchestration layer that manages context, tools, and workflows. Without careful design, AI systems fall into 'token maxing,' where costs grow faster than value. The study shows that a well-designed harness can dramatically reduce token usage and expenses.
Researchers introduced Akashic, a low-overhead memory system for LLM inference that uses MemAttention to organize context into bounded chunks and model semantic relationships. This could make chatbots and AI assistants much more efficient and accurate by reducing prefill costs and avoiding context limits.
A LessWrong article argues that trees, which are mostly air, offer a counterintuitive lesson for AI safety: true safety comes from structural resilience, not merely from efficiency or sustainability. The draft oversimplifies this by focusing on resource efficiency rather than the article's core point about failure modes and robustness.
Researchers have introduced Wiola, a novel small language model architecture that breaks from existing designs. It incorporates five unique components aimed at improving efficiency and performance.