58 stories tagged Efficiency
New York Governor Kathy Hochul revealed on Bloomberg's Odd Lots podcast that her team is using AI to analyze every state rule, regulation, and policy to identify outdated or ineffective ones. The goal is to streamline government operations, but the initiative also raises questions about privacy and bias in AI decision-making.
Researchers created a way to measure how well AI tools work together. It helps AI assistants use the right tools at the right time, making them faster and more reliable.
Researchers propose TAKE (Trajectory-Aware Knowledge Estimation), a text dataset distillation framework that reduces corpora to as little as 0.1% of their original size while preserving downstream task fidelity, using influence functions to select the most valuable samples.
Researchers fine-tuned LLaMA 3 (8B) with LoRA and 4-bit quantization to replace costly cross-encoders in RAG pipelines, achieving efficient real-time reranking for AI assistants and search tools.
Researchers developed a way to test AI models using smaller, representative subsets of benchmark prompts. This could make AI evaluation faster and more practical without sacrificing accuracy.
Researchers have developed a new method called KV-PRM that makes multi-agent AI systems more efficient. This could lead to faster, more capable AI collaborations in complex scenarios. The technique reduces the computational cost of evaluating long interactions, making it practical for real-world applications.
Researchers introduced HALO, a method to enhance existing AI language models with minimal extra computation. It selectively refines responses, improving accuracy without wasting resources.
Researchers developed a new AI planning method called GATS that reduces computational costs and improves reliability by eliminating LLM calls during inference. It could make AI assistants more efficient at complex tasks.
NVIDIA is creating AI models that are optimized to work seamlessly with their hardware. This approach could make AI systems faster and more efficient for everyone.
A new paper argues that the key to controlling enterprise AI costs lies in the 'harness'—the orchestration layer that manages context, tools, and workflows. Without careful design, AI systems fall into 'token maxing,' where costs grow faster than value. The study shows that a well-designed harness can dramatically reduce token usage and expenses.
Researchers introduced Akashic, a low-overhead memory system for LLM inference that uses MemAttention to organize context into bounded chunks and model semantic relationships. This could make chatbots and AI assistants much more efficient and accurate by reducing prefill costs and avoiding context limits.
A LessWrong article argues that trees, which are mostly air, offer a counterintuitive lesson for AI safety: true safety comes from structural resilience, not merely from efficiency or sustainability. The draft oversimplifies this by focusing on resource efficiency rather than the article's core point about failure modes and robustness.
Researchers have introduced Wiola, a novel small language model architecture that breaks from existing designs. It incorporates five unique components aimed at improving efficiency and performance.
Researchers have developed a new AI algorithm to help air traffic controllers manage flights more efficiently. This tool focuses on being easy to understand and quick to use, addressing key challenges in real-world air traffic management.
Researchers developed a method to help AI models know when to stop reasoning and provide answers. This could make AI faster and more efficient without sacrificing accuracy.
OpenAI and Broadcom have developed a new chip designed to make AI models like ChatGPT run faster and cost less. This could lead to more powerful and affordable AI tools for everyone.
A former Databricks AI chief has unveiled Un-0, an image-generation system that could slash AI power consumption by up to 1,000 times, making AI more accessible and environmentally friendly.
Many people use expensive AI models like GPT for simple tasks that cheaper or free alternatives can handle just as well. Switching to the right tool can save you money and improve performance.
Scientists have found a way to make AI models reason better by using compute resources more efficiently. This could lead to faster, more accurate AI assistants and tools without needing more powerful hardware.
Researchers found that selecting the most informative comparison pairs during AI training can improve results. This approach could make AI models more efficient to train without extra cost.
Researchers have developed Causal Attribution Pruning (CAP), a training-free method that prunes large language models by identifying critical attention heads through their causal impact on reasoning tasks. This reduces inference costs without sacrificing multi-step reasoning performance.
Researchers found that standard parallel sampling in AI search often leads to repetitive queries. Their new method, DivInit, improves efficiency by diversifying initial queries, reducing redundant work.
Researchers have developed a new method called Telegraph English that compresses information for AI models while preserving meaning. This could make AI answers more accurate and efficient, especially for complex, multi-step questions.
Researchers found that AI models often waste time overthinking, leading to errors. Their new method stops the AI when it's no longer helping, improving accuracy.