24 stories tagged Hardware
AMD has unveiled Helios, a new rack-scale AI system designed to rival Nvidia's offerings. The system will start shipping to customers later this year, giving businesses and researchers a high-performance alternative for large-scale AI workloads.
Etched, an AI chip startup founded by three Harvard dropouts, has secured a $10.3 billion valuation from major investors. The company claims its new chips and memory components accelerate AI inference without requiring traditional GPUs, potentially disrupting Nvidia's dominance in the AI hardware market.
Lunar, an AI research lab, has released an open-source AI model that runs on standard consumer hardware such as gaming PCs, eliminating the need for expensive servers and making advanced AI accessible to hobbyists and small businesses.
Apple has sued OpenAI, potentially derailing the AI company's plans to enter the hardware market and go public. The legal battle centers on alleged intellectual property theft and could reshape the AI hardware landscape.
NVIDIA is creating AI models that are optimized to work seamlessly with their hardware. This approach could make AI systems faster and more efficient for everyone.
Meta is starting production of its own AI chips designed for flexibility as AI technology evolves. This move could help Meta reduce its reliance on third-party hardware providers.
AMD's new Ryzen AI Halo brings powerful AI capabilities to your home computer, but it comes with a hefty price tag of $4,000. This system is designed to run AI models locally, offering privacy and speed benefits.
Anthropic, a leading AI company, is in talks with Samsung to develop custom AI chips. This follows OpenAI's recent announcement of a similar partnership with Broadcom.
Etched, a rival to Nvidia in AI chips, has secured $1 billion in sales and a $5 billion valuation. The company says the sales are under contract for inference systems powered by its chip, marking a significant shift in the competitive landscape for AI hardware.
OpenAI is releasing a physical device for its AI coding tool, Codex, on July 15th. The square-shaped device with buttons is designed to provide quick shortcuts for Codex. This is separate from the mysterious AI hardware project OpenAI is working on with other partners.
OpenAI unveiled Jalapeño, a custom AI inference chip built with Broadcom, marking a major step toward reducing reliance on Nvidia. The move highlights a broader industry trend by Google, Apple, and SpaceX to avoid single-supplier risk and could lead to faster, cheaper AI services.
OpenAI and Broadcom have introduced Jalapeño, a custom AI chip built specifically for LLM inference. The chip aims to improve performance, efficiency, and scalability of AI systems, potentially making AI tools faster and more cost-effective for everyday users.
Researchers have identified key ways AI models fail when translating programming logic into hardware design. The findings highlight a 90.8% success rate ceiling for current models, with specific types of errors limiting their effectiveness.
Hugging Face has integrated AI models with robot hardware, allowing developers to deploy models directly to robots. This breakthrough makes advanced AI capabilities accessible to physical robots for the first time.
Researchers have released OpenRTLSet, the largest open-source dataset for hardware design, featuring 131,000 Verilog code samples. This resource enables AI models to learn and generate hardware designs, potentially speeding up innovation in electronics.
Researchers developed StepPRM-RTL, an AI framework that enhances the accuracy of automatically generating hardware code. This could make designing digital circuits faster and more reliable for engineers.
Meta is working on a wearable AI device shaped like a pendant. This could make AI assistance more accessible and hands-free for everyday tasks.
A tech hobbyist successfully ran a massive AI language model using 768GB of Intel Optane memory and a single graphics card. The setup, called Local Kimi K2.5, achieved roughly 4 tokens per second, showing how powerful consumer hardware can be for cutting-edge AI experiments.
LocalLightChat is a new AI chat interface that can handle massive amounts of text on older computers. It makes powerful AI tools accessible to anyone with basic hardware.
A new tool ranks local AI models by performance and hardware needs, making it easier to pick the right one. This could save you time and effort when setting up AI tools on your computer.
A comprehensive guide for running large language models on a 64GB RAM device has been released. It covers practical tips for optimizing performance in code and math applications.
Graeme (@gkisokay) shares a curated list of powerful local LLMs that run efficiently on 32GB RAM machines. This opens up flagship-class models to a wider range of users.
An AI agent has autonomously designed a working RISC-V CPU core from scratch, demonstrating significant progress in AI's ability to tackle complex engineering tasks. The design was verified and fabricated, showing potential for accelerating hardware development.
A new type of computer is emerging, blending neural networks with traditional hardware. This hybrid approach promises to revolutionize computing by merging AI and classical computing paradigms.