6 stories tagged Training Data
Suno AI, a popular AI music generator, was trained using millions of songs and lyrics scraped from platforms like YouTube, Deezer, and Genius. This revelation comes from a hacking incident that exposed the company's data sources, raising questions about transparency in AI training.
NVIDIA has released a massive open-source dataset designed to train AI agents. This data could accelerate the development of more capable AI assistants for everyday tasks.
A new startup believes video game data could be better than the internet for training AI to understand the physical world. This approach might help AI learn how objects move and interact in space and time, a critical step toward artificial general intelligence (AGI).
Scientists found that diffusion language models can recall training data better than previously believed. This discovery highlights potential privacy risks for AI systems.
OpenAI's latest blog post traces the emergence of 'goblin mode' outputs in GPT-5, attributing it to specific training data quirks and alignment techniques. The post also outlines fixes implemented to mitigate the issue.
Researchers find that the primary bottleneck in scaling multimodal large language models (MLLMs) is knowledge density in training data, not task format. Task-specific supervision like Visual Question Answering (VQA) adds little incremental semantic information beyond image captions.