Power Law Data Distributions Boost Compositional Reasoning in AI Models
A new study reveals that training AI models on power-law distributed data improves their performance on complex reasoning tasks. This challenges the assumption that uniform data distributions are superior for learning rare skills.