5 stories tagged Diversity
Researchers introduced DRY-SFT (Don't Repeat Yourself Supervised Fine-Tuning), a new post-training method that increases output diversity and coverage in large language models, improving the probability of finding at least one correct solution in verifiable domains like math and coding.
A new ArXiv study finds that semantic convergence in large language models begins during the pretraining phase, not just the alignment process. The research shows that output homogeneity is observed from the first alignment stage (instruction-tuning/SFT), suggesting it is learned early and only magnified later. This challenges the common assumption that diversity loss is primarily an alignment problem.
A new arXiv study reveals that large language models produce homogenized opinions in tasks like synthetic surveys and public opinion prediction. Researchers identify which interventions actually increase diversity and which don't, offering a clearer path to more realistic AI-generated viewpoints.
A new paper suggests AI should be built by diverse contributors, not just big tech companies. This could make AI smarter by including more perspectives and knowledge. The idea is to create smaller, specialized AI models that anyone can contribute to, making AI more representative of human diversity.
Researchers developed a way to make AI models reflect diverse cultural values more accurately. This could help AI understand and respect different cultural perspectives better.