Archive

All 2,943 AI stories, newest first.

A diverse group of people using AI technology on various devices.
research

arXiv Paper Argues AI Leaderboards Structurally Exclude Global South Benchmarks Like IndicSUPERB and IrokoBench

A new position paper on arXiv argues that AI leaderboards are structurally ill-suited to serving the Global South due to a lack of independent governance, conflict-of-interest policies, and metric evolution mechanisms. The paper emphasizes that the barrier is not missing data—high-quality regional benchmarks like IndicSUPERB, MILU, and LAHAJA for India, IrokoBench for Africa, and AlGhafa for Arabic already exist—but rather institutional design and commercial pressure.

via ArXiv cs.AI#AI#Benchmark#Research