Research

Research News

1287 stories curated by AInformed

A researcher analyzing data on a computer screen, illustrating OpenFrontiers' benchmark for AI to solve scientific problems.
research

OpenFrontiers: A New Benchmark for AI to Solve Scientific Problems

Researchers have created OpenFrontiers, a cross-disciplinary resource combining a structured corpus of 12,151 open research problems with a retrospective benchmark of 200 recently resolved problems in mathematics. The benchmark evaluates large language models (LLMs) on formal proof tasks under closed-book, frozen-retrieval, and live-web conditions, finding that closed-book rediscovery is rare.

via ArXiv cs.AI#AI#Research#Benchmark