Forecasting Scientific Progress with Artificial Intelligence

Researchers introduced CUSP, a benchmark for forecasting scientific events under controlled knowledge cutoffs.

Frontier AI models were inconsistent across domains and often misjudged when breakthroughs would happen.

Models also stayed overconfident, even when given more prior information.

The findings suggest current AI systems are not yet reliable tools for predicting scientific progress or planning research.