Astronomy reasoning benchmarksAnnotated2026

Gold-Medal Performance by LLMs at the International Olympiad on Astronomy and Astrophysics

L. Carrit Delgado Pinheiro, Z. Chen, B. Caixeta Piazza, N. Shroff, Y. Liang, Y.-S. Ting, & H. Sun

Nature Astronomy

Show overview ▸

Five LLMs are evaluated on IOAA theory and data-analysis exams, revealing strong scores alongside persistent spatial, conceptual, and visual-reasoning failures.

Open PDFLoading page…
Gold-Medal Performance by LLMs at the International Olympiad on Astronomy and Astrophysics — annotated page 1

Annotify adds explanatory annotations and fades the original page background. Source paper: CC BY 4.0.

Open annotated PDF