Astronomy reasoning benchmarksAnnotated2026
Gold-Medal Performance by LLMs at the International Olympiad on Astronomy and Astrophysics
L. Carrit Delgado Pinheiro, Z. Chen, B. Caixeta Piazza, N. Shroff, Y. Liang, Y.-S. Ting, & H. Sun
Nature Astronomy
Show overview ▸Hide overview ▾
Five LLMs are evaluated on IOAA theory and data-analysis exams, revealing strong scores alongside persistent spatial, conceptual, and visual-reasoning failures.
Open PDFLoading page…

Annotify adds explanatory annotations and fades the original page background. Source paper: CC BY 4.0.
Open annotated PDF