AI for astronomyAnnotated2024

AstroMLab 2: AstroLLaMA-2-70B Model and Benchmarking Specialised LLMs

R. Pan, T. D. Nguyen, H. Arora, A. Accomazzi, T. Ghosal, & Y.-S. Ting

SuperComputing (SC24) AI4S Workshop 2024

Show overview ▸

Astronomy-specific training helps the tested 70B base model on multiple-choice questions, but smaller models and full instruction-following do not show the same gains. Separating training stages from evaluation protocols exposes the limits of specialization and the need for better astronomy-focused instruction data.

Open PDFLoading page…
AstroMLab 2: AstroLLaMA-2-70B Model and Benchmarking Specialised LLMs — annotated page 1

Annotify adds explanatory annotations and fades the original page background. Source paper: CC BY 4.0.

Open annotated PDF