AI for astronomyAnnotated2024
AstroMLab 2: AstroLLaMA-2-70B Model and Benchmarking Specialised LLMs
R. Pan, T. D. Nguyen, H. Arora, A. Accomazzi, T. Ghosal, & Y.-S. Ting
SuperComputing (SC24) AI4S Workshop 2024
Show overview ▸Hide overview ▾
Astronomy-specific training helps the tested 70B base model on multiple-choice questions, but smaller models and full instruction-following do not show the same gains. Separating training stages from evaluation protocols exposes the limits of specialization and the need for better astronomy-focused instruction data.
Open PDFLoading page…

Annotify adds explanatory annotations and fades the original page background. Source paper: CC BY 4.0.
Open annotated PDF