AI for astronomyAnnotated2023

AstroLLaMA: Towards Specialized Foundation Models in Astronomy

T. Nguyen, Y.-S. Ting, I. Ciucă, C. O'Neill, Z.-C. Sun, M. Jabłońska, S. Kruk, E. Perkowski, J. Miller, J. Li, et al.

International Joint Conference on Natural Language Processing

Show overview ▸

AstroLLaMA adapts LLaMA-2 to astronomy abstracts using continued causal language-model training. The paper reports lower perplexity and illustrative completion and embedding examples, while explicitly warning about inaccurate or fabricated numerical claims.

Open PDFLoading page…
AstroLLaMA: Towards Specialized Foundation Models in Astronomy — annotated page 1

Annotify adds explanatory annotations and fades the original page background. Source paper: arXiv non-exclusive distribution licence.

Open annotated PDF