AI for astronomyAnnotated2024

AstroLLaMA-Chat: Scaling AstroLLaMA with Conversational and Diverse Datasets

E. Perkowski, R. Pan, T. Nguyen, Y.-S. Ting, S. Kruk, T. Zhang, C. O'Neill, M. Jablonska, Z. Sun, M. J. Smith, et al.

Research Notes of the American Astronomical Society

Show overview ▸

A 7B astronomy language model combines continual pre-training on paper sections with conversational fine-tuning. Selected examples suggest domain relevance, while hallucinations, alignment limitations and unfinished quantitative benchmarking qualify the early release.

Open PDFLoading page…
AstroLLaMA-Chat: Scaling AstroLLaMA with Conversational and Diverse Datasets — annotated page 1

Annotify adds explanatory annotations and fades the original page background. Source paper: arXiv non-exclusive distribution licence.

Open annotated PDF