Reading the News: Adapting Large Language Models to Swedish Journalism Through Continued Pre-Training
Large language models are increasingly capable in general, but their utility can remain modest in niche or understudied areas. One approach to address this limitation is to specialise existing models through additional training on target-domain corpora. In this work, we investigate such continued pre-training for adapting large language models to Swedish journalism, using a high-quality dataset…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.