军事知识服务平台
Data Preparation for Large Language Models
摘要 Large language models(LLMs)have demonstrated remarkable generalization capabilities across di-verse domains,largely attributed to the availability of massive amounts of high-quality training data.Recently,the development paradigm of LLMs has been shifting from a model-centric to a data-centric perspective.In this paper,we provide a comprehensive survey of data preparation algorithms and workflows for LLMs,categorized into three stages:pre-training,continual pre-training,and post-training.We further summarize widely used datasets along with their associated data preparation method,offering a practical reference for researchers who may lack extensive experience in the field of data preparation.Finally,we outline potential directions for future work,highlighting open challenges and opportunities in advancing data preparation for LLMs.
年,卷(期): 2026, 41(1)
机标分类号: H319 H0-05 TP311
在线出版日期: 2026年6月29日