Definition
Pretraining is a large-scale training stage where a model learns general language patterns and knowledge from massive unlabeled text. It forms the foundation for later adaptation methods.
GlossaryAI term
Pretraining
事前学習
事前学習
Definition
Pretraining is a large-scale training stage where a model learns general language patterns and knowledge from massive unlabeled text. It forms the foundation for later adaptation methods.