Aller au contenu
← Tous les thèmes

Large language models

1 fiche(s)

1 fiche(s)

Machine learningLarge language modelsEN

How Large Language Models Are Trained

From raw text to assistant: the published recipe behind large language models. Data preparation, next-token pretraining, scaling laws, supervised fine-tuning and preference tuning (RLHF, DPO), each with its objective written out.

Intermédiaire · 9 min de lecture ·