Aller au contenu
← Tous les thèmes

Machine learning

2 fiche(s)

2 fiche(s)

Machine learningNatural language processingEN

The Mathematics of Embeddings

How discrete symbols become vectors: the embedding lookup as a matrix product, the similarity measures used to compare vectors, how skip-gram training relates to a factorised co-occurrence matrix, and what high-dimensional geometry implies for reading similarity scores.

Intermédiaire · 10 min de lecture ·

Machine learningLarge language modelsEN

How Large Language Models Are Trained

From raw text to assistant: the published recipe behind large language models. Data preparation, next-token pretraining, scaling laws, supervised fine-tuning and preference tuning (RLHF, DPO), each with its objective written out.

Intermédiaire · 9 min de lecture ·