RLHF and Post-Training Course by Nathan Lambert

This course is roughly aimed at early AI PhD or master's students, but it is designed to be accessible to anyone willing to put in the work.

If you prefer the traditional coursework path, the usual background is the basics of language modeling / NLP plus basic machine learning (e.g. an intro to AI course and an intro to ML course).

The ML Foundations of LLM Post-Training

A refresher on the ML prerequisites of post-training — language modeling, KL, cross-entropy, & other math — to acclimate to the series