Skip to content
ML Academy

Introduced on day 43

Instruction tuning

Supervised fine-tuning on examples that pair an instruction with a desired response, so a pretrained model follows instructions rather than only continuing text.

In detail

Instruction tuning is usually the first post-training stage, followed by preference tuning such as RLHF or DPO. The resulting chat or instruct checkpoints expect a specific prompt template, which must be matched when evaluating or adapting them.