Skip to content
ML Academy

DL, NLP and LLMs

Interview question

  • seniorlevel
  • 15 minsuggested time
  • 2ML engineer, Applied AI

You must fine-tune a transformer classifier, but only 8 sequences of up to 512 tokens fit on one GPU at a time and the recipe you are reproducing used a batch size of 512. Describe how you reproduce the recipe on four GPUs with gradient accumulation, which details commonly go wrong, and how you would check that the setup is equivalent.

Tests: Training mechanics: effective batch size, gradient accumulation, loss normalisation with variable-length sequences, learning-rate scaling and equivalence checks.

day 33day 34day 40

Sign in to practise: answers are saved before model answers are shown.