Skip to content
ML Academy

DL, NLP and LLMs

Interview question

  • seniorlevel
  • 12 minsuggested time
  • 2Applied AI, ML engineer

Explain how LoRA works. For one 4096 x 4096 weight matrix with rank 8, how many trainable parameters does LoRA add, and what are the practical trade-offs compared with full fine-tuning?

Tests: Mechanism of low-rank adaptation, parameter arithmetic, memory implications, serving options, and evaluation risks.

day 31day 40day 43day 44

Sign in to practise: answers are saved before model answers are shown.