Skip to content
ML Academy

DL, NLP and LLMs

Interview question

  • midlevel
  • 8 minsuggested time
  • 3Applied AI, ML engineer, Data scientist

An LLM step that extracts a fare class from customer emails returns different answers when the same email is sent twice. A teammate says "just set temperature to 0 and it is deterministic". What does temperature do, and is the teammate right?

Tests: Decoding mechanics: logits, softmax temperature, greedy vs sampled decoding, and what determinism does and does not guarantee in a production extraction pipeline.

day 42day 47

Sign in to practise: answers are saved before model answers are shown.