Skip to content
ML Academy

Production and system design

Interview question

  • stafflevel
  • 30 minsuggested time
  • 2Applied AI, ML engineer

Your company's LLM features (support assistant, document summarisation, internal search) now cost more than planned, and the CFO wants a 40% reduction in six months without hurting quality. How do you approach it?

Tests: AI cost engineering at portfolio level: measurement, unit economics, routing/cascades, caching, context and output control, batching, quality-cost frontiers with evaluation, and governance.

Sign in to practise: answers are saved before model answers are shown.