DeepOffer

Give a decision framework for choosing between prompting, RAG, and fine-tuning, with cost and latency attached.

ML TheoryReported interview question
Reported in public interview compilations — OpenAI, Mistral AI, Cohere, Microsoft, Databricks, Glean

Fine-tuning updates model behavior on task-specific examples. A sound plan defines the target behavior, cleans and splits data, chooses full or parameter-efficient updates, watches retained capabilities, and evaluates against prompting and RAG baselines.

Use equations or tensor shapes where they clarify the claim, then name an experiment or ablation that would distinguish competing explanations.

Common follow-up questions

Practice this question with an AI interviewer

Get asked follow-ups live, then receive a scored report — like a real MLE interview loop.

Start AI mock interview