DeepOffer

Debug a Transformer: find the classic bugs.

ML CodingReported interview question
Reported in interviews — OpenAI, 2026

Check mask orientation and dtype, softmax axis, scaling by head dimension, reshape/transpose order, residual placement, normalization epsilon, dropout mode, label shift, padding loss, and device/dtype consistency.

Test empty input, one-element input, duplicates, boundary indices, invalid states, and the largest allowed size; state time and space complexity.

Common follow-up questions

Practice this question with an AI interviewer

Get asked follow-ups live, then receive a scored report — like a real MLE interview loop.

Start AI mock interview