Catastrophic forgetting occurs when fine-tuning overwrites capabilities learned earlier. Mix replay data, lower the learning rate, regularize toward the base weights, freeze layers or use adapters, and evaluate both target and retained capabilities.
Use equations or tensor shapes where they clarify the claim, then name an experiment or ablation that would distinguish competing explanations.
Get asked follow-ups live, then receive a scored report — like a real MLE interview loop.
Start AI mock interview