19What causes vanishing and exploding gradients, and how do activations, initialization, and residuals fix them?▼mediumGoogleNVIDIAMeta1 replies○ sign inThis question connects why deep nets were hard to train with the cluster of tricks that solved it. What interviewers reward is the multiplicative-gradient cause and naming the real fixes: ReLU, He/Xavier init, residuals, normalization. Here is the answer.Open full answer →
27What consumes GPU memory during training/inference, and how do you fit a model that doesn't?▼hardNVIDIAOpenAIMeta1 replies◆ premiumOOM is the wall you hit most often in deep learning, and 'buy a bigger GPU' is the weakest reply. What counts is naming the memory consumers, knowing which one dominates, and pairing the right lever with it.Open full answer →
