deep learning
AI, ML & GenAI interview questions tagged deep learning, across every topic.
9 questions · 0 unlocked for you
Concepts behind "deep learning"
The curriculum that explains the ideas these questions test.
Core
Vanishing and Exploding GradientsIn a deep or recurrent network the backward gradient is a product of many per-layer Jacobians, so its magnitude compounds: factors mostly below one drive it toward zero (early layers stop learning) and factors above one make it explode (training diverges into NaNs). The root cause is that repeated multiplication, and the standard fixes attack it head-on: residual connections to hand gradient a shortcut, normalization to keep activations in scale, gating to hold signal across time, gradient clipping to cap the blow-up, and careful initialization. AI, ML, and GenAI engineer interviews probe it because it is the mechanism behind most deep-net training failures you have to diagnose.📊 Evaluation & ML FoundationsSign in
Core
Training Neural Nets: Init, Normalization, Dropout, LR SchedulesThe working recipe that lets deep nets train at all: scale-aware weight initialization (Xavier, He), normalization layers (batch, layer, RMS) that keep activations well-conditioned, dropout as stochastic regularization, and warmup plus cosine learning-rate schedules. AI, ML, and GenAI engineer interviews probe this because the wrong init or norm is a frequent reason training diverges or plateaus, and understanding why each one helps separates people who have trained models from those who have only called .fit().📊 Evaluation & ML FoundationsSign in
