51Is a model's chain-of-thought faithful to its actual reasoning, and why does it matter?▼hardAnthropicOpenAIGoogle2 replies◆ premiumChain-of-thought looks like the model showing its work, but it may not mirror the real computation. The signal is knowing CoT can be a post-hoc story, with evidence, and what that breaks for safety and oversight.Open full answer →
118Why do transformers need residual connections, and what do people mean by the residual stream?▼mediumAnthropicOpenAIGoogle DeepMind◆ premiumMost candidates answer with the 2015 ResNet answer and stop. The senior answer treats the residual stream as a shared communication bus, and that reframing is what makes logit attribution, the logit lens, and activation steering possible at all.Open full answer →
77Two of your features are highly correlated. Does it hurt the model, and what do you do about it?▼mediumMetaAmazonDatabricks1 replies◆ premiumThe textbook reflex ('drop one') is usually the wrong instinct, and whether collinearity matters at all depends on your model and what you want from it. This is the answer that tells rote apart from real understanding.Open full answer →
84Stakeholders ask which features drive your model. Why is feature importance misleading, and what do you use instead?▼mediumDatabricksMetaAmazon2 replies◆ premiumThe built-in importance scores from XGBoost can rank a random ID above a vital feature, and stakeholders will base decisions on that bar chart. Here is why default importance misleads and what a careful answer reports instead.Open full answer →
120Compare SHAP and LIME for explaining model predictions. What does SHAP guarantee that LIME does not?▼mediumGoogleMicrosoftAmazon2 replies◆ premiumBoth explain one prediction by crediting features, but only one is backed by a uniqueness theorem. What interviewers reward is knowing SHAP's game-theory guarantees, LIME's instability, and when each fits. Here is the answer.Open full answer →
121Explain integrated gradients for attribution. Why use it over raw gradients, and how do you pick the baseline?▼hardGoogleGoogle DeepMindNVIDIA1 replies◆ premiumRaw gradient saliency maps are noisy and saturate. Integrated gradients cures both with two axioms and a path integral, yet the baseline choice quietly decides the answer. Here is what a careful candidate explains.Open full answer →
11What is the difference between explainability and interpretability, and how do you explain a model's decision?▼mediumGoogleMicrosoftIBM2 replies○ sign inRegulators and enterprises increasingly require explanations for AI decisions, and the two terms get thrown around loosely. What lands is separating inherently interpretable models from post-hoc explanations and picking the right technique for the stakes.Open full answer →