03Define precision, recall, F1, and AUC, and give a case where each (and accuracy) is misleading.▼medium★ EssentialAmazonMetaGoogle2 repliesunlockedThe interviewer wants to see whether you choose metrics to fit the problem or just recite definitions. The signal that counts is recognizing when accuracy and even AUC mislead, and linking each metric to a decision.Open full answer →
74What is positive-unlabeled (PU) learning, and when do you need it?▼hardAmazonGoogleMeta1 replies◆ premiumPlenty of real problems hand you confirmed positives but never confirmed negatives, only unlabeled data. The shortcut everyone grabs quietly biases the model. What shows depth is naming the regime and its fix. Here is the answer.Open full answer →
75How do you handle multiclass classification (softmax vs one-vs-rest vs one-vs-one)?▼mediumAmazonGoogleMeta1 replies◆ premiumSome models are multiclass out of the box; others need a wrapper to extend a binary classifier to K classes. What shows depth is knowing the three strategies and exactly when each one wins. Here is the answer.Open full answer →
80Your model is accurate on average but fails badly for one subgroup. How do you find and fix it?▼hardGoogleMetaApple1 replies◆ premiumA 92% aggregate accuracy can mask 60% on the segment that matters most. Averages are exactly where these failures stay buried. Here is how to surface them and the menu of fixes that actually map to the cause.Open full answer →
33Design a fraud-detection system that uses LLMs (beyond a classic ML classifier).▼hardAmazonMicrosoftGoogle2 replies◆ premiumThe trap is swapping the classifier for an LLM. The real-time, imbalance, and adversarial constraints stay put. The signal is a hybrid: a fast calibrated model scores inline, LLMs investigate the gray zone off the hot path.Open full answer →
42Design a spam / abuse detection system (email, comments, or messages).▼hardGoogleMetaMicrosoft1 replies◆ premiumSpam detection is adversarial, imbalanced classification under a low-latency bar. The interviewer is watching whether you set the threshold by cost asymmetry and rely on signals spammers cannot fake. Here is the design.Open full answer →
58Design a customer churn prediction system.▼mediumAmazonNetflixMicrosoft1 replies◆ premiumA high-AUC churn model that changes no behavior is worthless. The strong answer nails the label definition, chooses classification vs survival deliberately, and is judged on retention uplift, not accuracy.Open full answer →