12What is perplexity, and what are its limits as a language-model metric?▼mediumOpenAIGoogleCohere2 replies○ sign inPerplexity is the classic LM metric. What matters is knowing it is just exponentiated cross-entropy, what it intuitively captures, and why low perplexity does not mean a good product.Open full answer →
76Implement a smoothed n-gram language model and compute perplexity on held-out text.▼mediumGoogleAmazonApple1 replies◆ premiumAhead of transformers, this was the language model, and it remains the clearest way to prove you grasp what perplexity truly measures. Smoothing is where people slip up. Here is the implementation.Open full answer →
