22What is instruction tuning, and how does it differ from pretraining and alignment?▼medium★ EssentialOpenAIAnthropicGoogle1 replies◆ premiumInstruction tuning converts a bare next-token predictor into a model that obeys instructions. What you are being tested on is slotting it correctly into the pretrain to SFT to alignment pipeline and stating precisely what it does and does not repair.Open full answer →
27How do you prepare a dataset to fine-tune an LLM, and why does data quality dominate?▼mediumOpenAIAnthropicCohere2 replies◆ premiumFine-tuning lives or dies on data, not on hyperparameters. What shows depth is spelling out what makes a set good (quality, diversity, format, dedup) and defending why a few thousand clean examples outperform a million noisy ones.Open full answer →
73How do you curate and filter a supervised fine-tuning (SFT) dataset, and why does a smaller clean set often win?▼hardAnthropicMetaHugging Face1 replies◆ premiumA few thousand carefully chosen examples can beat a million scraped ones. The signal is knowing which filters matter, how you gauge example quality, and why diversity beats raw volume.Open full answer →
