73How do you curate and filter a supervised fine-tuning (SFT) dataset, and why does a smaller clean set often win?▼hardAnthropicMetaHugging Face1 replies◆ premiumA few thousand carefully chosen examples can beat a million scraped ones. The signal is knowing which filters matter, how you gauge example quality, and why diversity beats raw volume.Open full answer →
79Your preference data has low annotator agreement and noisy labels. How do you measure and fix preference-data quality?▼hardScale AIAnthropicOpenAI1 replies◆ premiumA reward model can only match the quality of its labels, and human preference labels arrive noisy and inconsistent. The signal is measuring inter-annotator agreement and the concrete steps that raise label quality.Open full answer →
80How do you choose the data mixture for pretraining an LLM, and what does domain reweighting buy you?▼hardGoogle DeepMindMetaMistral1 replies◆ premiumThe proportions of web, code, books, and math in pretraining quietly set downstream skills. The signal is knowing how mixtures get chosen, why upsampling helps, and how methods like DoReMi automate it.Open full answer →
