49Design a machine translation service at scale.▼hardGoogleMetaMicrosoft1 replies◆ premiumMachine translation is seq2seq generation delivered across hundreds of language pairs under strict latency and quality budgets. What matters is sidestepping the quadratic pair blowup, saving low-resource languages, and serving it cheaply. Here is the design.Open full answer →
55Design a data labeling / annotation platform.▼hardScale AIGoogleAmazon1 replies◆ premiumLabeled data is the fuel for ML, and a labeling platform succeeds or fails on quality control. The signal is the workflow plus the quality math: consensus, gold honeypots, inter-annotator agreement, and active learning to spend the budget where it counts.Open full answer →
68Design a human-feedback data platform to collect the preference data that trains and aligns your models.▼hardAnthropicOpenAIScale AI2 replies◆ premiumRLHF and evals can only match the preference data behind them, and that data comes from humans whose quality swings wildly. The platform that yields trustworthy labels is a serious system in its own right. Here is its design.Open full answer →
114How do you design for the latency versus quality tradeoff in an AI system?▼mediumOpenAIAnthropicGoogle◆ premiumEvery AI system spends quality to buy speed, whether or not the team admits it. What scores is knowing the exchange rate for each knob, taking the free wins first, and having already decided what you will sell when the system saturates.Open full answer →