27How do vision-language models (VLMs) work, and how does CLIP enable cross-modal understanding?▼hardGoogleMetaOpenAI2 replies◆ premiumMultimodal is now table stakes, and this tests whether you understand how images and text reach a shared model. The signal is CLIP's contrastive alignment and how modern VLMs feed image features into an LLM's token space.Open full answer →
125What is visual question answering, and why is it harder than the benchmarks suggest?▼mediumGoogleMetaMicrosoft◆ premiumA model that never looks at the image can score respectably on VQA, which tells you most of what you need to know about the benchmark. Here is what the scores hide, and the one-line ablation that exposes it.Open full answer →