32What is cross-attention, and how does it differ from self-attention?▼mediumGoogleOpenAICohere1 replies◆ premiumCross-attention is how a model attends from one sequence into another, the mechanism behind encoder-decoder models and multimodal conditioning. What shows depth is knowing exactly where the queries versus keys/values come from.Open full answer →
110Explain multimodal fusion: early, late, and cross-attention. Which architecture would you pick, and when?▼mediumOpenAIGoogle DeepMindMeta◆ premiumFour fusion families, and the choice between them is decided by one question most candidates never ask. Naming CLIP and LLaVA is table stakes; the score comes from knowing which one cannot reason and which one eats your context window.Open full answer →
