cross encoder

Reranking is the cheapest large win in RAG quality: pull a broad set, then reorder it precisely. The signal is the bi-encoder-versus-cross-encoder distinction and the retrieve-then-rerank two-stage design. Here is the answer.

Late interaction reaches cross-encoder-like quality with near-bi-encoder scalability. The signal is the per-token embeddings plus MaxSim matching that earns you the middle ground, and understanding what it costs. Here is the answer.

An off-the-shelf cross-encoder is general; your domain carries jargon and relevance rules it never encountered. The signal is knowing when fine-tuning pays off, how to mine hard negatives, and how to avoid training a reranker that merely memorizes your retriever's mistakes.

Anyone can call a rerank endpoint. The word doing the work in this question is 'prove': you have to implement DCG, ideal DCG, and nDCG@k from graded labels and report the before-and-after. Plus the ceiling nobody mentions until it bites them in production.