bm25

The two knobs that decide whether a RAG system works, and the two candidates tend to gloss over. The signal is tuning chunking against recall and knowing precisely what dense retrieval drops that BM25 recovers. Here is the reasoning, not the rules of thumb.

Dense versus sparse is the core retrieval tradeoff, and 'just use embeddings' quietly loses every exact-match query. The signal is knowing what each representation captures and why production blends them. Here is the answer.

Pure vector search drops exact terms; pure keyword search drops meaning. The signal is understanding why each fails on its own and how to merge two rankings on incomparable scales without hand-tuning weights. Here is the answer.

A bridge connecting classic DSA and modern RAG. Interviewers want to see you build a working inverted index and a correct BM25 score by hand, reason about its complexity, and then know precisely when you would switch to embeddings and an ANN index instead.

Hybrid retrieval only beats either method when the fusion is tuned. The signal is knowing why you cannot simply add BM25 and cosine scores, how RRF's k constant behaves, and when a learned weight beats rank fusion.

A dense encoder given 'refund policy' has almost nothing to work with. The fix is counterintuitive and it is not a better embedding model, and the reason this bug survives your eval set is worse than the bug.