Reranking applies a more expensive relevance assessment to a shortlist from a fast retriever. Scoring only candidates is usually more practical than running a precise model over every document.
The demo changes card order after rescoring. Extra latency and cost mean the shortlist size should be measured.
When to use
Use it when retrieval returns candidates but the top results are often weak.