Why can a query group with many documents supply almost no learning signal to a pairwise ranker?
Classic MLLevel: IntermediateXGBoost · Learning to rank
Why can a query group with many documents supply almost no learning signal to a pairwise ranker?
Hints
- The loss compares unequal relevance levels.
- Count informative pairs, not just documents.
Answer
If all documents have the same relevance label, there are no unequal-relevance pairs to learn their order from. More rows alone do not create effective pairs; inspect label diversity per query.
Source and licence: XGBoost · Learning to rank · Apache-2.0 · answer: Quantoros editorial