Skip to content
Quantoros

Why can a query group with many documents supply almost no learning signal to a pairwise ranker?

Classic MLLevel: IntermediateXGBoost · Learning to rank

Why can a query group with many documents supply almost no learning signal to a pairwise ranker?

Hints
  • The loss compares unequal relevance levels.
  • Count informative pairs, not just documents.

Answer

If all documents have the same relevance label, there are no unequal-relevance pairs to learn their order from. More rows alone do not create effective pairs; inspect label diversity per query.

Source and licence: XGBoost · Learning to rank · Apache-2.0 · answer: Quantoros editorial

Related questions