Skip to content
Quantoros

How do word bigrams address one limitation of a unigram bag of words?

Classic MLLevel: IntermediateLocal word-order features

How do word bigrams address one limitation of a unigram bag of words?

Hints
  • Compare counts of individual words with adjacent pairs.
  • Local order is not complete syntax.

Answer

They encode adjacent word combinations and retain some local order, distinguishing phrases with similar unigram counts. They enlarge vocabulary and do not capture arbitrary long-range structure.

Source and licence: scikit-learn 1.7.2 — feature extraction · BSD-3-Clause · answer: Quantoros editorial

Related questions