How do word bigrams address one limitation of a unigram bag of words?
Classic MLLevel: IntermediateLocal word-order features
How do word bigrams address one limitation of a unigram bag of words?
Hints
- Compare counts of individual words with adjacent pairs.
- Local order is not complete syntax.
Answer
They encode adjacent word combinations and retain some local order, distinguishing phrases with similar unigram counts. They enlarge vocabulary and do not capture arbitrary long-range structure.
Source and licence: scikit-learn 1.7.2 — feature extraction · BSD-3-Clause · answer: Quantoros editorial