Skip to content
Quantoros

What are word embeddings? Why are they useful? Do you know Word2Vec?

NLPLevel: IntermediateText classification

What are word embeddings? Why are they useful? Do you know Word2Vec?

Hints
  • What does closeness mean in this representation and metric?
  • Check normalization, exact versus approximate search and alignment with the training objective.

Answer

Word Embeddings are vector representations for words. Each word is mapped to one vector, this vector tries to capture some characteristics of the word, allowing similar words to have similar vector representations.
Word Embeddings helps in capturing the inter-word semantics and represents it in real-valued vectors.

Word2Vec is a method to construct such an embedding. It takes a text corpus as input and outputs a set of vectors which represents words in that corpus.

It can be generated using two methods:

  • Common Bag of Words (CBOW)
  • Skip-Gram

Source and licence: Alexey Grigorev & contributors — Data Science Interviews · CC-BY-4.0

Related questions