What's the difference between an embedding and a generative model?
LLM & AILevel: FoundationLLM Foundations
What's the difference between an embedding and a generative model?
Hints
- What does closeness mean in this representation and metric?
- Check normalization, exact versus approximate search and alignment with the training objective.
Answer
An embedding model maps a piece of text to a single fixed-length vector that captures its meaning. It returns numbers rather than words, and you use it to measure similarity for search, clustering, and retrieval. A generative model produces text one token at a time, and you use it to write, answer, summarize, or translate.
Source and licence: Skillumen — Awesome AI Engineer Interview Questions · CC0-1.0