In plain terms, what one task is an LLM actually doing?
LLM & AILevel: FoundationLLM Foundations
In plain terms, what one task is an LLM actually doing?
Hints
- Identify the stage: pretraining, adaptation, generation or evaluation.
- Name the inputs, constraints and a case where the approach fails.
Answer
It predicts the next token, the most likely next word-piece given all the text so far. That is the entire job: at each step it outputs a probability distribution over its whole vocabulary, and a token is sampled from it.
Source and licence: Skillumen — Awesome AI Engineer Interview Questions · CC0-1.0