Skip to content
Quantoros

In plain terms, what one task is an LLM actually doing?

LLM & AILevel: FoundationLLM Foundations

In plain terms, what one task is an LLM actually doing?

Hints
  • Identify the stage: pretraining, adaptation, generation or evaluation.
  • Name the inputs, constraints and a case where the approach fails.

Answer

It predicts the next token, the most likely next word-piece given all the text so far. That is the entire job: at each step it outputs a probability distribution over its whole vocabulary, and a token is sampled from it.

Source and licence: Skillumen — Awesome AI Engineer Interview Questions · CC0-1.0

Related questions