Skip to content
Quantoros

Walk me through how a model like ChatGPT is built.

LLM & AILevel: FoundationLLM Foundations

Walk me through how a model like ChatGPT is built.

Hints
  • Identify the stage: pretraining, adaptation, generation or evaluation.
  • Name the inputs, constraints and a case where the approach fails.

Answer

It is built in three training stages, each editing the weights. Pretraining reads a huge slice of the internet predicting the next token, and picks up language and world knowledge as a side effect. The output is a base model. Instruction tuning (SFT) shows it curated pairs of an instruction and an answer, so it learns to respond helpfully. Alignment (RLHF or DPO) tunes tone, safety, and judgement from human preferences.

Source and licence: Skillumen — Awesome AI Engineer Interview Questions · CC0-1.0

Related questions