Skip to content
Quantoros

What are the three ways to give a model knowledge, and the one-line pitch for each?

LLM & AILevel: FoundationRAG (Retrieval-Augmented Generation)

What are the three ways to give a model knowledge, and the one-line pitch for each?

Hints
  • Identify the stage: pretraining, adaptation, generation or evaluation.
  • Name the inputs, constraints and a case where the approach fails.

Answer

There are three tools for three different jobs. RAG, retrieval-augmented generation, keeps facts outside the model and fetches the relevant ones at question time, so the model looks things up. Fine-tuning nudges the model's weights so it behaves a certain way, which bakes the behaviour in. Long context drops all the needed text into the prompt for one request, so you paste it in.

Source and licence: Skillumen — Awesome AI Engineer Interview Questions · CC0-1.0

Related questions