What are the three ways to give a model knowledge, and the one-line pitch for each?
LLM & AILevel: FoundationRAG (Retrieval-Augmented Generation)
What are the three ways to give a model knowledge, and the one-line pitch for each?
Hints
- Identify the stage: pretraining, adaptation, generation or evaluation.
- Name the inputs, constraints and a case where the approach fails.
Answer
There are three tools for three different jobs. RAG, retrieval-augmented generation, keeps facts outside the model and fetches the relevant ones at question time, so the model looks things up. Fine-tuning nudges the model's weights so it behaves a certain way, which bakes the behaviour in. Long context drops all the needed text into the prompt for one request, so you paste it in.
Source and licence: Skillumen — Awesome AI Engineer Interview Questions · CC0-1.0