Skip to content
Quantoros

Design a customer-support RAG bot over a million documents. What's the top-level architecture?

LLM & AILevel: AdvancedInference & Serving

Design a customer-support RAG bot over a million documents. What's the top-level architecture?

Hints
  • Break the query into candidate retrieval, context selection and generation.
  • How would you locate the stage that lost a fact without using only one end-to-end metric?

Answer

This answer is part of mentoring

Advanced questions come with a full breakdown and a mock interview with a working quant researcher. The first call is free.

Source and licence: Skillumen — Awesome AI Engineer Interview Questions · CC0-1.0

Related questions