Skip to content
Quantoros

How would you design a data pipeline to ingest, clean, and serve data for a daily ML model retraining job?

ML System DesignLevel: AdvancedData pipelines and distributed processing

How would you design a data pipeline to ingest, clean, and serve data for a daily ML model retraining job?

Hints
  • Start with quality, load and latency requirements.
  • Trace data to prediction; identify a failure point and a validation method.

Answer

This answer is part of mentoring

Advanced questions come with a full breakdown and a mock interview with a working quant researcher. The first call is free.

Source and licence: Ishan Dutta — Awesome Data Science Interview Q&A · MIT

Related questions