What is model checkpointing?
Deep LearningLevel: IntermediateOptimization in neural networks
What is model checkpointing?
Hints
- Trace data and gradients through the model, noting shapes.
- Separate training from inference and identify a necessary assumption.
Answer
Saving the weights learned by a model mid training for long running processes is known as model checkpointing so that you can resume your training from a certain checkpoint.
Source and licence: Alexey Grigorev & contributors — Data Science Interviews · CC-BY-4.0