Skip to content
Quantoros

Why can compiled NumPy computation on CUDA still be limited by data transfers?

GPU / CUDALevel: AdvancedCPU-GPU copies in compiled NumPy

Why can compiled NumPy computation on CUDA still be limited by data transfers?

Hints
  • Where are inputs and outputs physically stored?
  • Can repeated calls keep intermediates on the device?

Answer

This answer is part of mentoring

Advanced questions come with a full breakdown and a mock interview with a working quant researcher. The first call is free.

Source and licence: PyTorch contributors — torch.compile FAQ · BSD-3-Clause · answer: Quantoros editorial

Related questions