Mentoring · GPU & ML Performance
GPU programming and ML performance mentoring
Write and profile your own GPU kernels and make models faster: from the first vector-add kernel to a custom PyTorch operator in C++/CUDA with autograd and tests.
Who this is for
- ML engineers who want to understand and remove performance bottlenecks.
- C++ and systems developers moving into ML infrastructure and inference.
- Quant developers who need fast numerical code on GPUs.
What you will build
The GPU & ML Performance track has 8 sprints. It opens after Deep Learning on the ML path or after Quant Development.
- The first GPU kernel: vector addition.
- Operator fusion: a softmax kernel.
- Softmax occupancy and throughput.
- Tiled matrix multiplication.
- Block ordering and matmul autotuning.
- Layer normalisation forward pass.
- A PyTorch operator in C++ and CUDA.
- Testing and autograd for your own operator.
How mentoring works
- A free intro call to check your C++, Python and deep learning background.
- Weekly 1:1 calls and review of kernels, benchmarks and profiles.
- Portfolio projects you can show in ML infrastructure interviews.
Questions
Do I need my own GPU?
No. Free GPUs in Colab and Kaggle are enough for the track.
CUDA or Triton?
Both: Triton for productive kernels, C++/CUDA for custom PyTorch operators.
What background do I need?
Python, basic C++ and an understanding of how neural networks train.
Read next
GPU programming for machine learning: a roadmapA GPU programming roadmap for machine learning: GPU architecture, CUDA and Triton kernels, fused softmax, tiled matmul, profiling and custom PyTorch operators.Machine learning engineer roadmap: from Python to productionA machine learning engineer roadmap: Python and data, maths, classic ML, deep learning, a specialisation and MLOps, with portfolio projects and realistic timelines.How to choose a machine learning mentorHow to choose a machine learning or quant research mentor: what good mentorship includes, red flags, questions for the intro call and how pricing models compare.
Mentoring directions
Quant Research1:1 quant research mentoring from a working quantitative researcher: statistics, alpha research, backtesting, portfolio and risk, and quant interviews.ML Engineer1:1 machine learning mentoring: Python, maths, classic ML on Kaggle, deep learning, a specialisation and ML system design, with personal code review.LLM & AI Engineer1:1 mentoring for LLM and AI engineers: transformers, fine-tuning with LoRA, RAG, tool calling, agents, evaluation and local serving with vLLM.Quant Developer1:1 quant developer mentoring in modern C++: performance, concurrency, networking, a FIX gateway, order book matching, market data replay and QuantLib.Interview PrepPrepare for ML engineer and quant research interviews: mock interviews, CV review and a trainer with 2,000 questions and spaced repetition. In English or Russian.