Iaroslav Elistratov

B200 Attention Kernel from Scratch to Near-SOTA in 60 Diagrams

Build and understand one of the most complex GPU kernels on the latest hardware

B200 Attention Kernel from Scratch to Near-SOTA in 60 Diagrams

Adding autodiff to Triton MLIR passes (2025) · GitHub

Adding autodiff to Triton MLIR passes (2025) · GitHub

My minimal DL library in C and CUDA (2024) · GitHub

My minimal DL library in C and CUDA (2024) · GitHub

Build Neural Network in C/CUDA (Part 1): Deep Learning Foundations for our Implementation (2024) · YouTube

Build Neural Network in C/CUDA (Part 1): Deep Learning Foundations for our Implementation (2024) · YouTube

Graph Neural Networks for Autonomous Driving (2022) · GitHub

Graph Neural Networks for Autonomous Driving (2022) · GitHub