Challenges

30 challenges available

TitleDifficultyCategory
Vector AdditionEasyElement-wise Operations
Scalar MultiplicationEasyElement-wise Operations
Element-wise ReLUEasyActivation Functions
Vector Dot Product (Naive)EasyReduction
Matrix Transpose (Naive)EasyLinear Algebra
Row-wise SumEasyReduction
Element-wise MaxEasyElement-wise Operations
RGB to GrayscaleEasyImage Processing
1D Convolution (Simple)EasyConvolution
Prefix Sum (Single Block)EasyScan Operations
Matrix Transpose (Optimized)MediumLinear Algebra
Reduction (Sum) - Multi-blockMediumReduction
SoftmaxMediumActivation Functions
Matrix-Vector MultiplicationMediumLinear Algebra
2D Convolution (Tiled)MediumConvolution
Layer NormalizationMediumNormalization
HistogramMediumData Analysis
GELU ActivationMediumActivation Functions
SGEMM (Naive)MediumLinear Algebra
Warp-level ReductionMediumReduction
SGEMM (Tiled with Shared Memory)HardLinear Algebra
Batched Matrix MultiplicationHardLinear Algebra
Flash Attention (Forward Pass)HardAttention
Transpose Convolution (Deconvolution)HardConvolution
Block-sparse Matrix MultiplicationHardSparse Operations
Fused Multi-Head AttentionHardAttention
Grouped ConvolutionHardConvolution
Depthwise Separable ConvolutionHardConvolution
Online Softmax (Numerically Stable)HardActivation Functions
Tensor Contraction (Einstein Summation)HardTensor Operations