Term tag: mathematical foundations

Matrix Multiplication (GEMM)

The one operation that consumes most of an AI model's compute — and the reason AI chips are built the way they are, from tensor cores to systolic arrays.

Tensor Operations

The array manipulations — elementwise math, matrix multiplication, reshaping, broadcasting, reduction — that every neural network is built out of.