Look up any term in AI.

Overfitting

Overfitting is when a model memorizes its training data, including the noise, so it scores high on training data but fails on new, unseen data.

Data Poisoning

Data poisoning is a cyberattack where malicious actors insert corrupted or misleading data into an AI model's training set to manipulate its future.

Tensor Operations

The array manipulations — elementwise math, matrix multiplication, reshaping, broadcasting, reduction — that every neural network is built out of.

Distributed Training

How one model is trained across thousands of GPUs — data, tensor and pipeline parallelism, and why the network rather than the chip becomes the bottleneck.

Generative AI

Generative AI learns the probability distribution its training data came from, well enough to draw new samples from it — not just sort inputs into classes.

Parallel Processing

Running many computations at the same instant across many processing units. In AI it makes matrix multiplication fast, which is why GPUs train models.