Look up any term in AI.

Knowledge Distillation

How a small model learns what a big one knows: the teacher's full probability distribution carries structure the hard labels do not — Hinton's dark knowledge.

Retrieval-Augmented Generation (RAG)

A technique that retrieves relevant documents at query time and feeds them into a language model's prompt, so it answers from current, external facts.

AI in Science

Three different things get called AI for science. Two have produced verified results, the third mostly has not — and what got revised down.

AI Infrastructure

Why AI clusters are designed around memory bandwidth and interconnect rather than FLOPs, and what that changes when you size a training run or a serving fleet.

Graph Neural Networks (GNN)

A GNN takes adjacency as data, not as an architectural assumption. Message passing worked by hand, why k layers reach d^k nodes, and why deep GNNs collapse.

High Bandwidth Memory (HBM)

Stacked DRAM bonded beside the GPU die — the scarce component that gates AI accelerator supply, and why bandwidth rather than capacity is the constraint.