Term tag: Text Generation

Diffusion Language Models (DLMs)

Text models that unmask many tokens per pass instead of writing one at a time — what that actually buys in speed, and what it costs in quality.

Temperature

Temperature is the number that controls how random a language model's output is — it divides the logits before softmax, from near-deterministic to diverse.

Text Generation

Text generation is a language model producing text one token at a time: at each step it predicts a distribution over its vocabulary, picks a token, repeats.