Term tag: Benchmarks

AI Hallucinations

Models hallucinate because training and benchmarks reward guessing over admitting ignorance: a guess sometimes scores, "I don't know" scores zero every time.

Artificial General Intelligence (AGI)

AGI is AI matching human ability across most cognitive work — and there is no agreed test for it, so the definition you pick decides the answer.

Benchmark

An AI benchmark is a standardized test or dataset used to evaluate and compare the performance of different AI models across tasks like reasoning and coding.

Computer Use (GUI Agents)

How AI operates software by reading screenshots and issuing clicks and keystrokes: the perception-action loop, why grounding is hard, and what OSWorld measures.

Generalization

Why a model that scores 99% in training fails in the world: the generalization gap, the test-set size needed to measure it, and why classical theory is wrong.

Natural Language Processing (NLP)

NLP is the field; large language models are now the answer to most of it. What sixty years of work was for, and which parts are still unsolved.

Reasoning Model

A model trained to think at length before answering. How it differs from a chat model, what the effort dial does, and the tasks where it earns its price.

State of the Art Model (SOTA)

There is no single SOTA model. How to read a benchmark claim — and why a 3-point lead on GPQA Diamond is six questions, well inside the noise.