Term tag: AI Testing

A/B Testing

A/B testing is the randomized experiment that decides whether a model, prompt, or feature change truly improves a live metric — or just moved on noise.

Benchmark

An AI benchmark is a standardized test or dataset used to evaluate and compare the performance of different AI models across tasks like reasoning and coding.

LLM-as-a-Judge

Using one model to grade another's output against a rubric: how it works, the biases that break it, and the human agreement rate you can actually reach.