Term tag: regression

Conformal Prediction

A model-agnostic, distribution-free method that turns any prediction into a set guaranteed to contain the true answer at a chosen rate, such as 90%.

Decision Trees (DT)

How a decision tree actually chooses each split: Gini impurity worked by hand, why depth drives overfitting, and what a single tree cannot represent.

k-Nearest Neighbors (kNN)

How k-Nearest Neighbors classifies a point by majority vote of its k closest neighbours: choosing k, the distance metric, and the curse of dimensionality.

Random Forest (RF)

A random forest averages many decision trees, each grown on a bootstrap sample and split on a random subset of features, to cut variance without adding bias.

Regression

The supervised-learning task of predicting a continuous number — a price, a temperature, a duration — from input features, in contrast to classification.

Supervised Learning

Training a model on labeled input-output pairs so it learns a mapping it can apply to new, unlabeled inputs.

Support Vector Machines (SVM)

A classifier that separates two classes with the widest possible margin, using support vectors and the kernel trick to handle non-linear data.

Time Series

Data points indexed in time order, where the sequence matters and rows aren't independent — analyzed to forecast future values or flag anomalies.