Random Forest Explainer
A random forest is an ensemble of decision trees whose predictions are combined. Each tree is trained with randomness, commonly a bootstrap sample of the training rows and a random subset of features considered at each split. Classification uses votes or averaged probabilities; regression averages numeric outputs.
The trees should be useful individually but not make identical errors. Averaging many partly independent trees reduces the instability and variance of a single deep tree. Adding trees usually stabilizes the ensemble, although training and prediction require more computation and memory.
Random forests work with nonlinear relationships and interactions and often require less feature scaling than distance-based methods. Out-of-bag examples—rows omitted from a tree’s bootstrap sample—can provide an internal performance estimate and support some diagnostic measures.
The model is less transparent than one small tree. Feature-importance scores can favor certain variables or spread importance across correlated features, and they do not establish causation. Evaluation still needs representative held-out data, threshold choices, subgroup checks, and attention to missing or changing inputs.
A random forest combines many decision trees trained with randomized data and feature choices.
Key terms include ensemble, decision tree, bootstrap sample, feature subsampling, vote, averaging, variance, out-of-bag estimate and feature importance.
Random row samples and random candidate features encourage trees to learn different rules instead of repeating the same dominant pattern.
Their outputs are combined so that errors unique to a few trees have less influence on the final prediction.
Random forests are a strong general-purpose baseline for many tabular problems and can model interactions without manually specifying them.
Large ensembles can be costly, probability estimates may need calibration, and global importance summaries can obscure context and correlated features.
Explore more "Explainers"
Discover additional explainers across politics, science, business, technology, and other fields. Each explainer breaks down a complex idea into clear, everyday language—helping you better understand how major concepts, systems, and debates shape the world around us.