--

Since you construct random forests by randomly sampling trees, if you take the mean over infinitely many samples we arrive at a statistical expectation. This expectation is no longer random, but a fixed quantity, with fixed generalization error.

As you sample more and more trees, the forest converges to the expectation, so its generalization error comverges to the limit too (generally greater than 0.)

--

--

Sankar Srinivasan

Data Scientist. Passionate about simplifying complex ideas.