Tag Archives: Bagging

How Random Forests improve simple Regression Trees?

By Gabriel Vasconcelos Regression Trees In this post I am going to discuss some features of Regression Trees an Random Forests. Regression Trees are know to be very unstable, in other words, a small change in your data may drastically … Continue reading

Posted in R | Tagged , , , , , , | 5 Comments

Bagging, the perfect solution for model instability

By Gabriel Vasconcelos Motivation The name bagging comes from boostrap aggregating. It is a machine learning technique proposed by Breiman (1996) to increase stability in potentially unstable estimators. For example, suppose you want to run a regression with a few … Continue reading

Posted in R | Tagged , , , , , | 3 Comments