Saturday, December 13, 2014

Boosting vs Bagging

This is a paper that compares bagging and boosting on decision trees:

http://home.eng.iastate.edu/~julied/classes/ee547/Handouts/q.aaai96.pdf

The paper shows that both bagging and boosting improve over individual trees and that boosting usually gives better results than bagging, although in some cases boosting fails, probably due to its tendency to get distracted by noisy records.

Note that Quinlan is an important name in the field of machine learning. He is the one that introduced C4.5.

No comments:

Post a Comment