I’ve been spending the last few weeks reading all of the original academic papers I can find on ensembles. By “original” I mean the major papers that launched the various famous approaches and algorithms. I want to list this here to help anyone who might conduct a similar search (including myself in the future). In some cases, they aren’t originally the first paper, but each is a comprehensive paper written by the person credited with developing the technique.

Bagging: Bagging Predictors by Leo Breiman, 1994

Random Forests: Random Forests by Leo Breiman, 2001

AdaBoost: Intro to Boosting by Y. Freund, and R. Shapire, 1999

Super Learner (stacking): Super Learner by van der Laan, et al, 2007