Bagging
Idea
We want to ensemble of learners to be our predictors, the predicted value is weighted sum of the predictions from each weak learners.
Introduce randomness in the dataset, so that the effect of extrem outliers will be mitigated.
Method
We sample the data with replacement
Application
random forest