Sani/Ensemble

Created Mon, 29 Jan 2018 13:12:35 +0000 Modified Thu, 26 Dec 2024 08:45:18 +0000
64 Words

Ensemble have two type technique which is known as bagging and boosting.

Bagging

  • Building many predictors or model
  • Take random sub-sample or bootstrap of row(data)
  • Average the result or take the majority vote
  • Every model must loosely correlate with each other to reduce variance

Boosting

  • Predictors are made sequentially
  • Predictors learn from previous predictor mistake
  • Very fast
  • Can lead to overfitting

Reference

https://medium.com/mlreview/gradient-boosting-from-scratch-1e317ae4587d https://www.dataquest.io/blog/introduction-to-ensembles/