What is Stacking of Models in Machine Learning?
The last Ensemble method we will discuss in this series is called stacking (short for stacked generalization). It is based…
Category: Random Forest
Titanic – Advanced Feature Engineering Tutorial
Introduction I decided to write this kernel because Titanic: Machine Learning from Disaster is one of my favorite competitions on Kaggle. This…
Gradient Boosting in Machine Learning
Another very popular Boosting algorithm is Gradient Boosting. Just like AdaBoost,Gradient Boosting works by sequentially adding predictors to an ensemble,…
Random Forests | Machine Learning from Scratch
As we have discussed, a Random Forest is an ensemble of Decision Trees, generally trained via the bagging method (or…
What is Bagging and Pasting? Machine Learning from Scratch
Introduction One way to get a diverse set of classifiers is to use very different training algorithms, as just discussed.…
ROC and AUC in Evaluating Classification Models
In the dynamic world of business, where data-driven decisions reign supreme, the accuracy and reliability of classification models play a…
Information Gain in Machine Learning
Information Gain (IG) is critical in machine learning and decision tree algorithms, particularly in data classification and 𝐟𝐞𝐚𝐭𝐮𝐫𝐞 𝐬𝐞𝐥𝐞𝐜𝐭𝐢𝐨𝐧. Information…