What is Stacking of Models in Machine Learning?
The last Ensemble method we will discuss in this series is called stacking (short for stacked generalization). It is based…
Category: Decision Tree
Gradient Boosting in Machine Learning
Another very popular Boosting algorithm is Gradient Boosting. Just like AdaBoost,Gradient Boosting works by sequentially adding predictors to an ensemble,…
Boosting( Ensemble) Trees | Machine Learning from Scratch
Introduction Boosting (originally called hypothesis boosting) refers to any Ensemble method that can combine several weak learners into a strong…
What is Bagging and Pasting? Machine Learning from Scratch
Introduction One way to get a diverse set of classifiers is to use very different training algorithms, as just discussed.…
What is Ensemble Learning? | Machine Learning from Scratch
Introduction: Welcome to our comprehensive tutorial on Ensemble Learning! In this guide, we’ll delve into the fascinating world of Ensemble…
Decision Tree Regression | Machine Learning from Scratch
Decision Trees are also capable of performing regression tasks. Let’s build a regression tree using Scikit-Learn’s DecisionTreeRegressor class, training it…
Gini Impurity or Entropy? How to decide the root node in decision tree?
By default, the Gini impurity measure is used, but you can select the entropy impurity measure instead by setting the…
Decision Trees | Machine Learning from Scratch
Like SVMs, Decision Trees are versatile Machine Learning algorithms that can perform both classification and regression tasks, and even multioutput…
ROC and AUC in Evaluating Classification Models
In the dynamic world of business, where data-driven decisions reign supreme, the accuracy and reliability of classification models play a…
Information Gain in Machine Learning
Information Gain (IG) is critical in machine learning and decision tree algorithms, particularly in data classification and 𝐟𝐞𝐚𝐭𝐮𝐫𝐞 𝐬𝐞𝐥𝐞𝐜𝐭𝐢𝐨𝐧. Information…
Learning Curves | Machine Learning from Scratch
Till now, We have read about Gradient Descent,Min-Batch Gradient Descent,Stochastic Gradient Descent and other type of Gradient Descents and Polynomial…