-
Decision Trees | Machine Learning from Scratch
Like SVMs, Decision Trees are versatile Machine Learning algorithms that can perform both classification and regression tasks, and even multioutput tasks. They are very powerful algorithms, capable of fitting complex datasets. For example, you trained a DecisionTreeRegressor model on the California housing dataset, fitting it perfectly (actually overfitting it).Decision Trees are also the fundamental components… Read more
-
SVM Regression | Machine Learning from Scratch
Introduction As we mentioned earlier, the SVM algorithm is quite versatile: not only does it support linear and nonlinear classification, but it also supports linear and nonlinear regression. The trick is to reverse the objective: instead of trying to fit the largest possible street between two classes while limiting margin violations, SVM Regression tries to… Read more
-
Gaussian RBF Kernel | Machine Learning from Scratch
Introduction In Previous blog we talked about Polynomial Kernel. In this blog we will talk about Gaussian RBF Kernel. Just like the polynomial features method, the similarity features method can be useful with any Machine Learning algorithm, but it may be computationally expensive to compute all the additional features, especially on large training sets. However,… Read more
-
Polynomial Kernel | Machine Learning from Scratch
In Previous blog we talked about Non Linear SVM Classifications. In this blog we will talk about Polynomial Kernel. Introduction Adding polynomial features is simple to implement and can work great with all sorts of Machine Learning algorithms (not just SVMs), but at a low polynomial degree it cannot deal with very complex datasets, and… Read more
-
How can A linear model learn non-linear/discrete patterns?
Introduction During model development, one of the techniques that many donโt experiment with is feature discretization. The core idea is to transform a continuous feature into discrete features, mostly one-hot encoded. ๐๐ก๐ฒ ๐ฐ๐จ๐ฎ๐ฅ๐ ๐ฐ๐ ๐๐จ ๐ญ๐ก๐๐ญ? My rationale for using feature discretization has almost always been simple: โIt just makes sense to discretize a feature.โ… Read more
-
Tips For Writing Efficient And Faster SQL Queries
INTRODUCTION Query optimization is an important skill for SQL developers and database administrators (DBAs). In order to improve the performance of SQL queries, developers and DBAs need to understand the query optimizer and the techniques it uses to select an access path and prepare a query execution plan. Query tuning involves knowledge of techniques such… Read more