ROC and AUC in Evaluating Classification Models

In the dynamic world of business, where data-driven decisions reign supreme, the accuracy and reliability of classification models play a pivotal role. Whether you’re involved in lead scoring or any other binary classification system, understanding the intricacies of evaluation metrics is key. Among these, the ROC (Receiver Operating Characteristic) curve and its integral companion, AUC … Read more

Support Vector Machines (SVM) Algorithms

A Support Vector Machine (SVM) is a very powerful and versatile Machine Learning model, capable of performing linear or nonlinear classification, regression, and even outlier detection. It is one of the most popular models in Machine Learning, and anyone interested in Machine Learning should have it in their toolbox. SVMs are particularly well suited for … Read more

What is early stopping? | Machine Learning from Scratch

Machine learning models, particularly those trained iteratively using algorithms like Gradient Descent, face the risk of overfitting the training data. One powerful and elegant solution to this challenge is known as “Early Stopping.” In this blog post, we’ll delve into the concept of Early Stopping, explore its effectiveness, and showcase a practical implementation using a … Read more

Information Gain in Machine Learning

Information Gain

Information Gain (IG) is critical in machine learning and decision tree algorithms, particularly in data classification and 𝐟𝐞𝐚𝐭𝐮𝐫𝐞 𝐬𝐞𝐥𝐞𝐜𝐭𝐢𝐨𝐧. Information Gain Information Gain is a concept used in the field of machine learning and decision trees to measure the effectiveness of an attribute in classifying a dataset. It is commonly employed in the construction of … Read more

Pyspark Tutorial for beginners

S3 Bucket

PySpark, it is a Python library for Apache Spark, an open-source distributed computing system. PySpark allows you to write Spark applications using Python programming language, providing a Python API for Spark’s capabilities. Below are some properties of pyspark. 1. Create a simple Spark Dataframe 2. Read data from a table using spark.sql To read data … Read more

Extracting Financial Year from Date in Pandas and PySpark DataFrames

Python

Introduction Working with date data often involves extracting relevant information, such as the financial year. In this blog post, we’ll explore how to extract the financial year from a date column in both Pandas and PySpark DataFrames. Extracting Financial Year in Pandas DataFrame Sample Data Let’s start by creating a sample Pandas DataFrame with a … Read more

What is Lasso Regression? | Machine Learning from Scratch

Least Absolute Shrinkage and Selection Operator Regression (simply called Lasso Regression) is another regularized version of Linear Regression: just like Ridge Regression, it adds a regularization term to the cost function, but it uses the ℓ1 norm of the weight vector instead of half the square of the ℓ2 norm. Figure below shows the same … Read more

Regularized Linear Models(Ridge Regression) | Machine Learning from Scratch

As we saw in previous posts, a good way to reduce overfitting is to regularize the model (i.e., to constrain it): the fewer degrees of freedom it has, the harder it will be for it to overfit the data. For example, a simple way to regularize a polynomial model is to reduce the number of … Read more

Hackerrank | Longest Subarray with Absolute Difference Constraint

Hackerrank

Problem Overview Given an array of integers, our task is to find the longest subarray such that the absolute difference between any two elements is less than or equal to 1. Example a=[1,1,2,2,4,4,5,5,5] There are two subarrays meeting the criterion: [1,1,2,2] and [4,4,5,5,5]. The maximum length subarray has 5 elements. Function Description Complete the pickingNumbers function in the editor below. pickingNumbers has … Read more

Hackerrank | Magic Square

Hackerrank

We define a magic square to be an n*n matrix of distinct positive integers from 1 to n^2 where the sum of any row, column, or diagonal of length n is always equal to the same number: the magic constant. You will be given a 3*3 matrix  of integers in the inclusive range [1,9]. We can convert any digit a to any other digit b in the range [1,9] at cost of [a,b]. Given s, convert it into … Read more

A Python Script to Check IP Address Reachability

Python

Introduction In the world of networking, ensuring that devices are reachable is a fundamental aspect of troubleshooting and monitoring. One common method to test this reachability is by using the ping command. In this blog post, we will explore a simple Python script that prompts the user for an IP address and checks its reachability … Read more

Hackerrank | Birthday Candles Problem

Hackerrank

You are in charge of the cake for a child’s birthday. You have decided the cake will have one candle for each year of their total age. They will only be able to blow out the tallest of the candles. Count how many candles are tallest. Example candles=[4,4,1,3] The maximum height candles are  4 units high. … Read more

Hackerrank | Min Max Sum of N-1 Elements

Given five positive integers, find the minimum and maximum values that can be calculated by summing exactly four of the five integers. Then print the respective minimum and maximum values as a single line of two space-separated long integers. Example arr=[1,3,5,7,9] The minimum sum is 1+3+5+7=16 and the maximum sum is 3+5+7+9=24 . The function prints Function Description … Read more

HackerRank Problem | Staircase detail

Staircase detail This is a staircase of size n=4: Its base and height are both equal to 4 . It is drawn using # symbols and spaces. The last line is not preceded by any spaces. Write a program that prints a staircase of size n. Function Description Complete the staircase function in the editor below. staircase has the following parameter(s): Print Print … Read more

Hackerrank | Plus Minus Problem

Python

Given an array of integers, calculate the ratios of its elements that are positive,  negative, and zero. Print the decimal value of each fraction on a new line with  places after the decimal. Note: This challenge introduces precision problems. The test cases are scaled to six decimal places, though answers with absolute error of up to  10^-4 are acceptable. Example … Read more

Hackerrank Problems | Diagonal Difference

Given a square matrix, calculate the absolute difference between the sums of its diagonals. For example, the square matrix  is shown below: The left-to-right diagonal =1+5+9=15. The right to left diagonal = 3+5+9=17. Their absolute difference is |15-17|=2. Function description Complete the  diagonalDifference function in the editor below. diagonalDifference takes the following parameter: Return Input Format The first line … Read more

Hackerrank Problems | Compare the triplets

Python

Alice and Bob each created one problem for HackerRank. A reviewer rates the two challenges, awarding points on a scale from 1 to 100 for three categories: problem clarity, originality, and difficulty. The rating for Alice’s challenge is the triplet a = (a[0], a[1], a[2]), and the rating for Bob’s challenge is the triplet b = (b[0], b[1], b[2]). The task is to find … Read more

Learning Curves | Machine Learning from Scratch

bias-and-variance.

Till now, We have read about Gradient Descent,Min-Batch Gradient Descent,Stochastic Gradient Descent and other type of Gradient Descents and Polynomial Regression. In this post we will learn about Learning Curves in Machine Learning . Introduction Learning curves are graphical representations of how a model’s performance changes over time as it learns from training data. These … Read more

Polynomial Regression | Machine Learning from Scratch

Polynomial regression

Introduction Till now, We have read about Gradient Descent,Min-Batch Gradient Descent,Stochastic Gradient Descent and other type of Gradient Descents. In this post we will learn about Polynomial Regression. What if your data is actually more complex than a simple straight line? Surprisingly,you can actually use a linear model to fit nonlinear data. A simple way … Read more