Geeky Codes | AI Engineering, Data Engineering & Machine Learning Tutorials
How User-Defined Functions work inside Spark—and why experienced PySpark engineers treat them carefully You have a DataFrame. You need to apply a custom transformation. So you write a Python function: Then you turn it into a UDF: It works. But there is an important question: Should you actually use a UDF? In PySpark, the answer … Read more
This text explains the differences between narrow and wide transformations in Apache Spark. Narrow transformations process independently without redistributing data, while wide transformations necessitate data movement and often introduce shuffle operations, affecting performance. Understanding these concepts aids in Spark’s optimization and execution strategies, influencing stages, tasks, and overall efficiency.
Learn how RAG works, why LLMs hallucinate, and build your first Retrieval-Augmented Generation pipeline in Python. Find all tutorials here Introduction Large Language Models (LLMs) have transformed how we build AI applications. Today, we can ask models to: Tools like ChatGPT, Claude, Gemini, and Llama make these tasks feel almost magical. But there’s one major … Read more
When your LLM returns malformed JSON, the problem isn’t always the model. Here’s how to build structured, validated, and production-ready outputs with Pydantic and Instructor. Your LLM application works perfectly in development. You deploy it. A few hours later, production logs start filling up with errors: Or perhaps: The frustrating part? The model’s answer looks … Read more
Lily likes to play games with integers. She has created a new game where she determines the difference between a number and its reverse. For instance, given the number 12, its reverse is 21. Their difference is 9 . The number 120 reversed is 21, and their difference is 89. She decides to apply her game to decision making. She will … Read more
The last Ensemble method we will discuss in this series is called stacking (short for stacked generalization). It is based on a simple idea: instead of using trivial functions (such as hard voting) to aggregate the predictions of all predictors in an ensemble, why don’t we train a model to perform this aggregation? Figure below … Read more
Finding the top ( k ) most frequent elements in an array is a common question in coding interviews and a useful task in various applications like data analysis and natural language processing. This guide will walk you through three effective methods to solve this problem: using a HashMap with sorting, Min-Heap, and Bucket Sort. … Read more
In many coding interviews and real-world applications, finding the top ( k ) largest elements in an array is a common problem. This tutorial will guide you through three popular methods to solve this problem: Sorting, Min-Heap, and the Quick select algorithm. We’ll focus on the Min-Heap approach due to its efficiency and practical use … Read more
Introduction: In binary trees, exploring their structure and nodes in a systematic manner is crucial for various operations and analyses. One such traversal method is the level order traversal, which traverses the tree level by level, starting from the root node. Through this tutorial, we’ll delve into the intricacies of level order traversal and learn … Read more
Problem Statement: Given a positive integer ‘N’, our objective is to compute and return the minimum number of steps needed to reduce ‘N’ to 1. We have three permissible operations: Understanding the Approach: To efficiently solve this problem, we’ll employ dynamic programming to compute the minimum steps needed for each integer from 1 to ‘N’. … Read more
Introduction: In the realm of algorithmic problem-solving, the quest for the maximum sum of any contiguous subarray within a given array is a classic challenge. In this tutorial, we’ll embark on a journey to conquer this challenge using Kadane’s algorithm, a powerful tool that operates with a time complexity of O(N). Problem Statement: Given an … Read more
Introduction: Dynamic Programming (DP) is a powerful algorithmic technique used to solve a variety of optimization problems. One classic problem where DP shines is in finding the longest palindromic subsequence in a given string. In this tutorial, we’ll delve into the intricacies of this problem and learn how to tackle it using DP. Problem Statement: … Read more
You are given a string ‘S’. Your task is to check whether the string is palindrome or not. For checking palindrome, consider alphabets and numbers only and ignore the symbols and whitespaces. Note : Example : Input format : Output format : Note : Follow Up : Constraints : Implementation in Python
Databases vary widely, with relational databases being predominant due to their efficient data structuring and retrieval. SQL simplifies data manipulation across different DBMSs. Python’s sqlalchemy facilitates database connections, allowing data reading and writing through various methods, compatible with multiple SQL databases.
The text discusses the curse of dimensionality in machine learning, highlighting challenges in high-dimensional spaces. It suggests reducing features to improve training efficiency and visualization, while addressing potential information loss and risks of overfitting with increased dimensions. Dimensionality reduction techniques will be explored further.
Unstructured data files consist of a series of bits. The file doesn’t separate the bits from each other in any way. You can’t simply look into the file and see any structure because there isn’t any to see. Unstructured file formats rely on the file user to know how to interpret the data. For example, … Read more
As we have discussed, a Random Forest is an ensemble of Decision Trees, generally trained via the bagging method (or sometimes pasting), typically with max_samples set to the size of the training set. Instead of building a BaggingClassifier and passing it a DecisionTreeClassifier, you can instead use the RandomForestClassifier class, which is more convenient and … Read more
In many cases, the data you need to work with won’t appear within a library, such as the toy datasets in the Scikit-learn library. Real-world data usually appears in a file of some type, and a flat file presents the easiest kind of file to work with. In a flat file, the data appears as … Read more
The Utopian Tree goes through 2 cycles of growth every year. Each spring, it doubles in height. Each summer, its height increases by 1 meter. A Utopian Tree sapling with a height of 1 meter is planted at the onset of spring. How tall will the tree be after growth cycles? For example, if the number of growth cycles is n=5, the calculations are as … Read more
Given a string s of lowercase alphabets and a number k, the task is to print the minimum value of the string after removal of k characters. The value of a string is defined as the sum of squares of the count of each distinct character present in the string. Example 1: Input: s = abccc, k = 1Output: 6Explaination:We … Read more