Geeky Codes | AI Engineering, Data Engineering & Machine Learning Tutorials
Introduction Imagine you’ve built an amazing house price prediction website(flask ML App) using Flask and a machine learning model. The application works perfectly. Users enter details like location, area, number of bedrooms, and the model predicts the property’s price within milliseconds. There’s just one problem. Most of the day, nobody is using it. Yet your AWS … Read more
Understanding Nested Parallelism,FastAPI, OpenMP Thread Contention, and the Right Way to Deploy CPU-Bound Machine Learning Models Imagine This… You have trained a Random Forest classifier using Scikit-Learn. Everything works perfectly during development. You deploy it behind FastAPI, add a bit of asynchronous programming using run_in_executor(), and your API happily serves requests. Then someone runs a … Read more
What Is Longest Consecutive Sequence in Python? The Longest Consecutive Sequence in Python problem is one of the most popular coding interview questions asked by top technology companies such as Google, Amazon, Microsoft, Meta, and Netflix. At first glance, the problem appears straightforward. However, the requirement to achieve O(n) time complexity makes it an excellent … Read more
PyTorch CNN Shape Mismatch Error is one of the most common and frustrating issues faced by machine learning engineers and deep learning beginners. If you’ve encountered the dreaded: error while training or evaluating a Convolutional Neural Network (CNN), you’re not alone. The good news is that this error is usually easy to diagnose once you … Read more
To analyze user activity across multiple months, a self-join approach in SQL is preferred over separate joins, as it optimizes performance significantly. By matching records on MemberID and counting members in valid month pairs, one can efficiently identify active users without extensive resource use. Proper indexing further enhances this method.
If you’re working with SAP HANA and trying to join a parameterized view with other tables, you may encounter the following error: The confusing part is that the view executes perfectly when called directly, but fails when used inside a JOIN. In this article, we’ll walk through the root cause of this issue, understand how … Read more
Problem Statement Given a string containing lowercase English letters, compute the frequency of each character and then invert the mapping such that: Example Input Character Frequency Map Expected Output Understanding the Problem Most frequency-counting problems stop after creating a dictionary that maps characters to their counts. For this problem, we need to go one step … Read more
This concluding section wraps up critical concepts regarding Auto Loader scalability, DLT pipeline modes, Databricks SQL caching, Workflow concurrency, and the key differences between ingestion methods. Let’s bring it home! 🚀 Part 36: Ingestion Scalability Question 51: Auto Loader at Massive Scale A data engineering team is using Auto Loader in Directory Listing mode to … Read more
In this section, we are focusing on advanced Delta Lake optimization, streaming-static joins, Unity Catalog security features, and Databricks SQL alerting. 🛡️ Part 26: Unity Catalog Row & Column Security Question 41: Dynamic Data Masking A company policy dictates that only members of the hr_team group are allowed to see the actual values in the … Read more
In this section, we dive deep into Change Data Capture (CDC) with Delta Live Tables, Spark memory management, Databricks Workflows routing, and secure data sharing. Let’s keep crushing it! 🔄 Part 16: Delta Live Tables (DLT) & CDC Question 31: Handling Change Data Capture (CDC) A data engineer is building a Delta Live Tables (DLT) … Read more
In this section, we tackle advanced ingestion with Auto Loader, Spark internals, Delta Live Tables (DLT) architectures, and Databricks Workflows. Let’s keep the momentum going! 📥 Part 10: Advanced Auto Loader & Streaming Question 21: Handling Evolving Schemas A data engineer is using Auto Loader to ingest JSON files. The upstream team frequently adds new … Read more
🌊 Part 5: Delta Lake Mechanics Question 11: Accidental Data Deletion A junior data engineer accidentally ran a DELETE statement that removed millions of valid rows from a Delta table named sales_prod exactly two hours ago. The table has not been VACUUMed. Which Databricks SQL command should you use to recover the data? ✅ Correct … Read more
Preparing for a Databricks Data Engineering certification? Mastering the concepts is only half the battle; you also need to know how to navigate tricky multiple-choice scenarios. In this post, we’ll break down 10 real-world exam-style questions covering PySpark, Unity Catalog, Databricks Workflows, and Performance Optimization. More importantly, we won’t just give you the answers—we’ll explain … Read more
Prime numbers have fascinated mathematicians for centuries. Among the many special categories of primes, Chen Primes occupy an interesting place because they extend the idea of twin primes and connect prime numbers with semiprimes. In this article, we’ll understand: What is a Chen Prime? A prime number P is called a Chen Prime if: A … Read more
Large Language Models (LLMs) are pretrained on vast datasets to understand language and various concepts. Enterprises often fine-tune these models for specific domains. Techniques like full fine-tuning and Parameter-Efficient Fine-Tuning (PEFT) optimize model adaptation while minimizing costs and risks like catastrophic forgetting. Understanding these strategies is essential for AI applications.
“Our RAG chatbot worked perfectly in the POC.But once we scaled to 50,000 documents… accuracy dropped to 60%.” If you’ve worked with enterprise RAG systems, you’ve probably heard this story. And if you ask most engineers what went wrong, you’ll hear answers like: ❌ These sound smart❌ They sometimes help❌ But they miss the real … Read more
This blog explores how to measure ROI for Generative AI (GenAI) in healthcare. It outlines key performance indicators (KPIs) related to clinical outcomes, operational efficiency, finance, and patient experience. It emphasizes the importance of clear objectives, baseline measurements, and best practices to successfully assess GenAI’s impact on healthcare organizations.
Introduction: In string manipulation, discovering unique strings amidst a sea of possibilities can be both challenging and rewarding. In this tutorial, we embark on a journey to unravel the secrets of identifying unique strings, armed with the power of swapping characters at odd and even indices. Join us as we delve into the depths of … Read more
Introduction:In modern software development, adhering to principles and practices that promote maintainability, scalability, and reusability is crucial. Two fundamental concepts in this regard are the SOLID principles and dependency injection. In this tutorial, we’ll delve into these concepts, explaining what they are, how to apply them, and why they are essential in software development. We’ll … Read more
Let’s switch to the California housing problem and tackle it using a regression neural network. For simplicity, we will use Scikit-Learn’s fetch_california_housing() function to load the data. This dataset is simpler since it contains only numerical features. There is no ocean_proximity feature, and there is no missing value. After loading the data, we split it … Read more