Programming, AI, Machine Learning & Software Development Tutorials
In this Section Explore Curated AWS tutorials related to AWS Glue, AWS Athena, AWS Sagemaker
Stop scanning the entire S3 dataset when you only need a handful of Parquet files When working with large datasets on AWS S3, Parquet is one of the most popular storage formats for data engineering and analytics workloads. It’s columnar. It’s compressed. It supports predicate pushdown. And it works extremely well with distributed processing frameworks … Read more
Introduction Imagine you’ve built an amazing house price prediction website(flask ML App) using Flask and a machine learning model. The application works perfectly. Users enter details like location, area, number of bedrooms, and the model predicts the property’s price within milliseconds. There’s just one problem. Most of the day, nobody is using it. Yet your AWS … Read more
PySpark, it is a Python library for Apache Spark, an open-source distributed computing system. PySpark allows you to write Spark applications using Python programming language, providing a Python API for Spark’s capabilities. Below are some properties of pyspark. 1. Create a simple Spark Dataframe 2. Read data from a table using spark.sql To read data … Read more
Introduction Working with date data often involves extracting relevant information, such as the financial year. In this blog post, we’ll explore how to extract the financial year from a date column in both Pandas and PySpark DataFrames. Extracting Financial Year in Pandas DataFrame Sample Data Let’s start by creating a sample Pandas DataFrame with a … Read more