Pyspark Tutorial for beginners
PySpark, it is a Python library for Apache Spark, an open-source distributed computing system. PySpark allows you to write Spark…
Category: Data Engineering
Data engineering involves designing, constructing, and maintaining data architectures and systems. It focuses on transforming raw data into valuable information through processes such as ETL (Extract, Transform, Load).
Extracting Financial Year from Date in Pandas and PySpark DataFrames
Introduction Working with date data often involves extracting relevant information, such as the financial year. In this blog post, we’ll…