Data Engineering | Geeky Codes- Code Like A Geek But In Style

17 Feb

How to collect Covid19 Data using API in Python

geekycodesco0 CommentsData Engineering, Data Pipelines, Pandas, Python, Real Life ExamplesData Collection, Data Engineering, data pipelines, Dataframe, DataScience, Machine learning, Programming, Python

In this tutorial, we will be collecting covid19 Data using API in Python. What is API? API (Application Programming Interface) is a computing interface that interacts between multiple software. What is JSON? JSON (JavaScript Object Notation) is a lightweight format for storing and transporting data. It is used to send data from server to web. Required modules: matplotlibrequestspandasjson Commands to install modules: pip install matplotlib pip install requests pip install pandas Ignore this section if you've already installed these modules. Steps: Importing all required modules.Calling API and getting JSON data.Getting the Data for a particular stateVisualization of data. The below URL redirects…

How to Extract current Temperature of any city using OpenWeatherMap API in Python

geekycodesco0 CommentsBlog, Data Engineering, Data Pipelines, Python, Real Life ExamplesCoding, DataScience, How to Extract current weather of any city using OpenWeatherMap API in Python, Programming, Python, Temperature Extraction, Weather API

In this tutorial, we will find the city's weather using the OpenWeatherMap API. To use the OpenWeatherMap API, we need to get the API key. We will get it by creating an account on their website. Create an account and get your API key. Free up to 60 calls per minute. You have to pay if you want more than that. In this tutorial, the free version is enough. We need an HTTP application module and a JSON module to work with feedback. Follow the steps below in the weather for any city. Submit JSON applications and modules.Generate a basic…

Starting Data Pipelines | Fundamentals of Data Engineering

geekycodesco0 CommentsData Engineering, Data Pipelines, Data Science, Python, SQLData Engineering, data pipelines, Ingestion, Programming, Python, SQL

This article includes a comprehensive introduction with step-by-step definitions and code in data pipelines to introduce the basics of data engineering. Data pipelines are widely used in data science and machine learning and are essential in the process of machine learning to integrate data from multiple streams to gain business intelligence for competitive and profitable analysis. What is a Data Pipeline? Data pipeline is a set of rules that motivates and converts data from multiple sources to an area where new values can be obtained. In the simplest way, the pipeline can only extract data from various sources such as…