How to load data into PostgreSQL using Python | Your first ETL pipeline | Data Engineering Tutorial
10.1 هزار بار بازدید -
2 سال پیش
-
What are the basics you
What are the basics you should cover when you build an ETL pipeline?
🎬In this episode I am showing you how an ETL process would look like. We are going to load the data from Task 8 and load it into our local PostgreSQL database.
✨If you are new here:
This is a public and weekly online Python Class which you can attend as well. All you have to do is to join our Discord server if you are interested! Links down below :)
==== CLASS STARTS AT 4:30 ====
⏱ Timestamps
0:00 Intro & Agenda
1:00 Recap - How to start web scraping using DEV TOOLS
4:30 Example how my ETL pipeline would look like
9:30 What is a logger?
17:00 Test the database connection
27:25 How to create a database table based on your data
42:00 How to extract the .json data and load into PostgreSQL
========================
If you want to learn how to become a programmer and build automated software, this video is for you. Feel free to drop them in the comments or join our socials!
========================
🙋♂️Community Discord:
Discord: discord
https://theselfdev.com
blog.theselfdev.com
pomo.theselfdev.com
📲 Instagram:
Instagram: self.devs
📩 Connect with me:
Instagram - Instagram: long.integer
Twitch - Twitch: longlikeshort
Twitter - Twitter: longinteger017
BGM: Video
Subscriber: 1174
#dataengineering #pythontutorial #dataanalysis
📚The FASTEST way to become a Data Engineer:
FASTEST Way to Become a Data Engineer...
📚Knowing this about DATA will shock you:
This SECRET behind NETFLIX will shock...
📚FREE Python Programming Class:
How to start learning Python Programm...
🎬In this episode I am showing you how an ETL process would look like. We are going to load the data from Task 8 and load it into our local PostgreSQL database.
✨If you are new here:
This is a public and weekly online Python Class which you can attend as well. All you have to do is to join our Discord server if you are interested! Links down below :)
==== CLASS STARTS AT 4:30 ====
⏱ Timestamps
0:00 Intro & Agenda
1:00 Recap - How to start web scraping using DEV TOOLS
4:30 Example how my ETL pipeline would look like
9:30 What is a logger?
17:00 Test the database connection
27:25 How to create a database table based on your data
42:00 How to extract the .json data and load into PostgreSQL
========================
If you want to learn how to become a programmer and build automated software, this video is for you. Feel free to drop them in the comments or join our socials!
========================
🙋♂️Community Discord:
Discord: discord
https://theselfdev.com
blog.theselfdev.com
pomo.theselfdev.com
📲 Instagram:
Instagram: self.devs
📩 Connect with me:
Instagram - Instagram: long.integer
Twitch - Twitch: longlikeshort
Twitter - Twitter: longinteger017
BGM: Video
Subscriber: 1174
#dataengineering #pythontutorial #dataanalysis
📚The FASTEST way to become a Data Engineer:
FASTEST Way to Become a Data Engineer...
📚Knowing this about DATA will shock you:
This SECRET behind NETFLIX will shock...
📚FREE Python Programming Class:
How to start learning Python Programm...
2 سال پیش
در تاریخ 1401/07/27 منتشر شده
است.
10,174
بـار بازدید شده