How to Stream Data using Apache Kafka & Debezium from Postgres | Real Time ETL | ETL | Part 2

In this video we will set up database streaming from Postgres database to Apache Kafka. In the previous session we installed Apache Kafka, Debezium and the rest of the required components, and configured the Postgres database for data streaming. Today we will configure a the Database and Debezium Connector and start Streaming data from our Postgres database.

Link to Part 1:   Set up Debezium, Apache Kafka and Pos...

Link to Postgres Install:   How to install PostgreSQL  on windows...
Link to Python ETL: How to build an ETL pipeline with Pyt...

#apachekafka #DataStreaming #etl

💻  GitHub: https://github.com/hnawaz007/pythonda...


💥Subscribe to our channel:
haqnawaz

📌 Links
-----------------------------------------
#️⃣ Follow me on social media! #️⃣

🔗 GitHub: https://github.com/hnawaz007
📸 Instagram: Instagram: bi_insights_inc
📝 LinkedIn: LinkedIn: haq-nawaz
🔗 Medium: hnawaz100

-----------------------------------------

Topics covered in this video:
0:00 - Introduction Apache Kafka, Debezium and requirements
0:29 - Postgres Table Creation
2:22 - Python Data Insert Script
3:13 - Kafka Connect API Client
3:41-  VS Code API Client Install
5:03 - Postgres Kafka Connector
7:38 - Kafka Topics & Insert row for topic creation
8:53 - Stream Data to Kafka

• #science_technology
• #kafka_quick_start
• #apache_kafka
• #kafka
• #kafka_python_consumer
• #kafka_python_producer
• #kafka_data_streaming
• #kafka_setup_on_docker
• #etl
• #data_streaming
• #schema_registry
• #how_to_install_kafka
• #build_data_pipeline
• #real_time_data_pipeline
• #data_pipeline_with_kafka
• #kafka_stream_data_from_database
• #learn_kafka
• #apache_kafka_data_streaming
• #apache_kafka_postgres_data_streaming
• #database_real_time_etl
• #stream_database_changes_to_kafka
• #real_time_etl