Kafka in one shot | Hands on building producer, consumers using GoLang | Topics, Partitions , Broker

In this video we learn about Kafka. We start by learning why we need Kafka ? How it helps in generating realtime recommendation. Then we learn about the publisher subscriber architecture. We learn in depth about kafka architecture about topics, publishers, consumers, brokers, clusters. We then learn why kafka is so fast ? We read about zero copy and simultaneous read.
Finally, we setup Kafka using a docker container and connect to it using kadek UI. And we build a publisher and a consumer using GoLang.

Code for the Video - https://github.com/sa-y-an/ytvideos
Kadeck - https://www.kadeck.com/get-kadeck
Apache Kafka - https://kafka.apache.org/

Content -
0:00 - Agenda
1:36 - Intro ( Need for Kafka )
5:23 - Need of Publisher Subscriber Architecture
11:36 - Kafka Architecture (Topics , Consumers & Retention Period , Producers )
20:35 - Partitions
24:33 - Brokers
25:55 - The LinkedIn Problem (How Kafka solves it )
27:34 - What makes Kafka so fast (Sequential I/O & Zero Copy)
30:41 - How Kafka Got its Name ? 🤔
31:38 - Hands On with Kafka (Setting Up Kafka using Docker, Kadeck)
34:11 - ZooKeper
37:14 - Understanding Docker Compose File
38:47 - Kadek
41:09 - Building a GoLang Microservice
46:07 - Building the Publisher
1:02:19 - Demo of the publisher using Kadeck
1:04:03 - Building the consumer


Lets Connect !

Sayan - LinkedIn: sa-y-an

Coding Peer

Instagram - Instagram: codingpeer
Twitter - Twitter: CodingPeer

#codingpeer #kafka #eventstreaming #message #golang

• #education
• #codingpeer