Learn Reactive Kafka From Scratch (Part 1/3)
548 بار بازدید -
7 ماه پیش
-
Embark on a journey to
Embark on a journey to master Reactive Kafka from the ground up. This comprehensive guide provides hands-on lessons and examples for effective Kafka development. By the end of the tutorial, you will become very comfortable with Kafka.
Create a Nest.js Microservice using Kafka
☞ https://morioh.com/p/72efe8179bd7
How to Master Kafka Message Routing with Specific Partitions
☞ https://morioh.com/p/8dc65076e0f3
Build a Real-Time Notification System with Go and Kafka
☞ https://morioh.com/p/88d30c12462f
Here is what we will do in this course:
Kafka
Setting up Kafka – latest KRaft mode using custom docker image
Bootstrap Server
Various Kafka Topic commands and Options
Console Producer
Console consumer
Various Kafka properties
How apps publish and consume messages
How serialization and Deserialization works in Kafka
How Kafka Log Retention works
Offset and How to reset Offset to consume messages from specific time
Message Format
How to scale Applications using Kafka Consumer Group
Message Ordering
Kafka With Reactive Programming
Creating a simple Java Kafka producer and consumer applications using reactive programming
Various producer and consumer configuration
Auto offset reset
How to acknowledge the messages
Emitting millions events to check the performance
Seeking offset
Partition assignment strategy
Cooperative sticky assignor
Range assignor
Kafka Cluster
How cluster works
Setting up Kafka cluster using docker compose
Kafka cluster – Fault tolerance demo. How producer and consumer applications work without any issues when Kafka brokers go up and down.
Best Practices
What is producer acknowledge and why we should do that?
Min in sync replicas
Creating idempotent producer
Creating idempotent consumer to take care of duplicate messages
Compression – to reduce the size of messages and improve the throughput
Discussing Common Questions
How many topics should I create?
How many partitions should I create?
How many replicas should I have?
Batch / Parallel Processing
Consuming messages in parallel and proper order to make use of all the CPUs.
Error Handling
Retry
Dead Letter Topic
Poison Pill Messages
Kafka Transaction
How to produce and consume messages in transactional mode (like Database Transaction)
Integration Tests
Developing integration tests using Embedded Kafka
Kafka Security
Plain Credentials
SSL
Assignment
Lets test our learning by developing a couple of Microservices communicating via Kafka Topic to analyze the user behaviors and provide metrics to Business team on Product Trending.
#Kafka #Microservices #Morioh
____________________________________________
Computer Gear:
⬛ Monitor: https://amzn.to/3PWEfBv
⌨ Keyboard: https://amzn.to/3rApJG7
🐁 Mouse: https://amzn.to/3RLZBma
🎤 Mic: https://amzn.to/3RFd5QJ
📱 Tablet: https://amzn.to/45aw7Sm
💡 Lighting: https://amzn.to/3LEjNCE
💡 Key Lighting: https://amzn.to/3PZcLv7
Camera Equipment:
📷 Camera: https://amzn.to/3ZzQ1Vu
📸 Primary Lens: https://amzn.to/48C2UCv
📸 Secondary Lens: https://amzn.to/3ZBaMQI
🎥 Secondary Camera: https://amzn.to/46gjgzq
🎙 Camera Mic: https://amzn.to/3PzRs1F
🎞 USB to HDMI: https://amzn.to/455ZSnj
Book for Developer:
📔 Python: https://bit.ly/3REqgBm
📙 JavaScript: https://bit.ly/3RLdPUJ
📘 React: https://bit.ly/3ruQtb7
📗 Next.js: https://bit.ly/3LHY7pp
📗 Machine Learning: https://bit.ly/3PXJvoo
📗 Flutter: https://bit.ly/46OyL1p
📗 Angular: https://bit.ly/3PFrGZT
📗 SQL: https://bit.ly/46aDc6D
Please note I may earn a small commission for any purchase through these links - Thanks for supporting the channel!
____________________________________________
Note: If you have any copyright issue with the content used in our channel or you find something that belongs to you, before you claim it to Youtube, SEND US A MESSAGE and the respective content will be DELETED right away. Thanks for understanding.
◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️
👕 Merchandise: https://www.moteefe.com/store/develop...
🌎 Social Network for Developers: https://morioh.com/
📱 Twitter: https://twitter.com/moriohdotcom
Create a Nest.js Microservice using Kafka
☞ https://morioh.com/p/72efe8179bd7
How to Master Kafka Message Routing with Specific Partitions
☞ https://morioh.com/p/8dc65076e0f3
Build a Real-Time Notification System with Go and Kafka
☞ https://morioh.com/p/88d30c12462f
Here is what we will do in this course:
Kafka
Setting up Kafka – latest KRaft mode using custom docker image
Bootstrap Server
Various Kafka Topic commands and Options
Console Producer
Console consumer
Various Kafka properties
How apps publish and consume messages
How serialization and Deserialization works in Kafka
How Kafka Log Retention works
Offset and How to reset Offset to consume messages from specific time
Message Format
How to scale Applications using Kafka Consumer Group
Message Ordering
Kafka With Reactive Programming
Creating a simple Java Kafka producer and consumer applications using reactive programming
Various producer and consumer configuration
Auto offset reset
How to acknowledge the messages
Emitting millions events to check the performance
Seeking offset
Partition assignment strategy
Cooperative sticky assignor
Range assignor
Kafka Cluster
How cluster works
Setting up Kafka cluster using docker compose
Kafka cluster – Fault tolerance demo. How producer and consumer applications work without any issues when Kafka brokers go up and down.
Best Practices
What is producer acknowledge and why we should do that?
Min in sync replicas
Creating idempotent producer
Creating idempotent consumer to take care of duplicate messages
Compression – to reduce the size of messages and improve the throughput
Discussing Common Questions
How many topics should I create?
How many partitions should I create?
How many replicas should I have?
Batch / Parallel Processing
Consuming messages in parallel and proper order to make use of all the CPUs.
Error Handling
Retry
Dead Letter Topic
Poison Pill Messages
Kafka Transaction
How to produce and consume messages in transactional mode (like Database Transaction)
Integration Tests
Developing integration tests using Embedded Kafka
Kafka Security
Plain Credentials
SSL
Assignment
Lets test our learning by developing a couple of Microservices communicating via Kafka Topic to analyze the user behaviors and provide metrics to Business team on Product Trending.
#Kafka #Microservices #Morioh
____________________________________________
Computer Gear:
⬛ Monitor: https://amzn.to/3PWEfBv
⌨ Keyboard: https://amzn.to/3rApJG7
🐁 Mouse: https://amzn.to/3RLZBma
🎤 Mic: https://amzn.to/3RFd5QJ
📱 Tablet: https://amzn.to/45aw7Sm
💡 Lighting: https://amzn.to/3LEjNCE
💡 Key Lighting: https://amzn.to/3PZcLv7
Camera Equipment:
📷 Camera: https://amzn.to/3ZzQ1Vu
📸 Primary Lens: https://amzn.to/48C2UCv
📸 Secondary Lens: https://amzn.to/3ZBaMQI
🎥 Secondary Camera: https://amzn.to/46gjgzq
🎙 Camera Mic: https://amzn.to/3PzRs1F
🎞 USB to HDMI: https://amzn.to/455ZSnj
Book for Developer:
📔 Python: https://bit.ly/3REqgBm
📙 JavaScript: https://bit.ly/3RLdPUJ
📘 React: https://bit.ly/3ruQtb7
📗 Next.js: https://bit.ly/3LHY7pp
📗 Machine Learning: https://bit.ly/3PXJvoo
📗 Flutter: https://bit.ly/46OyL1p
📗 Angular: https://bit.ly/3PFrGZT
📗 SQL: https://bit.ly/46aDc6D
Please note I may earn a small commission for any purchase through these links - Thanks for supporting the channel!
____________________________________________
Note: If you have any copyright issue with the content used in our channel or you find something that belongs to you, before you claim it to Youtube, SEND US A MESSAGE and the respective content will be DELETED right away. Thanks for understanding.
◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️
👕 Merchandise: https://www.moteefe.com/store/develop...
🌎 Social Network for Developers: https://morioh.com/
📱 Twitter: https://twitter.com/moriohdotcom
7 ماه پیش
در تاریخ 1402/10/04 منتشر شده
است.
548
بـار بازدید شده