Apache Kafka on Kubernetes using Helm Chart - Installing and Running Apache Kafka

#kafka #kubernetes #helm

Apache Kafka is a popular tool for building real-time, distributed data processing pipelines. Running Apache Kafka on Kubernetes with Helm Chart has become a popular way to deploy Kafka clusters due to its ease of use and scalability. In this video, we will show you how to install and run Apache Kafka on Kubernetes using Helm Chart. We will cover the steps needed to get your Kafka clusters up and running, as well as some helpful tips and tricks for running Apache Kafka on Kubernetes.

Helm chart
------------------
https://github.com/bitnami/charts/tre...

Minikube windows
------------------------------
https://github.com/kubernetes/minikub...

Minikube Linux
------------------------
https://github.com/kubernetes/minikub...

Helm Windows
-------------------------
https://get.helm.sh/helm-v3.10.2-wind...

Helm linux
-----------------
https://get.helm.sh/helm-v3.10.2-linu...

Starting the Kubernetes cluster
-------------------------------------------------
minikube start --profile kafkaminikube --cpus 6 --memory 15360 --driver virtualbox --no-vtx-check

Starting the Kubernetes dashboard
---------------------------------------------------------
minikube dashboard --profile=kafkaminikube --url true

Adding bitnami repository to local helm repository
--------------------------------------------------------------------------------
helm repo add bitnami https://charts.bitnami.com/bitnami

Apache kafka Installation
------------------------------------------
helm install kafka-release bitnami/kafka --set persistence.size=8Gi,logPersistence.size=8Gi,replicaCount=3,volumePermissions.enabled=true,persistence.enabled=true,logPersistence.enabled=true,auth.clientProtocol=plaintext,allowPlaintextListener=true,listeners=PLAINTEXT://0.0.0.0:9092,advertisedListeners=PLAINTEXT://:9092,listenerSecurityProtocolMap=PLAINTEXT:PLAINTEXT,interBrokerListenerName="PLAINTEXT",serviceAccount.create=true,rbac.create=true,image.tag=latest
helm upgrade kafka-release bitnami/kafka --set externalAccess.enabled=true

Login to kafka pod
--------------------------------
kubectl exec --tty -i kafka-release-0 --namespace default -- bash

Kafka Topic creation
---------------------------------
kafka-topics.sh --create --topic test1 --bootstrap-server kafka-release-0.kafka-release-headless.default.svc.cluster.local:9092 --replication-factor 3 --partitions 3

Kafka verify the cluster using producer and consumer
------------------------------------------------------------------------------------
kafka-console-producer.sh --broker-list kafka-release-0.kafka-release-headless.default.svc.cluster.local:9092,kafka-release-1.kafka-release-headless.default.svc.cluster.local:9092,kafka-release-2.kafka-release-headless.default.svc.cluster.local:9092 --topic test1

kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test1 --from-beginning


Please subscribe by clicking the below link to support my channel:
https://bit.ly/3gM6elC


Kubernetes helm
apache kafka tutorial
apache kafka tutorial for beginners
helm charts
introduction to apache kafka
kafka apache
kafka connect
kafka consumer
kafka producer
kafka streams
kubernetes ingress
kafka kubernetes
helm charts kubernetes
deploy kafka on kubernetes
helm chart tutorial
kafka tutorial
helm kubernetes
kafka
kafka connect
kafka tutorial for beginners
kubernetes kafka
helm tutorial
install kafka
install kafka windows
kafka connect tutorial
kafka project
kubernetes
minikube
spring boot kubernetes

• #education
• #apache_kafka
• #kubernetes_helm
• #apache_kafka_tutorial
• #apache_kafka_tutorial_for_beginners
• #helm_charts
• #introduction_to_apache_kafka
• #kafka
• #kafka_apache
• #kafka_connect
• #kafka_consumer
• #kafka_producer
• #kafka_streams
• #kafka_tutorial
• #kafka_tutorial_for_beginners
• #kubernetes_ingress