Skip to main content
Version: Nightly

Manage Kafka

The GreptimeDB cluster uses Kafka as the Remote WAL storage. This guide describes how to manage Kafka cluster. This guide will use Bitnami's Kafka Helm chart as an example.

Prerequisites​

Install​

Save the following configuration as a file kafka.yaml:

controller:
  replicaCount: 1
  persistence:
    enabled: true
    size: 200Gi 
  resources:
    limits:
      cpu: 2
      memory: 2G

broker:
  replicaCount: 3 # Set to the number of brokers you want to deploy.
  persistence:
    enabled: true
    size: 200Gi 
  resources:
    limits:
      cpu: 2
      memory: 2G

Install Kafka cluster:

helm upgrade --install kafka \
    oci://registry-1.docker.io/bitnamicharts/kafka \
    --values kafka.yaml \
    --version 31.5.0 \
    --create-namespace \
    -n kafka-cluster

Wait for Kafka cluster to be ready:

kubectl wait --for=condition=ready pod \
    -l app.kubernetes.io/instance=kafka \
    -n kafka-cluster \

Check the status of the Kafka cluster:

kubectl get pods -n kafka-cluster
Expected Output
NAME                 READY   STATUS    RESTARTS   AGE
kafka-controller-0   1/1     Running   0          64s
kafka-broker-0       1/1     Running   0          63s
kafka-broker-1       1/1     Running   0          62s
kafka-broker-2       1/1     Running   0          61s