Run Kafka Cluster

• From the root directory

$ cd docker-compose
$ docker compose -f common.yml -f kafka_cluster.yml up
$ docker compose -f common.yml -f elastic_cluster.yml up

• Inspect running containers

$ docker ps

• To run services in docker

$ cd docker-compose
$ docker compose -f common.yml -f services.yml up
$ docker compose -f common.yml -f kafka_cluster.yml -f services.yml up

• Monitor Kafka cluster and topics

$ docker run -it --network=host confluentinc/cp-kafkacat kafkacat -L -b localhost:19092

• View the messages as received by kafka consumer

$ kafkacat -C -b localhost:19092 -t twitter-topic

Run below command to make it an executable file

$ chmod +x check-config-server-started.sh