Automated deploy for a Kafka cluster on AWS. Can be used with Storm or standalone.
The deploy provisions and configures both Zookeeper and Kafka.
Install leiningen.
Set up your ~/.pallet/config.clj as described here
Start a cluster:
lein deps
lein run :deploy --start --name mykafkacluster --kn 8 --zn 2
This creates a cluster called "mykafkacluster" with 8 kafka nodes and 2 zookeeper nodes.
Stop a cluster:
lein run :deploy --stop --name mykafkacluster