My bash scripts to clear Storm and Zookeeper cluster remotely by ssh.
Connect to every zookeeper server by ssh and stop zookeeper, then delete data folder. Then connect to every Storm node by ssh, kill Storm processes and delete data folder. Connect to zookeeper servers again, start them. Connect to Storm nodes again, start them. Continue reading
Symptoms: when trying to run a Storm supervisor node it is not listed in cluster. We can see the following error in log:
Error when processing event java.lang.RuntimeException: java.io.EOFException at backtype.storm.utils.Utils.deserialize(Utils.java:69) ~[storm-core-0.9.0.1.jar:na]
Solution worked for me: Stop zookeeper and supervisor, clean data dirs. This will probably not suite the production because of data lost.
How to automate Apache Storm cluster creation on Amazon EC2.
Install Leiningen 2 (a tool to handle Clojure projects):
$ wget https://raw.github.com/technomancy/leiningen/stable/bin/lein
$ mv lein /usr/local/bin/
$ chmod +x /usr/local/bin/lein
$ lein
