Create a N-nodes Hadoop cluster using docker container
docker v17.09 or above
docker network create --driver=bridge hadoop
./init-cluster -n 5
./init-cluster -n NODES_NUMBER [-h HADOOP_VERSION] [-s SPARK_VERSION] [-c COMPILE_HADOOP]
- NODES_NUMBER: mandatory
- HADOOP_VERSION: default to
2.8.2 - SPARK_VERSION: default to
2.2.0 - COMPILE_HADOOP: default to
false
./exec-task <hadoop | spark>
Based on kiwenlau