hadoop-2.10.0-docker

Ubuntu-xenial base with hadoop-2.10.0, ssh, jdk8, ping, vim packages.

Configuration

These are sloppy commands. Check the DevOps folder in OneDrive for detailed guidance.

1. Update the core-site.xml & yarn-site.xml configuration files with the IP of the Master node.
2. Update the slaves file configuration with the IP of the slave.
3. Create Namenode (only in master) and Datanode directory.
4. chmod 755 /FakePath/Datanode
5. hdfs namenode -format and look for succesful format.
6. Generate the ssh keys for master and worker nodes.
7. Copy the keys of master and workers in ~/.ssh/authorized_keys for all of machines (All keys in all systems)