Hadoop on Windows with Eclipse

1. Introduction
2. Prerequistes
3. Set Environment Variables
4. Setup SSH daemon
5. Download hadoop and place it in the home directory.
6. Unpack hadoop
7. Configure Hadoop
8. Format the namenode
9. Setup hadoop plugin
10. Start the cluster
11. Setup hadoop location
12. Upload data
13. Create and run a test project.

Start the local hadoop cluster

Next step is to launch the newly configured cluster.

 

1. Close all the windows on the desktop, open five Cygwin windows and arrange them as shown below.

   

2. Start the namenode in the first window by executing:
   cd hadoop-0.19.1
   bin/hadoop namenode
3. Start the secondary namenode in the second window by executing:
   cd hadoop-0.19.1
   bin/hadoop secondarynamenode
4. Start the job tracker the third window by executing:
   cd hadoop-0.19.1
   bin/haoop jobtracker
5. Start the data node the fourth window by executing:
   cd hadoop-0.19.1
   bin/haoop datanode
6. Start the task tracker the fifth window by executing:
   cd hadoop-0.19.1
   bin/haoop tasktracker
7. Now you should have an operational hadoop cluster. If everthing went fine your screen should look like the image below:
   
   
   

At this point the cluster is running and you can proceed to the next step.

Continue