Hadoop Administration

What is Hadoop Administration?

Hdfs  administration and MapReduce administration, both concepts come under Hadoop administration.

• Hdfs administration: It includes monitoring the HDFS file structure, location and  updated files.
• MapReduce administration: it includes monitoring the list of applications, configuration of nodes, application status.

Here is a Mapreduce Tutorial Video by Intellipaat

HDFS administration: We are using put and get  commands for storing and fetching the data.

We can see the below screenshot using the url to the browser <http://localhost:50070> after passing the command “start-all.sh” on “/$HADOOP_HOME/sbin”.

We can see the files in the “/user/hadoop” directory in this screen shot.

Datanode information in a cluster

Mapreduce  job monitoring:

The most two important things in this concept are

• Suitable datanode configuration in application
• For each application, number of datanodes and resources

We can see the below screen shot using the url to the browser http://localhost:8080/ after passing the command “start-all.sh” on “/$HADOOP_HOME/sbin”.

We can see the current running node information in the below screenshot.