What is Hadoop Administration?
Hdfs administration and MapReduce administration, both concepts come under Hadoop administration.
- Hdfs administration: It includes monitoring the HDFS file structure, location and updated files.
- MapReduce administration: it includes monitoring the list of applications, configuration of nodes, application status.
Here is a Mapreduce Tutorial Video by Intellipaat
HDFS administration: We are using put and get commands for storing and fetching the data.
We can see the below screenshot using the url to the browser <http://localhost:50070> after passing the command “start-all.sh” on “/$HADOOP_HOME/sbin”.
We can see the files in the “/user/hadoop” directory in this screen shot.
Datanode information in a cluster
Mapreduce job monitoring:
The most two important things in this concept are
- Suitable datanode configuration in application
- For each application, number of datanodes and resources
We can see the below screen shot using the url to the browser http://localhost:8080/ after passing the command “start-all.sh” on “/$HADOOP_HOME/sbin”.
We can see the current running node information in the below screenshot.
