• Articles
  • Tutorials
  • Interview Questions

Hadoop Administration

What is Hadoop Administration?

Hdfs  administration and MapReduce administration, both concepts come under Hadoop administration.

  • Hdfs administration: It includes monitoring the HDFS file structure, location and  updated files.
  • MapReduce administration: it includes monitoring the list of applications, configuration of nodes, application status.

Here is a Mapreduce Tutorial Video by Intellipaat

Video Thumbnail

HDFS administration: We are using put and get  commands for storing and fetching the data.

We can see the below screenshot using the url to the browser <http://localhost:50070> after passing the command “start-all.sh” on “/$HADOOP_HOME/sbin”.

pic2

We can see the files in the “/user/hadoop” directory in this screen shot.
pic2
Datanode information in a cluster
pic2

Certification in Bigdata Analytics

Mapreduce  job monitoring:

The most two important things in this concept are

  • Suitable datanode configuration in application
  • For each application, number of datanodes and resources

We can see the below screen shot using the url to the browser http://localhost:8080/ after passing the command “start-all.sh” on “/$HADOOP_HOME/sbin”.

pic2

We can see the current running node information in the below screenshot.
pic2

Course Schedule

Name Date Details
Big Data Course 23 Nov 2024(Sat-Sun) Weekend Batch View Details
30 Nov 2024(Sat-Sun) Weekend Batch
07 Dec 2024(Sat-Sun) Weekend Batch

About the Author

Technical Research Analyst - Big Data Engineering

Abhijit is a Technical Research Analyst specialising in Big Data and Azure Data Engineering. He has 4+ years of experience in the Big data domain and provides consultancy services to several Fortune 500 companies. His expertise includes breaking down highly technical concepts into easy-to-understand content.