Hadoop Administration

What is Hadoop Administration?

Hdfs  administration and MapReduce administration, both concepts come under Hadoop administration.

  • Hdfs administration: It includes monitoring the HDFS file structure, location and  updated files.
  • MapReduce administration: it includes monitoring the list of applications, configuration of nodes, application status.

Here is a Mapreduce Tutorial Video by Intellipaat

Video Thumbnail

HDFS administration: We are using put and get  commands for storing and fetching the data.

We can see the below screenshot using the url to the browser <http://localhost:50070> after passing the command “start-all.sh” on “/$HADOOP_HOME/sbin”.

pic2

We can see the files in the “/user/hadoop” directory in this screen shot.
pic2
Datanode information in a cluster
pic2

Certification in Bigdata Analytics

Mapreduce  job monitoring:

The most two important things in this concept are

  • Suitable datanode configuration in application
  • For each application, number of datanodes and resources

We can see the below screen shot using the url to the browser http://localhost:8080/ after passing the command “start-all.sh” on “/$HADOOP_HOME/sbin”.

pic2

We can see the current running node information in the below screenshot.
pic2
 

Related Blogs What’s Inside
MongoDB CRUD Operations Outlines MongoDB CRUD operations for data manipulation in NoSQL systems.
Overview of Apache Hadoop Introduces Apache Hadoop for distributed storage and big data processing.
Scala Installation Explains Scala installation for developing big data and functional applications.
Kafka Configuration Details Apache Kafka configuration for robust real-time streaming solutions.
Cassandra vs DynamoDB Compares Cassandra and DynamoDB for performance in NoSQL database systems.
Scala Collections Details Scala collections for efficient data handling in programming tasks.
Splunk Installation Explains Splunk installation for log analytics and data monitoring tasks.

About the Author

Technical Research Analyst - Big Data Engineering

Abhijit is a Technical Research Analyst specialising in Big Data and Azure Data Engineering. He has 4+ years of experience in the Big data domain and provides consultancy services to several Fortune 500 companies. His expertise includes breaking down highly technical concepts into easy-to-understand content.