This course will enable an Analyst to work on Big Data and Hadoop which takes into consideration the burgeoning demands of the industry to process and analyze data at high speeds. This Training Course will give you the right skills to deploy various tools and techniques to be a Hadoop Analyst working with Big Data.
Big Data, Factors constituting Big Data., Hadoop and Hadoop Ecosystem, MapReduce -Concepts of Map, Reduce, Ordering, Concurrency, Shuffle, Reducing, Concurrency., Hadoop Distributed File System (HDFS) Concepts and its Importance, Deep Dive into MapReduce – Execution Framework, Partioner, Combiner, Data Types, Key pairs., HDFS Deep Dive – Architecture, Data Replication, Name Node, Data Node, Data Flow., Parallel Copying with DISTCP, Hadoop Archives.
Installing Hadoop in Pseudo Distributed Mode, Understanding Important configuration files, their Properties and Demon Threads., Accessing HDFS from Command Line, MapReduce – Basic Exercises, Understanding Hadoop Eco-system
1.Introduction to Sqoop, use cases and Installation
2.Introduction to Hive, use cases and Installation
3.Introduction to Pig, use cases and Installation
4.Introduction to Oozie, use cases and Installation
5.Introduction to Flume, use cases and Installation
6.Introduction to Yarn
Assignment – 1
Mini Project – Importing Mysql Data using Sqoop and Querying it using Hive
How to develop MapReduce Application, writing unit test., Best Practices for developing and writing, Debugging MapReduce applications, Joining Data sets in MapReduce
Introduction to Hive
What Is Hive?, Hive Schema and Data Storage, Comparing Hive to Traditional Databases, Hive vs. Pig, Hive Use Cases, Interacting with Hive
Relational Data Analysis with Hive
Hive Databases and Tables, Basic HiveQL Syntax, Data Types, Joining Data Sets, Common Built-in Functions, Hands-On Exercise: Running Hive Queries on the Shell, Scripts, and Hue
Hive Data Management
Hive Data Formats, Creating Databases and Hive-Managed Tables, Loading Data into Hive, Altering Databases and Tables, Self-Managed Tables, Simplifying Queries with Views, Storing Query Results, Controlling Access to Data, Hands-On Exercise: Data Management with Hive
Understanding Query Performance, Partitioning, Bucketing, Indexing Data
Hands on Exercises – Playing with huge data and Querying extensively.
User defined Functions, Optimizing Queries, Tips and Tricks for performance tuning
Introduction to Pig
What Is Pig?, Pig’s Features, Pig Use Cases, Interacting with Pig
Basic Data Analysis with Pig
Pig Latin Syntax, Loading Data, Simple Data Types, Field Definitions, Data Output, Viewing the Schema, Filtering and Sorting Data, Commonly-Used Functions, Hands-On Exercise: Using Pig for ETL Processing
Processing Complex Data with Pig
Complex/Nested Data Types, Grouping, Iterating Grouped Data, Hands-On Exercise: Analyzing Data with Pig
Multi-Dataset Operations with Pig
Techniques for Combining Data Sets, Joining Data Sets in Pig, Set Operations, Splitting Data Sets, Hands-On Exercise
Macros and Imports, UDFs, Using Other Languages to Process Data with Pig, Hands-On Exercise: Extending Pig with Streaming and UDFs
Introduction to Impala
What is Impala?, How Impala Differs from Hive and Pig, How Impala Differs from Relational Databases, Limitations and Future Directions, Using the Impala Shell
Choosing the Best (Hive, Pig, Impala)
Putting it all together and Connecting Dots, Working with Large data sets, Steps involved in analyzing large data
How ETL tools work in Big data Industry, Connecting to HDFS from ETL tool and moving data from Local system to HDFS, Moving Data from DBMS to HDFS, Working with Hive with ETL Tool, Creating MapReduce job in ETL tool, End to End ETL PoC showing Hadoop integration with ETL tool.
Major Project, Hadoop Development, cloudera Certification Tips and Guidance and Mock Interview Preparation, Practical Development Tips and Techniques, certification preparation
Assignment – 3
Project 1 – Working with MapReduce, Hive, Sqoop
Problem Statement – It describes that how to import mysql data using sqoop and querying it using hive and also describes that how to run the word count mapreduce job.
Project 2 – Connecting Pentaho with Hadoop Eco-system
Problem Statement – It includes:
Topics: Quick Overview of ETL and BI, Configuring Pentaho to work with Hadoop Distribution, Loading data into Hadoop cluster, Transforming data into Hadoop cluster, Extracting data from Hadoop Cluster
Hadoop is a leader in Hadoop online training. This Hadoop analyst training will help you be fully proficient in becoming a master data analyst in order to collect, analyze and transform huge volumes of data on the Hadoop cluster setup by deploying powerful tools like SQL and other scripting languages. Upon successful completion of the training you will be awarded the Intellipaat Hadoop Analyst certification.
Intellipaat offers lifetime access to videos, course materials, 24/7 Support, and course material upgrades to latest version at no extra fees. For Hadoop and Spark training you get the Intellipaat Proprietary Virtual Machine for Lifetime and free cloud access for 6 months for performing training exercises. Hence it is clearly a one-time investment. We are also exclusively partnered with IBM for providing you IBM Certified Hadoop Professional training as well.
Intellipaat basically offers the self-paced training and online instructor-led training. Apart from that we also provide corporate training for enterprises. All our trainers come with over 12 years of industry experience in relevant technologies and also they are subject matter experts working as consultants. You can check about the quality of our trainers in the sample videos provided.
If you have any queries you can contact our 24/7 dedicated support to raise a ticket. We provide you email support and solution to your queries. If the query is not resolved by email we can arrange for a one-on-one session with our trainers. The best part is that you can contact Intellipaat even after completion of training to get support and assistance. There is also no limit on the number of queries you can raise when it comes to doubt clearance and query resolution.
Yes, you can learn Hadoop without being from a software background. We provide complimentary courses in Java and Linux so that you can brush up on your programming skills. This will help you in learning Hadoop technologies better and faster.
The Intellipaat self-paced training is for people who want to learn at their own leisurely pace. As part of this program we provide you with one-on-one sessions, doubt clearance over email, 24/7 Live Support, 1yr of cloud access and lifetime LMS and upgrade to the latest version at no extra cost. The prices of self-paced training can be 75% lesser than online training. While studying should you face any unexpected challenges then we shall arrange a Virtual LIVE session with the trainer.
We provide you with the opportunity to work on real world projects wherein you can apply your knowledge and skills that you acquired through our training. We have multiple projects that thoroughly test your skills and knowledge of various Hadoop components making you perfectly industry-ready. These projects could be in exciting and challenging fields like banking, insurance, retail, social networking, high technology and so on. The Intellipaat projects are equivalent to six months of relevant experience in the corporate world.
Yes, Intellipaat does provide you with placement assistance. We have tie-ups with 80+ organizations including Ericsson, Cisco, Cognizant, TCS, among others that are looking for Hadoop professionals and we would be happy to assist you with the process of preparing yourself for the interview and the job.
Yes, if you would want to upgrade from the self-paced training to instructor-led training then you can easily do so by paying the difference of the fees amount and joining the next batch of classes which shall be separately notified to you.
Upon successful completion of training you have to take a set of quizzes, complete the projects and upon review and on scoring over 60% marks in the qualifying quiz the official Intellipaat verified certificate is awarded.The Intellipaat Certification is a seal of approval and is highly recognized in 80+ corporations around the world including many in the Fortune 500 list of companies.
This course is designed for clearing the Intellipaat Hadoop Analyst exam.
As part of this training you will be working on real time projects and assignments that have immense implications in the real world industry scenario thus helping you fast track your career effortlessly.
At the end of this training program there will be a quiz that perfectly reflects the type of questions asked in the certification exam and helps you score better marks.
The certification will be awarded on the completion of assignments and Project work (upon expert review) and on scoring of at least 60% marks in the quiz. Intellipaat certification is well recognized in top 80+ MNCs like Ericsson, Cisco, Cognizant, Sony, Mu Sigma, Saint-Gobain, Standard Chartered, TCS, Genpact, Hexaware, etc.
"PMI®", "PMP®" and "PMI-ACP®" are registered marks of the Project Management Institute, Inc.
The Open Group®, TOGAF® are trademarks of The Open Group.
The Swirl logoTM is a trade mark of AXELOS Limited.
ITIL® is a registered trade mark of AXELOS Limited.
PRINCE2® is a Registered Trade Mark of AXELOS Limited.
Certified ScrumMaster® (CSM) and Certified Scrum Trainer® (CST) are registered trademarks of SCRUM ALLIANCE®
Professional Scrum Master is a registered trademark of Scrum.org