Looking for a Tutor Near You?

Post Learning Requirement »
x

Choose Country Code

x

Direction

x

Ask a Question

x

x
x
For better view click here
x
Hire a Tutor
DISCOVER

Notes Bigdata: Hadoop. Spark, Scala

Loading...

Published in: Big Data & Hadoop
479 Views

• I am a seasoned Hadoop trainer I have been teaching Hadoop since 3 years, have trained many individuals and made them capable to excel in big data world. • Extensive hands on experience with working level knowledge on Big data and NoSQL (Not Only SQL) technologies including: Hadoop’s, PIG, Hive, HBase, SQOOP, Flume, Oozie, YARN, Map Reduce using Java, HDFS, Master-Slave architectural model, Clustering, managing, and monitoring Hadoop clusters using Ambari.

Tarang G / Pune

5 years of teaching experience

Qualification: MCA (Pune University - 2005)

Teaches: Big Data & Hadoop, Data Science

Contact this Tutor
  1. HADOOP using Cloud era Developer Course by Tarang G. Introduction about Faculty 15+ years of professional experience in software design and development. Worked on multiple projects in fast paced, dynamic, and highly demanding environment with diversified technologies like AS/400, Mainframes and Hadoop (5+) Extensive hands on experience with working level knowledge on Big data and NoSQL (Not Only SQL) technologies including: Hadoop's, PIG, Hive, HBase, SQOOP, Flume, Oozie, YARN, Map Reduce using Java, HDFS, Master-Slave architectural model, Clustering, managing, and monitoring Hadoop clusters using Ambari. Hands-on experience with industry-standard IDES like Eclipse. Master in various phases of software development including system analysis, design, development, testing, & support applications using different areas of scrum and agile processes. Full System Development Life Cycle (SDLC) experience including: gathering requirements, analysis of requirements, design, development, documentation, deployment and testing. Strong in Object Oriented Analysis and Design techniques. I am a seasoned Hadoop trainer I have been teaching Hadoop since 3 years, have trained many individuals and made them capable to excel in big data world. Introduction to BigData, Hadoop:- Big Data Introduction Hadoop Introduction What is Hadoop? Why Hadoop? Hadoop History? Different types of Components in Hadoop? HDFS, MapReduce, PIG, Hive, SQOOP, HBASE, OOZIE, Flume, Zookeeper and so on... What is the scope of Hadoop? Deep Drive in HDFS (for Storing the Data):- Introduction of HDFS VMware Player Introduction, VMware Player Hardware Requirements HDFS Design HDFS role in Hadoop Features of HDFS Daemons of Hadoop and its functionality o o o o o Name Node Secondary Name Node Job Tracker Data Node Task Tracker Anatomy of File Wright Anatomy of File Read
  2. Network Topology o Nodes o Racks o Data Center Basic Configuration for HDFS Data Organization o Blocks and o Replication Rack Awareness Heartbeat Signal How to Store the Data into HDFS How to Read the Data from HDFS Accessing HDFS (Introduction of Basic Linux commands) MapReduce using Java (Processing the Data):- Introduction of MapReduce. MapReduce Architecture Data flow in MapReduce o o o o o o Splits Mapper Portioning Sort and shuffle Combiner Reducer YARN:- Understand Difference Between Block and InputSplit Role of Record Reader Basic Configuration of MapReduce MapReduce life cycle o Driver Code o Mapper o and Reducer How MapReduce Works Writing and Executing the Basic MapReduce Program using Java Submission & Initialization of MapReduce Job. File Input/output Formats in MapReduce Jobs o Text Input Format o Key Value Input Format Word Count Example Partition MapReduce Program YARN Infrastructure, Resource Manager, Resource Manager in HA Mode, Application Master, NodeManager Container, Role of AppMaster in Application.
  3. SQOOP:- Flume HIVE:- PIG:- Introduction to SQOOP Use of SQOOP Connect to mySql database SQOOP commands o Import o Export o Eval o Codegen and etc... Joins in SQOOP Export to MySQL Introduction to Flume Uses of Flume Flume Architecture o o o Flume Master Flume Collectors Flume Agents Introduction to HIVE HIVE Meta Store HIVE Architecture Tables in HIVE o Managed Tables o External Tables Hive Data Types o Primitive Types o Complex Types Partition Joins in HIVE HIVE UDF's and UADF's with Programs Word Count Example Introduction to Apache PIG Introduction to PIG Data Flow Engine MapReduce vs PIG in detail When should PIG used? Data Types in PIG Basic PIG programming Modes of Execution in PIG o Local Mode and o MapReduce Mode Operators/ Transformations in PIG PIG UDF's with Program Word Count Example in PIG The difference between the MapReduce and PIG
  4. HBASE:- Introduction to HBASE Basic Configurations of HBASE Fundamentals of HBase What is NoSQL? HBase Data Model o Table and Row o Column Family and Column Qualifier o Cell and its Versioning Categories of NoSQL Data Bases o Key-Value Database o Document Database o Column Family Database H BASE Architecture o o o o o H Master Region Servers Regions MemStore Store SQL vs NOSQL How HBASE is differ from RDBMS HDFS vs HBase Client side buffering or bulk uploads HBase Designing Tables HBase Operations o o o o Cluster Setup:-- Get Scan Put Delete Downloading and installing the CentOs Installing Java Installing Hadoop Creating Cluster Increasing Decreasing the Cluster size Monitoring the Cluster Health Starting and Stopping the Nodes
  5. Zookeeper OOZIE Introduction Zookeeper Data Modal Operations Introduction to OOZIE Use of OOZIE Where to use? Project Explanations with Architecture

Need a Tutor or Coaching Class?

Post an enquiry and get instant responses from qualified and experienced tutors.

Post Requirement

Related Study Notes

Upload Study Notes

If you have your own Study Notes which you think can benefit others, please upload on LearnPick. For each approved Study Note you will get 100 Credit Points and 100 Activity Score which will increase your profile visibility.

Upload Now
Home > Study Notes > Notes Bigdata: Hadoop. Spark, Scala