Hadoop for Systems Administrators Classroom Live Salt Lake City, UT September 23, 2019

Course Overview

• HADOOP OVERVIEW
  1. Data Analysis
  2. Big Data
  3. Origins of Hadoop
  4. Hadoop Marketplace
  5. Hadoop Core
  6. Hadoop Ecosystem:
  7. Hadoop Ecosystem (cont):
  8. Hadoop Ecosystem (cont):
  9. Hadoop Ecosystem (cont):
  10. Hadoop Ecosystem (cont):
  11. Cluster Architecture
  12. Hardware/Software Requirements
  13. Running Commands on Multiple Systems
  LAB TASKS
  1. Running Commands on Multiple Hosts
  2. Preparing to Install Hadoop
• HDFS
  1. Design Goals
  2. Design
  3. Blocks
  4. Block Replication
  5. Namenode Daemon
  6. Secondary Namenode Daemon
  7. Datanode Daemon
  8. Accessing HDFS
  9. Permissions and Users
  10. Adding and Removing Datanodes
  11. Balancing
  LAB TASKS
  1. Single Node HDFS
  2. Multi-node HDFS
  3. Files and HDFS
  4. Managing and Maintaining HDFS
• YARN
  1. YARN Design Goals
  2. YARN Architecture
  3. Resource Manager
  4. Node Manager
  5. Containers
  6. YARN: Other Important Features
  7. Slider
  LAB TASKS
  1. YARN
• MAPREDUCE
  1. MapReduce
  2. Terminology and Data Flow
  LAB TASKS
  1. Mapreduce
• INSTALLING HADOOP WITH AMBARI LAB TASKS
  1. CDH Uninstall
  2. Installing Hadoop with Ambari
  3. Tez
• DATA INGESTION
  1. Sqoop
  2. Flume
  3. Kafka
  LAB TASKS
  1. Sqoop
• DATA LINEAGE AND GOVERNANCE
  1. Falcon
  2. Atlas
  3. Oozie
• DATA PROCESSING FRAMEWORKS
  1. The Bane of MapReduce
  2. Tez overview
  3. Pig
  4. Hive
  5. Spark
  6. Storm
  7. Solr
  8. Solr (cont)
  LAB TASKS
  1. Pig
• NOSQL IMPLEMENTATIONS
  1. HBase
  2. Phoenix
  3.  
• CLUSTER MANAGEMENT
  1. Ambari Metrics System (AMS)
  2. Zookeeper

Prerequisites

Qualified participants should be comfortable with the Linux commands and have some systems administration experience, but do not need previous Hadoop experience