Developer Training for Spark & Hadoop

Course Details
Code:
DEV-S-H
Tuition (USD):
$3,195.00 • Classroom (4 days)
$3,195.00 • Virtual (4 days)
GSA (USD):
$2,736.27 • Classroom (4 days)
$2,736.27 • Virtual (4 days)
This course is available in other formats
Self-Paced
Cloudera Developer Training for Spark and Hadoop (SPARK-HADOOP-OD)

This four-day hands-on training course delivers the key concepts and expertise participants need to ingest and process data on a Hadoop cluster using the most up-to-date tools and techniques. Employing Hadoop ecosystem projects such as Spark (including Spark Streaming and Spark SQL), Flume, Kafka, and Sqoop, this training course is the best preparation for the real-world challenges faced by Hadoop developers.

Skills Gained

Through expert-led discussion and interactive, hands-on exercises, participants will learn how to:

  • Distribute, store, and process data in a Hadoop cluster
  • Write, configure, and deploy Apache Spark applications on a Hadoop cluster
  • Use the Spark shell for interactive data analysis
  • Process and query structured data using Spark SQL
  • Use Spark Streaming to process a live data stream
  • Use Flume and Kafka to ingest data for Spark Streaming

Prerequisites

This course is designed for developers and engineers who have programming experience, but prior knowledge of Hadoop is not required.

  • Apache Spark examples and hands-on exercises are presented in Scala and Python. The ability to program in one of those languages is required
  • Basic familiarity with the Linux command line is assumed
  • Basic knowledge of SQL is helpful

Course Details

Course Topics

  • Introduction
  • Introduction to Apache Hadoop and the Hadoop Ecosystem
  • Apache Hadoop File Storage
  • Large-Scale Systems
  • Data Processing on an Apache Hadoop Cluster
  • Importing Relational Data with Apache Sqoop
  • Apache Spark Basics
  • Working with RDDs
  • Aggregating Data with Pair RDDs
  • Writing and Running Apache Spark Applications
  • Configuring Apache Spark Applications
  • Parallel Processing in Apache Spark
  • RDD Persistence
  • Common Patterns in Apache Spark Data Processing
  • DataFrames and Spark SQL
  • Course details: Message Processing with Apache Kafka
  • Capturing Data with Apache Flume
  • Integrating Apache Flume and Apache Kafka
  • Apache Spark Streaming: Introduction to DStreams
  • Apache Spark Streaming: Processing Multiple Batches
  • Apache Spark Streaming: Data Sources
  • Conclusion
Course Details
Code:
DEV-S-H
Tuition (USD):
$3,195.00 • Classroom (4 days)
$3,195.00 • Virtual (4 days)
GSA (USD):
$2,736.27 • Classroom (4 days)
$2,736.27 • Virtual (4 days)