When does class start/end?
Classes begin promptly at 9:00 am, and typically end at 5:00 pm.
Apache Spark Programming with Databricks
This course uses a case study driven approach to explore the fundamentals of Spark Programming with Databricks, including Spark architecture, the DataFrame API, Structured Streaming, and query...
Read More
$1,500 USD
GSA
$1,360.20
Course Code
ASPWD
Duration
2 days
Available Formats
Classroom, Virtual
“Instructor was great, he was to the point. He did great job explaining the concepts and providing the content.”
This course uses a case study driven approach to explore the fundamentals of Spark Programming with Databricks, including Spark architecture, the DataFrame API, Structured Streaming, and query optimization. You will start by visualizing and applying Spark architecture concepts in example scenarios. Then, you will explore and preprocess datasets by applying a variety of DataFrame transformations and actions. After ingesting data from various file formats, you will apply these preprocessing steps and write them to Delta tables. The case study then expands to stream from Delta in an analytics use case that demonstrates core Structured Streaming concepts. Lastly, you will explore the Spark UI and how query optimization, partitioning, and caching affect performance.
Skills Gained
- Define the major components of Spark architecture and execution hierarchy
- Describe how DataFrames are built, transformed, and evaluated in Spark
- Apply the DataFrame API to explore, preprocess, join, and ingest data in Spark
- Apply the Structured Streaming API to perform analytics on streaming data
- Navigate the Spark UI and describe how the catalyst optimizer, partitioning, and caching affect Spark's execution performance
Who Can Benefit
- SQL analyst
- Data engineer
- Data scientist
- Machine learning engineer
- Data architect
Prerequisites
- Familiarity with basic SQL concepts (select, filter, groupby, join, etc)
- Beginner programming experience with Python or Scala (syntax, conditions, loops, functions)
Contact Us
1-800-803-3948
Modal Title
CloseSubscriber Dialog
CloseSummer Savings
Save up to $250-$2500 Use Promo Code: SurfBoard
View Details Register by September 6, 2019
