databricks blk

Apache Spark Programming with Databricks

This course uses a case study driven approach to explore the fundamentals of Spark Programming with Databricks, including Spark architecture, the DataFrame API, Structured Streaming, and query...

Read More
$1,500 USD GSA  $1,360.20
Course Code ASPWD
Duration 2 days
Available Formats Classroom, Virtual
210 Reviews star_rate star_rate star_rate star_rate star_half

“Joel was awesome ,knows his stuff well and explains nicely and just amazing !! the course materials were awesome !! Very nicely designed class !! Very very satisfied .. Keep up the good work !!”

Course Image

This course uses a case study driven approach to explore the fundamentals of Spark Programming with Databricks, including Spark architecture, the DataFrame API, Structured Streaming, and query optimization. You will start by visualizing and applying Spark architecture concepts in example scenarios. Then, you will explore and preprocess datasets by applying a variety of DataFrame transformations and actions. After ingesting data from various file formats, you will apply these preprocessing steps and write them to Delta tables. The case study then expands to stream from Delta in an analytics use case that demonstrates core Structured Streaming concepts. Lastly, you will explore the Spark UI and how query optimization, partitioning, and caching affect performance.

Skills Gained

  • Define the major components of Spark architecture and execution hierarchy
  • Describe how DataFrames are built, transformed, and evaluated in Spark
  • Apply the DataFrame API to explore, preprocess, join, and ingest data in Spark
  • Apply the Structured Streaming API to perform analytics on streaming data
  • Navigate the Spark UI and describe how the catalyst optimizer, partitioning, and caching affect Spark's execution performance

Who Can Benefit

  • SQL analyst
  • Data engineer
  • Data scientist
  • Machine learning engineer
  • Data architect

Prerequisites

  • Familiarity with basic SQL concepts (select, filter, groupby, join, etc)
  • Beginner programming experience with Python or Scala (syntax, conditions, loops, functions)
Contact Us 1-800-803-3948
Contact Us
FAQ Get immediate answers to our most frequently asked qestions. View FAQs arrow_forward