When does class start/end?
Classes begin promptly at 9:00 am, and typically end at 5:00 pm.
This course uses a case study driven approach to explore the fundamentals of Spark Programming with Databricks, including Spark architecture, the DataFrame API, Structured Streaming, and query optimization. You will start by visualizing and applying Spark architecture concepts in example scenarios. Then, you will explore and preprocess datasets by applying a variety of DataFrame transformations and actions. After ingesting data from various file formats, you will apply these preprocessing steps and write them to Delta tables. The case study then expands to stream from Delta in an analytics use case that demonstrates core Structured Streaming concepts. Lastly, you will explore the Spark UI and how query optimization, partitioning, and caching affect performance.
Skills Gained
- Define the major components of Spark architecture and execution hierarchy
- Describe how DataFrames are built, transformed, and evaluated in Spark
- Apply the DataFrame API to explore, preprocess, join, and ingest data in Spark
- Apply the Structured Streaming API to perform analytics on streaming data
- Navigate the Spark UI and describe how the catalyst optimizer, partitioning, and caching affect Spark's execution performance
Who Can Benefit
- SQL analyst
- Data engineer
- Data scientist
- Machine learning engineer
- Data architect
Prerequisites
- Familiarity with basic SQL concepts (select, filter, groupby, join, etc)
- Beginner programming experience with Python or Scala (syntax, conditions, loops, functions)
Does the course schedule include a Lunchbreak?
Lunch is normally an hour long and begins at noon. Coffee, tea, hot chocolate and juice are available all day in the kitchen. Fruit, muffins and bagels are served each morning. There are numerous restaurants near each of our centers, and some popular ones are indicated on the Area Map in the Student Welcome Handbooks - these can be picked up in the lobby or requested from one of our ExitCertified staff.
How can someone reach me during class?
If someone should need to contact you while you are in class, please have them call the center telephone number and leave a message with the receptionist.
What languages are used to deliver training?
Most courses are conducted in English, unless otherwise specified. Some courses will have the word "FRENCH" marked in red beside the scheduled date(s) indicating the language of instruction.
What does GTR stand for?
GTR stands for Guaranteed to Run; if you see a course with this status, it means this event is confirmed to run. View our GTR page to see our full list of Guaranteed to Run courses.
How do I find an ExitCertified training location?
We have training locations across the United States and Canada. View a full list of classroom training locations.
Which delivery formats are available?
At ExitCertified we offer training that is Instructor-Led, Online, Virtual and Self-Paced.
Does ExitCertified deliver group training?
Yes, we provide training for groups, individuals and private on sites. View our group training page for more information.
Does ExitCertified deliver group training?
Yes, we provide training for groups, individuals, and private on sites. View our group training page for more information.
Some Labs are very good but some steps it ask to update but its already updated, but overall its very good training.
Fantastic and great training. Tons of hands-on labs to really make you understand the material being thought.
This was a good program to get prepared for the solutions architect associate exam.
Although there seemed to be too many links for the course, everything worked smoothly.
ExitCertified was a great. They gave me all the materials and information I needed ahead of time to prepare for the course.
9 options available
-
Aug 15, 2021 – Aug 17, 2021 (3 days) GTRSAVE on this course - Promo Code: SUMMER500
-
Aug 23, 2021 – Aug 24, 2021 (2 days) GTRSAVE on this course - Promo Code: SUMMER500
-
Sep 20, 2021 – Sep 21, 2021 (2 days)SAVE on this course - Promo Code: SUMMER500
-
Oct 7, 2021 – Oct 8, 2021 (2 days)
-
Oct 25, 2021 – Oct 26, 2021 (2 days) GTR
-
Nov 15, 2021 – Nov 16, 2021 (2 days)
-
Nov 29, 2021 – Nov 30, 2021 (2 days)
-
Dec 6, 2021 – Dec 7, 2021 (2 days)
-
Dec 27, 2021 – Dec 28, 2021 (2 days)
Contact Us
1-800-803-3948