When does class start/end?
Classes begin promptly at 9:00 am, and typically end at 5:00 pm.
This course uses a case study driven approach to explore the fundamentals of Spark Programming with Databricks, including Spark architecture, the DataFrame API, Structured Streaming, and query optimization. You will start by visualizing and applying Spark architecture concepts in example scenarios. Then, you will explore and preprocess datasets by applying a variety of DataFrame transformations and actions. After ingesting data from various file formats, you will apply these preprocessing steps and write them to Delta tables. The case study then expands to stream from Delta in an analytics use case that demonstrates core Structured Streaming concepts. Lastly, you will explore the Spark UI and how query optimization, partitioning, and caching affect performance.
Skills Gained
- Define the major components of Spark architecture and execution hierarchy
- Describe how DataFrames are built, transformed, and evaluated in Spark
- Apply the DataFrame API to explore, preprocess, join, and ingest data in Spark
- Apply the Structured Streaming API to perform analytics on streaming data
- Navigate the Spark UI and describe how the catalyst optimizer, partitioning, and caching affect Spark's execution performance
Who Can Benefit
- SQL analyst
- Data engineer
- Data scientist
- Machine learning engineer
- Data architect
Prerequisites
- Familiarity with basic SQL concepts (select, filter, groupby, join, etc)
- Beginner programming experience with Python or Scala (syntax, conditions, loops, functions)
Does the course schedule include a Lunchbreak?
Lunch is normally an hour long and begins at noon. Coffee, tea, hot chocolate and juice are available all day in the kitchen. Fruit, muffins and bagels are served each morning. There are numerous restaurants near each of our centers, and some popular ones are indicated on the Area Map in the Student Welcome Handbooks - these can be picked up in the lobby or requested from one of our ExitCertified staff.
How can someone reach me during class?
If someone should need to contact you while you are in class, please have them call the center telephone number and leave a message with the receptionist.
What languages are used to deliver training?
Most courses are conducted in English, unless otherwise specified. Some courses will have the word "FRENCH" marked in red beside the scheduled date(s) indicating the language of instruction.
What does GTR stand for?
GTR stands for Guaranteed to Run; if you see a course with this status, it means this event is confirmed to run. View our GTR page to see our full list of Guaranteed to Run courses.
How do I find an ExitCertified training location?
We have training locations across the United States and Canada. View a full list of classroom training locations.
Which delivery formats are available?
At ExitCertified we offer training that is Instructor-Led, Online, Virtual and Self-Paced.
Does ExitCertified deliver group training?
Yes, we provide training for groups, individuals and private on sites. View our group training page for more information.
Does ExitCertified deliver group training?
Yes, we provide training for groups, individuals, and private on sites. View our group training page for more information.
well organized and designed course. Tommy is good teacher and answer our all the questions
It should include certification practice questions in relation to the topic discussed.
Excellent facilities, excellent staff.. and the coffee is good too! Thanks for helping to advance my career and the career of my colleagues!
Delivered the expected level of training in an easier to understand way than expected.
Classromm confortable and enviroment. Instructir knowlegeable of course matarial but need to align to students working in the Canadian Federal Govt. ve US Federal govt.
9 options available
-
Mar 18, 2021 – Mar 19, 2021 (2 days) GTR
-
Apr 1, 2021 – Apr 2, 2021 (2 days)
-
Apr 18, 2021 – Apr 20, 2021 (3 days)
-
Apr 22, 2021 – Apr 23, 2021 (2 days)
-
May 13, 2021 – May 14, 2021 (2 days)
-
Jun 7, 2021 – Jun 8, 2021 (2 days)
-
Jun 28, 2021 – Jun 29, 2021 (2 days)
-
Jul 22, 2021 – Jul 23, 2021 (2 days)
-
Jul 26, 2021 – Jul 28, 2021 (3 days)
Contact Us
1-800-803-3948