When does class start/end?
Classes begin promptly at 9:00 am, and typically end at 5:00 pm.
This course uses a case study driven approach to explore the fundamentals of Spark Programming with Databricks, including Spark architecture, the DataFrame API, Structured Streaming, and query optimization. You will start by visualizing and applying Spark architecture concepts in example scenarios. Then, you will explore and preprocess datasets by applying a variety of DataFrame transformations and actions. After ingesting data from various file formats, you will apply these preprocessing steps and write them to Delta tables. The case study then expands to stream from Delta in an analytics use case that demonstrates core Structured Streaming concepts. Lastly, you will explore the Spark UI and how query optimization, partitioning, and caching affect performance.
Skills Gained
- Define the major components of Spark architecture and execution hierarchy
- Describe how DataFrames are built, transformed, and evaluated in Spark
- Apply the DataFrame API to explore, preprocess, join, and ingest data in Spark
- Apply the Structured Streaming API to perform analytics on streaming data
- Navigate the Spark UI and describe how the catalyst optimizer, partitioning, and caching affect Spark's execution performance
Who Can Benefit
- SQL analyst
- Data engineer
- Data scientist
- Machine learning engineer
- Data architect
Prerequisites
- Familiarity with basic SQL concepts (select, filter, groupby, join, etc)
- Beginner programming experience with Python or Scala (syntax, conditions, loops, functions)
Does the course schedule include a Lunchbreak?
Lunch is normally an hour long and begins at noon. Coffee, tea, hot chocolate and juice are available all day in the kitchen. Fruit, muffins and bagels are served each morning. There are numerous restaurants near each of our centers, and some popular ones are indicated on the Area Map in the Student Welcome Handbooks - these can be picked up in the lobby or requested from one of our ExitCertified staff.
How can someone reach me during class?
If someone should need to contact you while you are in class, please have them call the center telephone number and leave a message with the receptionist.
What languages are used to deliver training?
Most courses are conducted in English, unless otherwise specified. Some courses will have the word "FRENCH" marked in red beside the scheduled date(s) indicating the language of instruction.
What does GTR stand for?
GTR stands for Guaranteed to Run; if you see a course with this status, it means this event is confirmed to run. View our GTR page to see our full list of Guaranteed to Run courses.
How do I find an ExitCertified training location?
We have training locations across the United States and Canada. View a full list of classroom training locations.
Which delivery formats are available?
At ExitCertified we offer training that is Instructor-Led, Online, Virtual and Self-Paced.
Does ExitCertified deliver group training?
Yes, we provide training for groups, individuals and private on sites. View our group training page for more information.
Does ExitCertified deliver group training?
Yes, we provide training for groups, individuals, and private on sites. View our group training page for more information.
Good Course. We covered a lot of material in a short amount of time. This course had useful labs that built upon each other.
The class provided by ExitCertified was well put together, with a great instructor and thorough course materials.
I attended AWS Big data analytics training through online and it is very well organized. overall good training
Should allow student to download the software of the e-Textbook though out agency can't give the permition to download file out of the firewall.
The course material and instructor were very good. easy to follow, lab was setup nicely and was able to complete most of the lab material.
The Koretex App is absolute garbage and very cumbersome to use on a tablet/ipad. A PDF file would be 100 times better than that atrocious app.
As a recommendation this class should be 5 days instead of 4 as some chapters had to be rushed.
16 options available
-
Jun 6, 2021 – Jun 8, 2021 (3 days)
- Location
-
Edison, NJ
- Language
- English
- Time
- 3:00PM – 12:00AM PDT
- Enroll
- Enroll
-
Jun 6, 2021 – Jun 8, 2021 (3 days)
-
Jun 7, 2021 – Jun 8, 2021 (2 days) GTR
-
Jun 28, 2021 – Jun 29, 2021 (2 days) GTR
-
Jul 22, 2021 – Jul 23, 2021 (2 days)
-
Jul 26, 2021 – Jul 28, 2021 (3 days)
-
Aug 9, 2021 – Aug 10, 2021 (2 days)
-
Aug 15, 2021 – Aug 17, 2021 (3 days)
-
Aug 23, 2021 – Aug 24, 2021 (2 days)
-
Sep 20, 2021 – Sep 21, 2021 (2 days)
-
Oct 7, 2021 – Oct 8, 2021 (2 days)
-
Oct 25, 2021 – Oct 26, 2021 (2 days)
-
Nov 15, 2021 – Nov 16, 2021 (2 days)
-
Nov 28, 2021 – Nov 30, 2021 (3 days)
-
Dec 6, 2021 – Dec 7, 2021 (2 days)
Contact Us
1-800-803-3948