The future of IBM Maximo: Work Centers and Inspections Can Transform Your Business

closeClose

ETL Part 2 - Transformations and Loads

  • Tuition USD $75
  • Reviews star_rate star_rate star_rate star_rate star_half 508 Ratings
  • Course Code ETL2-TRAN-SELF
  • Duration 0 hours
  • Available Formats Self Paced

In this course data engineers apply data transformation and writing best practices such as user-defined functions, join optimizations, and parallel database writes. By the end of this course, you will transform complex data with custom functions, load it into a target database, and navigate Databricks and Spark documents to source solutions.

Skills Gained

  • Apply built-in functions to manipulate data
  • Write UDFs with a single DataFrame column inputs
  • Apply UDFs with a multiple DataFrame column inputs and that return complex types
  • Employ table join best practices relavant to big data environments
  • Repartition DataFrames to optimize table inserts
  • Write to managed and unmanaged tables

Prerequisites

ETL Part 1 self-paced course.

Course Details

Course Outline

  • Course Overview and Setup
  • Common Transformations
  • User Defined Functions
  • Advanced UDFs
  • Joins and Lookup Tables
  • Database Writes
  • Table Management
  • Capstone Project: Custom Transformations, Aggregating and Loading

Platforms

Supported platforms include Azure Databricks, Databricks Community Edition, and non-Azure Databricks.

  • If you're planning to use the course on Azure Databricks, select the "Azure Databricks" Platform option.
  • If you're planning to use the course on Databricks Community Edition or on a non-Azure version of Databricks, select the "Other Databricks" Platform option.

Format

The course is a series of seven self-paced lessons available in both Scala and Python. A final capstone project involves writing custom, generalizable transformation logic to population data warehouse summary tables and efficiently writing the tables to a database. Each lesson includes hands-on exercises.

How do I enroll?

A comprehensive listing of ExitCertified courses can be found here. You can register directly for the required course/location when you select "register". If you have any questions or prefer to speak with an ExitCertified education consultant directly, please submit your query here. A representative will contact you shortly.

How do I pay for a class?

You can pay at the time of registration using credit card (Mastercard/Visa/American Express) cheque or PO.

What if I have training credits?

ExitCertified honors all savings programs from the partners we work with. ExitCertified also offers training credits across multiple partners through our FLEX Account.

When does class start/end?

Classes begin promptly at 9:00 am, and typically end at 5:00 pm.

Lunchtime?

Lunch is normally an hour long and begins at noon. Coffee, tea, hot chocolate and juice are available all day in the kitchen. Fruit, muffins and bagels are served each morning. There are numerous restaurants near each of our centers, and some popular ones are indicated on the Area Map in the Student Welcome Handbooks - these can be picked up in the lobby or requested from one of our ExitCertified staff.

How can someone reach me during class?

If someone should need to contact you while you are in class, please have them call the center telephone number and leave a message with the receptionist.

What languages are used to deliver training?

Most courses are conducted in English, unless otherwise specified. Some courses will have the word "FRENCH" marked in red beside the scheduled date(s) indicating the language of instruction.

Bill has been outstanding instructor. He has right balance of knowledge and skills to navigate this entire process in a timely manner. Thanks a lot Bill.

I just finished the 3 days training on AWS Solution Architect course instructed by Seid. He is very knowledgeable. He engaged the students and he is very friendly. The labs were well planned. I strongly suggest people to take the course.

Course Material was well presented and labs were interesting and hand on experience

The courses are very in-depth and useful to get a good idea of everything and get going from there.

Just finished up a course taught by Sean Mohseni. Excellent instructor. If you can find a course he's teaching, its well worth it.

Contact Us 1-800-803-3948
Contact Us Live Chat
FAQ Get immediate answers to our most frequently asked qestions. View FAQs arrow_forward