Winter Savings - Save on IT Training Using Promo Code FROSTBYTE

closeClose

Confluent Stream Processing using Apache Kafka Streams & KSQL

  • Tuition USD $2,475
  • Reviews star_rate star_rate star_rate star_rate star_half 1527 Ratings
  • Course Code AK-STREAM
  • Duration 3 days
  • Available Formats Classroom

In this three-day, hands-on training course, you will learn how to use Confluent KSQL to transform, enrich, filter and aggregate streams of real-time data using a SQL-like language. You will learn to use the Streams library to build applications, and then learn how to test, monitor, secure, scale and integrate them.

Skills Gained

During this instructor-led, hands-on course, you will learn to:

  • Identify common patterns and use cases for real-time stream processing
  • Understand the high level architecture of Apache Kafka® Streams
  • Write real-time applications with the Kafka Streams API to filter, transform, enrich, aggregate, and join data streams
  • Describe how KSQL combines the elastic, fault-tolerant, high-performance stream processing capabilities of Kafka Streams with the simplicity of a SQL-like syntax
  • Author KSQL queries that showcase its balance of power and simplicity
  • Test, secure, deploy, and monitor Kafka Streams applications and KSQL queries

Who Can Benefit

This course is designed for application developers, architects, DevOps engineers, and data scientists who need to interact with Kafka clusters to create real-time applications to filter, transform, enrich, aggregate, and join data streams to discover anomalies, analyze behavior, or monitor complex systems.

Prerequisites

Attendees should be familiar with developing professional apps in Java (preferred), .NET, C#, Python, or another major programming language. Participants are required to provide a laptop computer with unobstructed internet access to fully participate in the class.

Additionally, students require a strong knowledge of the Kafka architecture as well as knowledge of Kafka client application development, either through prior experience or by taking the recommended prerequisites, Confluent Fundamentals for Apache Kafka® and Confluent Developer Skills for Building Apache Kafka.

Course Details

Hands-on Training

Throughout the course, you will interact with hands-on lab exercises to reinforce stream processing concepts. Some exercises include:

  • Anatomy of a Kafka Streams Application
  • Joining Two Streams
  • Using the Kafka Streams Processor API
  • Testing a Kafka Streams Application
  • Using KSQL
  • Using the KSQL REST API
  • Scaling a Kafka Streams Application
  • Securing a Kafka Streams Application
  • Getting Metrics from a Kafka Streams Application
  • Using JConsole to monitor a Kafka Streams Application
  • Monitoring a Kafka Streams Application in Confluent Control Center

Course Outline

Motivation and Concepts for Streams

  • Motivation and Use Cases for Real-Time Streaming
  • High Level Comparison of Kafka Streams and KSQL
  • Stream Processing Concepts

Kafka Streams Architecture

  • Kafka Streams’ Place in the Kafka Ecosystem
  • High Level Architecture Design
  • Kafka Streams Data Types

Writing Kafka Streams Applications

  • Anatomy of a Kafka Streams Application
  • Kafka Streams DSL — Stateless Operations
  • Kafka Streams DSL — Aggregations
  • Kafka Streams DSL — Windowed aggregations
  • Kafka Streams DSL — Joins
  • Kafka Streams DSL — Summary
  • Processor API
  • Optimizations

Testing Kafka Streams Applications

  • Get streams of data into and out of Kafka with Kafka Connect and REST Proxy
  • Maintain data formats and ensure compatibility with Schema Registry and Avro
  • Build real-time streaming applications with Confluent KSQL & Kafka Streams

The Confluent Platform

  • Unit Tests
  • Integration Tests
  • Stress Tests
  • End-to-end Tests

Introduction to KSQL

  • Sample Use Cases
  • End-to-end Examples
  • Interacting with KSQL

Using KSQL

  • Data Manipulation
  • Aggregations
  • Testing

Deployment

  • Parallelism
  • Elasticity
  • Fault tolerance
  • Capacity planning
  • Troubleshooting
  • KSQL-specific considerations

Security

  • Security Overview
  • Access Control
  • Examples
  • KSQL-specific considerations

Monitoring

  • JMX
  • Confluent Control Center
  • KSQL-specific Considerations

When does class start/end?

Classes begin promptly at 9:00 am, and typically end at 5:00 pm.

Does the course schedule include a Lunchbreak?

Lunch is normally an hour long and begins at noon. Coffee, tea, hot chocolate and juice are available all day in the kitchen. Fruit, muffins and bagels are served each morning. There are numerous restaurants near each of our centers, and some popular ones are indicated on the Area Map in the Student Welcome Handbooks - these can be picked up in the lobby or requested from one of our ExitCertified staff.

How can someone reach me during class?

If someone should need to contact you while you are in class, please have them call the center telephone number and leave a message with the receptionist.

What languages are used to deliver training?

Most courses are conducted in English, unless otherwise specified. Some courses will have the word "FRENCH" marked in red beside the scheduled date(s) indicating the language of instruction.

What does GTR stand for?

GTR stands for Guaranteed to Run; if you see a course with this status, it means this event is confirmed to run. View our GTR page to see our full list of Guaranteed to Run courses.

Does ExitCertified deliver group training?

Yes, we provide training for groups, individuals and private on sites. View our group training page for more information.

Does ExitCertified deliver group training?

Yes, we provide training for groups, individuals, and private on sites. View our group training page for more information.

The training was excellent which is what I expecting for Amazon software training.

The course on Redshift was excellent! As a DBA/DA I found there is a quite a bit of learning for Oracle professionals to move into AWS.

J’aime cet environnement, je vois qu’on peut faire beaux de chose la dessus. J’aime ce genre de projet ou environnement bien fait.

J`aime l´environnement, la façon dont les labs sont organises. Sauf que je ne peux pas faire de click droit sur ces pages. Pour les labs çà aurait été utile.

Well planned presentations. Live Demo. Excellent labs to ensure comprehension.

0 options available

There are currently no scheduled dates for this course. If you are interested in this course, request a course date with the links above. We can also contact you when the course is scheduled in your area.

Contact Us 1-800-803-3948
Contact Us Live Chat
FAQ Get immediate answers to our most frequently asked qestions. View FAQs arrow_forward