Udemy – Hands-on Kafka Connect: Source to Sink in S3, GCS & Beyond 2024-8

Published on: 2024-09-20 18:56:22

Categories: 28

Description

Hands-on Kafka Connect: Source to Sink in S3 GCS & Beyond course This course is completely dedicated to Kafka Connect and exploring its open source connectors. There are many connectors available in Kafka Connect. In this course, you will first learn about Kafka Connect and its architecture. In the second module, you will learn the S3 Sink connector in detail. First, you familiarize yourself with the S3 Sink connector and install it in standalone mode. Then, you run the same configurations in distributed mode to understand the clear difference between them. You will explore different Partitioner classes with examples. Next, you’ll learn how to integrate Kafka Connect with the Schema Registry and test the evolution of your backwards compatibility schema. Next, you’ll learn about DLQ and test it by creating invalid records for Kafka. Finally, using Docker Compose, you automate the creation of the S3 Sink connector with a single command.

What you will learn in this course:

Deep knowledge of Kafka Connect and its architecture
In-depth practical knowledge of implementing the S3 Sink connector in distributed mode
Setting up a Kafka Connect cluster
Full understanding of Debezium Mysql CDC resource connector
The necessity of Schema Registry and its integration with sink and source connectors
Schema evolution in sink and source connectors