Home

All courses

Apache Kafka for Beginners - Learn Kafka by Hands-On

Apache Kafka

IT & Software

Other IT & Software

Apache Kafka for Beginners - Learn Kafka by Hands-On

Deep dive in to Apache Kafka concepts and learn to build Kafka producers/consumers using Java.

4.6

(1150)

7637 enrolled on this course

Last updated 11/2021

None

₹ 2899.0

₹ 4399.0

Buy Now

30-Day Money-Back Guarantee

Lessons

Quizzes

Duration

13 Hours

Skill level

Beginner

Language

English

Certificate

Yes

Full lifetime access

Yes

Description

:
Learn the fundamentals and advanced concepts of Apache Kafka in this course. This course will give you a good understanding of all the concepts through Hands-On
This course will walk you through the Kafka concepts step by step
All the Kafka concepts will be taught through
Hands-On
This course will increase your technical expertise in Kafka
This course will give you good exposure to build Kafka Client applications using Java
This course will be an eyeopener for people who think Kafka is a complex system and you will find yourself in a better place after you complete this course
This course will transfer you from no Kafka experience to an experienced Kafka user.
Course Overview:
Getting Started with Kafka
In this section, I will give you all a quick introduction to Apache Kafka, terminologies and different client APIs that are part of Kafka
Download and Install Kafka
In this section, we will download the Kafka distribution from the Kafka Website.
Understanding Kafka Components and its Internals - (Theory + Hands-On)
In this section, we will explore the Kafka internals from a theoretical perspective followed by hands-on exploring the Kafka internals.
Learn about the Topics and Partitions in Kafka
Setup a Local Kafka Cluster with Multiple Brokers
Producer/Consumer messages in the Kafka Cluster
Learn about Consumer Offsets and Consumer Groups
Commit Log and Retention Policy
Learn about Kafka Load Distribution and Fault Tolerance and Robustness
Kafka Producer API - Hands-On
In this section, we will learn about building the Kafka Producer to producer messages into Kafka using the producer API
Setting up the base-project for Producer
Understand how the producer API works
Produce messages to the Kafka topic using the Synchronous/Asynchronous approach
Understand how Kafka producer API works behind the scenes
Kafka Producer API - Guaranteed Message Delivery Configurations
In this lecture, we will learn about the different configurations that guarantee message delivery into Kafka.
Explore some of the producer API Configurations
Configuring the acks and min.insync.replicas for guaranteed message delivery
Override the retries and retry-back-off-ms value\
Kafka Consumer API - Hands On
In this section, we will learn about building Kafka consumers to read messages from Kafka using the Consumer API.
Setting up the base-project for Consumers
Consuming Messages using Consumer API - poll() loop
Build Kafka Consumer using the Consumer API
auto.offset.reset - earliest vs latest
Consumer Groups & Consumer Rebalance
In this section, we will learn about Consumer Groups and Consumer rebalance.
Scaling the Consumer using Consumer Groups
Consumer Rebalance
Consumer Rebalance & max-poll-interval-ms
Consumer Offsets - Default and Manual Offset Management - Hands-On
Committing Offsets - Default Offset Commit Strategy
Manually Committing Offsets
Committing Offsets Synchronously - using commitSync()
Committing Offsets Asynchronously - using commitAsync()
Committing Specific Offsets - using CommitSync()
By the end of this, you will have a complete understanding of how Apache Kafka works and how to build Kafka client applications using Producer and Consumer API.
Who this course is for:
Any one who is willing to learn about Kafka.

What you'll learn

Understand all the Kafka concepts and Kafka core internals.

Learn Kafka internals through practice

Build Kafka Producer applications using Java

Learn the Kafka Producer Techniques for reliable data delivery

Build Kafka Consumer applications using Java

Advance Kafka Consumer Techniques to handle duplicate processing of records

Consumer Rebalance and different techniques to handle them

Consumer techniques to seek to a specific offset

Learn to build Custom Serializer and Deserializer in Kafka

By the end of the course you will have a complete understanding of Apache Kafka and build Kafka consumer applications using Java

Requirements

You will need a copy of Adobe XD 2019 or above. A free trial can be downloaded from Adobe.
No previous design experience is needed.
No previous Adobe XD skills are needed.

Course Content

27 sections • 95 lectures

Expand All Sections

1-Getting Started with Course

1.1-Course Introduction & Objectives

1.2-Pre-Requesities

2-Course Slides

2.1-Course Slides

3-Getting Started with Kafka

3.1-Introduction to Kafka

3.2-Kafka Terminologies and Client APIs

4-Download and Install Kafka

4.1-Download and Install Kafka

5-Source Code for this Course

5.1-Source Code

6-Understanding Kafka Components and its Internals - (Theory + Hands On)

6.1-Kafka Topics and Partitions - Theory

6.2-Set Up a ZooKeeper/Kafka Broker in Local

6.3-Create Topic, Produce and Consume Messages using the Command Line Interface(CLI)

6.4-Produce and Consume Messages with Key

6.5-Consumer Offsets

6.6-Consumer Groups

6.7-Commit Log and Retention Policy

6.8-Kafka as a Distributed Streaming System

6.9-Setting up a Kafka Cluster in Local with 3 Kafka Brokers

6.10-How Kafka Cluster distributes the Client Requests ? - Leader/Follower

6.11-How Kafka handles Data Loss ? - Replication and In-Sync-Replica(ISR)

6.12-Fault Tolerance and Robustness in Kafka

7-Kafka Producer API - Hands On

7.1-Project SetUp

7.2-Sending Messages using Producer API

7.3-Build Kafka Producer - Send Messages Synchronously

7.4-Add Logging using LogBack

7.5-Sending Messages Asynchronously

7.6-Send Messages with Key

7.7-Programmatic Interface to Produce Messages

7.8-Kafka Producer API - Behind the Scenes

8-Kafka Producer API - Guaranteed Message Delivery Configurations

8.1-Kafka Producer API - Guaranteed Message Delivery Configurations

8.2-Configuring acks and min.insync.replicas - Hands On

8.3-Configuring retries and retry.backoff.ms - Hands On

9-Kafka Consumer API - Hands On

9.1-Project SetUp

9.2-Consuming Messages using Consumer API - poll() loop

9.3-Build Kafka Consumer using the Consumer API

9.4-auto.offset.reset - earliest vs latest

10-Consumer Groups & Consumer Rebalance - Hands On

10.1-Scaling the Consumer using Consumer Groups

10.2-Consumer Rebalance

10.3-Consumer Rebalance & max.poll.interval.ms

11-Consumer Offsets - Default and Manual Offset Management - Hands On

11.1-Committing Offsets - Default Offset Commit Strategy

11.2-Manually Committing Offsets

11.3-Committing Offsets Synchronously - using commitSync()

11.4-Committing Offsets Asynchronously - using commitAsync()

11.5-Committing Specific Offsets - using CommitSync()

12-Consumer Rebalance Listeners - Hands On

12.1-Introduction to Rebalance Listeners

12.2-Implement ConsumerRebalanceListener in Kafka Consumer

12.3-Committing Offsets using ConsumerRebalanceListener

13-Kafka Consumer - seekToBeginning(), seekToEnd() & seek() - Hands On

13.1-Introduction to seekToBeginning() & seekToEnd()

13.2-seekToBeginning() & seekToEnd() - Hands On

13.3-Introduction to seek()

13.4-Seek to a specific offset using seek() method in Kafka Consumer - Hands On

14-Custom Serializer and Deserializers in Kafka - Hands On

14.1-Why Custom Kafka Serializer/Deserializer ?

14.2-Build a Custom Serializer in Kafka Producer using Jackson

14.3-Build Kafka Producer using Custom Serializer

14.4-Build a Custom DeSerializer in Kafka Producer using Jackson

14.5-Build Kafka Consumer using Custom Serializer

14.6-Publish Custom Java Objects using StringSerializer and Jackson ObjectMapper

14.7-Consume Custom Java Objects using StringDeserializer and Jackson ObjectMapper

15-Bonus Section

15.1-Coupon for my Other Courses

Course Categories

Popular Courses

Apache Kafka for Beginners - Learn Kafka by Hands-On

Description

What you'll learn

Requirements

Course Content

You May Like