Module 1: Kafka Experiments
Six split-screen interactive sandboxes — theory on the left, live simulator on the right.
Single-Node KRaft Setup
Initialize Kafka 4.x without ZooKeeper. Generate cluster UUIDs, format KRaft metadata storage, and start a standalone broker.
Core Messaging Pipeline
Create topics and establish a publish-subscribe pipeline across three machines using CLI producer and consumer.
Partitions & Consumer Groups
Scale throughput using partition sharding and consumer group rebalancing across parallel consumers.
Cluster Fault Tolerance
Simulate broker node crashes in a 3-broker cluster and observe leader re-election and message durability.
Python Programmatic Streaming
Move from CLI to IDE. Write KafkaProducer and KafkaConsumer in Python with the kafka-python library.
Live Video Streaming
Use OpenCV and Python to capture, compress and stream real webcam frames over Kafka in real time.