Get in Touch
 Duration 16 hours

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Setup

  • Understanding Apache Kafka and the Confluent Platform
  • Fundamentals of Kafka brokers, producers, consumers, and topics
  • The role of Kafka in data streaming and messaging workflows
  • Confluent extensions: REST Proxy, Schema Registry, and Control Center
  • Kafka cluster architecture: brokers, partitions, and replication

Module 2: Configuring Zookeeper Quorums

  • Introduction to Zookeeper
  • Zookeeper’s function within a Kafka cluster
  • Determining Zookeeper quorum size
  • Configuring Zookeeper services
  • Implementing SSH on servers
  • Practical Lab: Configuring Zookeeper (as a team and as a service)
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Practical Lab: Setting up the Zookeeper quorum
  • Zookeeper’s internal file system structure
  • Performance factors influencing Zookeeper
  • Demo: Managing Zookeeper with tools and Zoonavigator

Module 3: Configuring the Kafka Cluster

  • Core Kafka concepts
  • Kafka configuration essentials
  • Practical Lab: Configuring Kafka on a single broker
  • Practical Lab: Executing Kafka commands
  • Practical Lab: Setting up a multi-broker (cluster) environment
  • Practical Lab: Testing the Kafka cluster
  • Verifying connectivity to the Kafka cluster
  • Configuring Advertised.listeners: key settings
  • Topic configuration strategies
  • Setting up message ingestion and delivery within topics
  • Practical Lab: Demonstrating Kafka resilience
  • Kafka performance: I/O, network, RAM, CPU, and OS considerations
  • Kafka performance: additional influencing factors
  • Practical Lab: Modifying broker configurations

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
  • Message sending and receiving methods (CLI, Java, Spring Framework)
  • Metrics and monitoring tools (Confluent Control Center, Elasticsearch, etc.)
  • Log file management and offset handling
  • High availability and disaster recovery planning
  • Achieving high availability through replication
  • Performance tuning for producers and consumers
  • Disaster recovery strategies
  • Failover control and data recovery processes
  • Connector setup
  • Implementing Kafka Connect
  • Securing Kafka environments

Summary and Future Directions

Requirements

  • Proficiency with Linux-based systems and command-line utilities
  • Working knowledge of distributed systems concepts
  • Familiarity with fundamental networking and system configuration

Target Audience

  • DevOps and SRE teams responsible for managing Kafka deployments
  • System administrators working with Confluent and Zookeeper
  • Kafka developers and architects overseeing scalable system designs

Number of participants


Price per participant (excl. VAT)

Testimonials (2)

Upcoming Courses

Related Categories