Get in Touch
 Duration 21 hours

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Configuration

  • The role of Kafka in contemporary data pipelines
  • Distinguishing between Apache Kafka and Confluent Kafka
  • Core architectural elements: producers, consumers, brokers, topics, and partitions
  • Deployment models and scaling considerations for Kafka clusters

Module 2: Configuring the Zookeeper Quorum

  • Introduction to Zookeeper
  • The function of Zookeeper within a Kafka cluster
  • Determining appropriate Zookeeper Quorum sizes
  • Zookeeper configuration parameters
  • Establishing SSH access on servers
  • Practical exercise: Configuring Zookeeper as a team and as a service
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Practical exercise: Configuring the Zookeeper Quorum
  • Exploring the Zookeeper internal file system
  • Performance factors influencing Zookeeper operations
  • Demonstration of management tools, including Zookeeper and Zoonavigator

Module 3: Kafka Cluster Configuration

  • Fundamental Kafka concepts
  • Core Kafka configuration settings
  • Practical exercise: Configuring Kafka brokers
  • Practical exercise: Executing Kafka commands
  • Practical exercise: Configuring a Kafka Multi-Broker Cluster
  • Practical exercise: Testing Kafka cluster functionality
  • Verification of cluster connectivity
  • Configuring Advertised.listeners: A critical setting
  • Topic configuration management
  • Settings for message ingestion and retrieval within topics
  • Practical exercise: Demonstrating Kafka resilience
  • Kafka performance optimization: I/O
  • Kafka performance optimization: Network (RED)
  • Kafka performance optimization: RAM
  • Kafka performance optimization: CPU
  • Kafka performance optimization: Operating System (OS)
  • Kafka performance optimization: Additional factors
  • Practical exercise: Modifying Kafka broker configurations

Module 4: Advanced Kafka Configuration

  • Configuration of Landoop Kafka topic UI, Confluent REST Proxy, and Confluent Schema Registry
  • Message production and consumption via CLI, Java, and the Spring framework
  • Monitoring metrics and utilizing tools such as Confluent Control Center and Elasticsearch
  • Management of log files and offsets
  • Implementing high availability and disaster recovery strategies
  • Ensuring high availability through replication mechanisms
  • Optimizing producer and consumer performance
  • Formulating disaster recovery plans
  • Controlling failover processes and data recovery
  • Connector configuration
  • Implementing Kafka Connect
  • Applying Kafka security features

Summary and Recommended Next Steps

Requirements

  • Working knowledge of distributed systems and messaging concepts
  • Proficiency with the Linux command line interface
  • Foundational understanding of networking principles and system administration

Target Audience

  • System administrators
  • DevOps engineers
  • Platform and infrastructure engineering teams

Number of participants


Price per participant (excl. VAT)

Testimonials (2)

Upcoming Courses

Related Categories