Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Module 1: Overview of Confluent Apache Kafka Architecture and Configuration
- The role of Kafka in contemporary data pipelines
- Distinguishing between Apache Kafka and Confluent Kafka
- Core architectural elements: producers, consumers, brokers, topics, and partitions
- Deployment models and scaling considerations for Kafka clusters
Module 2: Configuring the Zookeeper Quorum
- Introduction to Zookeeper
- The function of Zookeeper within a Kafka cluster
- Determining appropriate Zookeeper Quorum sizes
- Zookeeper configuration parameters
- Establishing SSH access on servers
- Practical exercise: Configuring Zookeeper as a team and as a service
- Utilizing the Zookeeper Command Line Interface (CLI)
- Practical exercise: Configuring the Zookeeper Quorum
- Exploring the Zookeeper internal file system
- Performance factors influencing Zookeeper operations
- Demonstration of management tools, including Zookeeper and Zoonavigator
Module 3: Kafka Cluster Configuration
- Fundamental Kafka concepts
- Core Kafka configuration settings
- Practical exercise: Configuring Kafka brokers
- Practical exercise: Executing Kafka commands
- Practical exercise: Configuring a Kafka Multi-Broker Cluster
- Practical exercise: Testing Kafka cluster functionality
- Verification of cluster connectivity
- Configuring Advertised.listeners: A critical setting
- Topic configuration management
- Settings for message ingestion and retrieval within topics
- Practical exercise: Demonstrating Kafka resilience
- Kafka performance optimization: I/O
- Kafka performance optimization: Network (RED)
- Kafka performance optimization: RAM
- Kafka performance optimization: CPU
- Kafka performance optimization: Operating System (OS)
- Kafka performance optimization: Additional factors
- Practical exercise: Modifying Kafka broker configurations
Module 4: Advanced Kafka Configuration
- Configuration of Landoop Kafka topic UI, Confluent REST Proxy, and Confluent Schema Registry
- Message production and consumption via CLI, Java, and the Spring framework
- Monitoring metrics and utilizing tools such as Confluent Control Center and Elasticsearch
- Management of log files and offsets
- Implementing high availability and disaster recovery strategies
- Ensuring high availability through replication mechanisms
- Optimizing producer and consumer performance
- Formulating disaster recovery plans
- Controlling failover processes and data recovery
- Connector configuration
- Implementing Kafka Connect
- Applying Kafka security features
Summary and Recommended Next Steps
Requirements
- Working knowledge of distributed systems and messaging concepts
- Proficiency with the Linux command line interface
- Foundational understanding of networking principles and system administration
Target Audience
- System administrators
- DevOps engineers
- Platform and infrastructure engineering teams
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)