Get in Touch
 Duration 16 hours

Course Outline

Module 1: Introduction to Confluent Apache Kafka Architecture and Cluster Configuration

  • Overview of Apache Kafka and the Confluent Platform.
  • Foundational concepts of Kafka brokers, producers, consumers, and topics.
  • The role of Kafka in data streaming and messaging pipelines.
  • Confluent extensions: REST Proxy, Schema Registry, and Control Center.
  • Kafka cluster architecture: brokers, partitions, and replication.

Module 2: Zookeeper Quorum Configuration

  • Introduction to Zookeeper.
  • The function of Zookeeper within a Kafka cluster.
  • Determining Zookeeper quorum size.
  • Zookeeper configuration parameters.
  • Implementing SSH on target servers.
  • Hands-on: Configuring Zookeeper (as a team and as a service).
  • Utilizing the Zookeeper Command Line Interface (CLI).
  • Hands-on: Establishing a Zookeeper quorum.
  • Zookeeper internal file system structure.
  • Performance factors influencing Zookeeper.
  • Demo: Zookeeper management tools and Zoonavigator.

Module 3: Kafka Cluster Configuration

  • Core Kafka fundamentals.
  • Configuring Kafka instances.
  • Hands-on: Configuring Kafka on a single broker.
  • Hands-on: Executing Kafka commands.
  • Hands-on: Setting up a Kafka multi-broker (cluster) environment.
  • Hands-on: Testing Kafka cluster integrity.
  • Verifying connectivity to the Kafka cluster.
  • Advertised.listeners configuration: critical settings.
  • Topic configuration specifics.
  • Setting up message ingestion and delivery across topics.
  • Hands-on: Demonstrating Kafka resilience.
  • Kafka performance: I/O, network, RAM, CPU, and OS considerations.
  • Kafka performance: additional influencing factors.
  • Hands-on: Modifying broker configurations.

Module 4: Advanced Kafka Configuration

  • Configuration of Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry.
  • Sending and receiving messages (via CLI, Java, and Spring Framework).
  • Metrics and monitoring tools (Confluent Control Center, Elasticsearch, etc.).
  • Log file management and offset control.
  • High availability and disaster recovery principles.
  • Ensuring high availability through replication.
  • Performance tuning for producers and consumers.
  • Disaster recovery strategies.
  • Failover control and data recovery procedures.
  • Setting up connectors.
  • Implementing Kafka Connect.
  • Kafka security features and best practices.

Summary and Next Steps

Requirements

  • Proficiency with Linux-based systems and command-line utilities.
  • Working knowledge of distributed systems concepts.
  • Comprehension of fundamental networking and system configuration.

Intended Audience

  • DevOps and SRE teams responsible for Kafka deployments.
  • System administrators managing Confluent and Zookeeper components.
  • Kafka developers and architects focused on building scalable systems.

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories