Get in Touch
 Duration 16 hours

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Setup

  • An introduction to Apache Kafka and the Confluent Platform.
  • Foundational concepts of Kafka brokers, producers, consumers, and topics.
  • The significance of Kafka in data streaming and messaging workflows.
  • Confluent-specific extensions: REST Proxy, Schema Registry, and Control Center.
  • Cluster architecture details: brokers, partitions, and replication mechanisms.

Module 2: Configuring Zookeeper Quorum

  • Understanding Zookeeper and its purpose.
  • The function of Zookeeper within a Kafka cluster.
  • Determining the appropriate Zookeeper quorum size.
  • Configuring Zookeeper components.
  • Implementing SSH on server infrastructure.
  • Hands-on: Configuring Zookeeper (both as a team and as a service).
  • Utilizing the Zookeeper Command Line Interface (CLI).
  • Hands-on: Establishing a Zookeeper quorum setup.
  • Exploring Zookeeper’s internal file system.
  • Performance considerations affecting Zookeeper.
  • Demo: Managing Zookeeper using tools like Zoonavigator.

Module 3: Configuring Kafka Clusters

  • Essential Kafka concepts.
  • Basics of Kafka configuration.
  • Hands-on: Configuring Kafka on a single broker.
  • Hands-on: Running Kafka commands.
  • Hands-on: Setting up a multi-broker Kafka cluster.
  • Hands-on: Testing the Kafka cluster setup.
  • Verifying connectivity to the Kafka cluster.
  • Configuring advertised.listeners: key settings explained.
  • Topic configuration details.
  • Setting up message ingestion and delivery via topics.
  • Hands-on: Demonstrating Kafka resilience in action.
  • Performance factors: I/O, network, RAM, CPU, and OS.
  • Additional performance influencing factors.
  • Hands-on: Modifying broker configurations.

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry.
  • Messaging via CLI, Java, and the Spring Framework.
  • Utilizing metrics and monitoring tools such as Confluent Control Center and Elasticsearch.
  • Managing log files and offsets.
  • Implementing high availability and disaster recovery protocols.
  • Achieving high availability through replication.
  • Performance tuning for producers and consumers.
  • Developing disaster recovery strategies.
  • Controlling failover and recovering data.
  • Setting up connectors.
  • Implementing Kafka Connect.
  • Exploring Kafka security features.

Course Summary and Recommended Next Steps

Requirements

  • Proficiency with Linux-based operating systems and command-line utilities.
  • A solid understanding of distributed system concepts.
  • Basic knowledge of networking principles and system configuration.

Target Audience

  • DevOps and SRE teams responsible for managing Kafka deployments.
  • System administrators working with Confluent platforms and Zookeeper.
  • Kafka developers and architects tasked with designing scalable systems.

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories