Visão Geral

Este Curso Kafka ensinará Apache Kafka – um popular sistema de mensagens distribuídas. Cobriremos o streaming

Objetivo

Após realizar este Curso Kafka você será capaz de:

• Tecnologias e arquitetura de streaming
• Conceitos e arquitetura Kafka
• Programação usando API Kafka
• API de fluxos Kafka
• Conexão Kafka
• SQL
• Monitorando Kafka
• Ajuste / solução de problemas do Kafka
• Melhores Práticas
• Casos de uso

Publico Alvo

• Desenvolvedores, arquitetos

Pre-Requisitos

• Recomendado: Confortável com a linguagem de programação Java e ferramentas de desenvolvimento Java (Eclipse, Maven) – os exercícios de programação são em Java
• É bom ter: Confortável no ambiente Linux (ser capaz de navegar na linha de comando do Linux, executar comandos

Materiais

Conteúdo Programatico

Introduction to Streaming Systems

1. Understanding Fast data
2. Streaming terminologies
3. Understanding at-least-once / at-most-once / exactly-once processing patterns
4. Popular streaming architectures
5. Lambda architecture
6. Streaming platforms overview

Introducing Kafka

1. Comparing Kafka with other queue systems (JMS / MQ)
2. Kafka Architecture
3. Kaka concepts : Messages, Topics, Partitions, Brokers, Producers, commit logs
4. Kafka & Zookeeper
5. Producing messages
6. Consuming messages
7. Consumers, Consumer Groups
8. Message retention
9. Scaling Kafka
10. Labs : Getting Kafka up and running; Using Kafka utilities

Using Kafka APIs

1. Commits, Offset
2. Configuration parameters
3. Producer API – sending messages to Kafka
4. Consumer API – consuming messages from Kafka
5. Producer send modes
6. Message compression
7. s, Seeking
8. Managing offsets – auto-commit / manual commit
9. Labs : Writing Produc; Clickstream processing hemes; Managing offsets

Kafka Streams API

1. Introduction to Kafka Streams library
2. Features and design
3. Streams concepts : KStream / KTable / KStore
4. Streaming operations (transformations, filters, joins, aggregations)
5. Using Streams API : foreach / filter / map / groupby
6. Labs: Kafka Streaming APIs

Monitoring and Instrumenting Kafka

1. Monitoring Kafka metrics
2. Introduction to Metrics library
3. Instrumenting Kafka applications with the Metrics library
4. Using Grafana to visualize metrics
5. Labs: Monitor Kafka cluster; Instrument Kafka applications with the metrics library

Confluent Kafka Platform

1. Introduction to Confluent platform
2. KSQL
3. KSQLdb
4. Avro Schema Registry

Kafka Connect

1. Connect ecosystem
2. Popular connectors
3. Sample configurations

Kafka Best Practices

1. Avoiding common mistakes
2. Hardware selection
3. Cluster sizing
4. Partition sizing
5. Zookeeper settings
6. Compression and batching
7. Message sizing
8. Monitoring and instrumenting
9. Troubleshooting

Kafka Case Studie