Introducing Exactly Once Semantics in Apache Kafka®

Speakers: Gehrig Kunz, Technical Product Marketing Manager, Confluent & Apurva Mehta, Software Engineer, Confluent

Apache Kafka®'s rise in popularity as a streaming platform has demanded a revisit of its traditional at-least-once message delivery semantics.

In this talk, we present the recent additions to Kafka to achieve exactly-once semantics (EoS) including support for idempotence and transactions in the Kafka clients. The main focus will be the specific semantics that Kafka distributed transactions enable and the underlying mechanics which allow them to scale efficiently.