GOTO 2020 • Kafka as a Platform: The Ecosystem from the Ground Up • Robin Moffatt

40:50 919 views 97% Published a month ago

This presentation was recorded at GOTOpia November 2020. #GOTOcon #GOTOpia

Robin Moffatt - Senior Developer Advocate at Confluent

Kafka has become a key data infrastructure technology, and we all have at least a vague sense that it is a messaging system, but what else is it? How can an overgrown message bus be getting this much buzz? Well, because Kafka is merely the center of a rich streaming data platform that invites detailed exploration.
In this talk, we’ll look at the entire streaming platform provided by Apache Kafka and the Confluent community components. Starting with a lonely key-value pair, we’ll build up topics, partitioning, replication, and low-level Producer and Consumer APIs. We’ll group consumers into elastically scalable, fault-tolerant application clusters, then layer on more sophisticated stream processing APIs like Kafka Streams and ksqlDB. We’ll help teams collaborate around data formats with schema management [...]

00:00 Intro
01:22 Events
05:45 The log
07:53 Topics
09:33 Partitions
10:55 PUB/SUB
22:04 Brokers and replication
23:27 Pretty good so far...
24:17 Brokers and replication continued
35:07 Demo
39:42 Summary

Download slides and read the full abstract here:
#Kafka #Apache #ApacheKafka #ksqlDB #APIs #Streams #Confluent #PUBSUB

Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at

SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.

Watch on YouTube