GOTO 2020 • Kafka as a Platform: The Ecosystem from the Ground Up • Robin Moffatt

39:16 1152 views 100% Published one year ago

This presentation was recorded at GOTOpia Europe 2020. #GOTOcon #GOTOpia

Robin Moffatt - Don't miss this introduction to Apache Kafka from the top-rated speaker from Kafka Summit 2020

Kafka has become a key data infrastructure technology, and we all have at least a vague sense that it is a messaging system, but what else is it? How can an overgrown message bus be getting this much buzz? Well, because Kafka is merely the center of a rich streaming data platform that invites detailed exploration.
In this talk, we’ll look at the entire streaming platform provided by Apache Kafka and the Confluent community components. Starting with a lonely key-value pair, we’ll build up topics, partitioning, replication, and low-level Producer and Consumer APIs. We’ll group consumers into elastically scalable, fault-tolerant application clusters, then layer on more sophisticated stream processing APIs like Kafka Streams and ksqlDB. We’ll help teams collaborate around data formats with schema management. We’ll integrate with legacy systems without writing custom code.
By the time we’re done, the open-source project we thought was Big Data’s answer to message queues will have become an enterprise-grade [...]

00:00 Intro
00:48 Events
04:03 The log
05:55 Immutable event log
06:27 Topics
08:18 Partitions
09:10 PUB/SUB
17:00 Brokers and replications
19:01 Streaming pipelines
28:50 Demo
37:22 Summary

Download slides and read the full abstract here:
#Kafka #Apache #ApacheKafka #ksqlDB #APIs #Streams #Confluent

Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at

SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.

Watch on YouTube