GOTO 2020 • Kafka as a Platform: The Ecosystem from the Ground Up • Robin Moffatt

40:50 919 views 97% Published a month ago

This presentation was recorded at GOTOpia November 2020. #GOTOcon #GOTOpia
http://gotopia.eu

Robin Moffatt - Senior Developer Advocate at Confluent

ABSTRACT
Kafka has become a key data infrastructure technology, and we all have at least a vague sense that it is a messaging system, but what else is it? How can an overgrown message bus be getting this much buzz? Well, because Kafka is merely the center of a rich streaming data platform that invites detailed exploration.
In this talk, we’ll look at the entire streaming platform provided by Apache Kafka and the Confluent community components. Starting with a lonely key-value pair, we’ll build up topics, partitioning, replication, and low-level Producer and Consumer APIs. We’ll group consumers into elastically scalable, fault-tolerant application clusters, then layer on more sophisticated stream processing APIs like Kafka Streams and ksqlDB. We’ll help teams collaborate around data formats with schema management [...]

TIMECODES
00:00 Intro
01:22 Events
05:45 The log
07:53 Topics
09:33 Partitions
10:55 PUB/SUB
22:04 Brokers and replication
23:27 Pretty good so far...
24:17 Brokers and replication continued
35:07 Demo
39:42 Summary

Download slides and read the full abstract here:
https://gotopia.eu/november-2020/sessions/1625/kafka-as-a-platform-the-ecosystem-from-the-ground-up

https://twitter.com/GOTOcon
https://www.linkedin.com/company/goto-
https://www.facebook.com/GOTOConferences
#Kafka #Apache #ApacheKafka #ksqlDB #APIs #Streams #Confluent #PUBSUB

Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech

SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.
https://www.youtube.com/user/GotoConferences/?sub_confirmation=1



Watch on YouTube