GOTO 2021 • Streaming with Structure • Katherine Stanley

38:20 693 views 88% Published 5 months ago

This presentation was recorded at GOTOpia February 2021. #GOTOcon #GOTOpia

Katherine Stanley - Software engineer at IBM Event Streams

Using a publish-subscribe messaging system like Apache Kafka is a great way to minimise coupling between your applications.
The stream history that Kafka provides allow consumers to come and go, without the producers ever being aware. This works fine until an application changes the shape of the events it is producing — how do consumers understand and handle the change? This is where schemas and a schema registry comes in.
This session will introduce the common schema formats that are used in the Kafka community and some schema registries that support these. It will also cover how to use schemas in different types of Kafka applications. Learn how to effectively [...]

00:00 Intro
00:53 Barista example
08:49 Using JSON
10:20 Adding structure with schemas
13:20 Schema registry
14:07 What format to use?
19:33 Which schema to choose?
27:02 Serdes and converters
34:41 Apicurio registry
36:06 Confluent schema registry
36:51 Summary
37:28 Outro

Download slides and read the full abstract here:
#Streaming #ApacheKafka #Kafka #Stream #EventStreaming #KafkaStreams #EventDriven #SoftwareArchitecture #StringSerializer #JSON #ApacheAvro #KafkaRecords #Serdes #Converter #KafkaConnect #Apicurio #Confluent

Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at

SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.

Watch on YouTube