GOTO 2021 • Streaming with Structure • Katherine Stanley38:20 693 views 88% Published 4 weeks ago
This presentation was recorded at GOTOpia February 2021. #GOTOcon #GOTOpia
Katherine Stanley - Software engineer at IBM Event Streams
Using a publish-subscribe messaging system like Apache Kafka is a great way to minimise coupling between your applications.
The stream history that Kafka provides allow consumers to come and go, without the producers ever being aware. This works fine until an application changes the shape of the events it is producing — how do consumers understand and handle the change? This is where schemas and a schema registry comes in.
This session will introduce the common schema formats that are used in the Kafka community and some schema registries that support these. It will also cover how to use schemas in different types of Kafka applications. Learn how to effectively [...]
00:53 Barista example
08:49 Using JSON
10:20 Adding structure with schemas
13:20 Schema registry
14:07 What format to use?
19:33 Which schema to choose?
27:02 Serdes and converters
34:41 Apicurio registry
36:06 Confluent schema registry
Download slides and read the full abstract here:
#Streaming #ApacheKafka #Kafka #Stream #EventStreaming #KafkaStreams #EventDriven #SoftwareArchitecture #StringSerializer #JSON #ApacheAvro #KafkaRecords #Serdes #Converter #KafkaConnect #Apicurio #Confluent
Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech
SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.