Avro serialization with Kafka and AWS Glue
Avro is a popular serialization format for high throughput streaming applications. However, to get the benefits of improved performance, it requires an external schema registry.
In this video we will explore the challenges of using AWS glue as a schema, including:
- What is Apache Avro?
- Why a schema registry is important?
- What are some challenges with integrating Kafka and AWS schema registry?
- How can`aws-glue-schema-registry` enable us to use AWS schema registry with Python Kafka clients?
- Overview of library and code examples.
Note - here is the main Python library discussed in this talk.
I'm not a maintainer of this project just a fan.
Learn more about engineering at IRONSCALES, the team, and some of their work here.