aiokafka
aiokafka copied to clipboard
Add Avro schema registry support
Describe the solution you'd like It would be nice to have support for schema registry the way confluent_kafka has it
Additional context Avro has a JSON like data model, but can be represented as either JSON or in a compact binary form. It dramatically increases data quality by keeping it clean and consistent
Not sure if appropriate here, but I've been using https://github.com/lsst-sqre/kafkit in combination with aiokafka which has been working pretty well.
It's not a very widely known library though, judging by github stars or by issues/pull requests. It is however a pretty small library, so personally I felt safe vetting and using it for production purposes.
Also not sure if it's still actively maintained or not, I have a PR sitting for ~1 month now. Perhaps fork it if you find it useful?
Not sure if appropriate here, but I've been using https://github.com/lsst-sqre/kafkit in combination with aiokafka which has been working pretty well.
It's not a very widely known library though, judging by github stars or by issues/pull requests. It is however a pretty small library, so personally I felt safe vetting and using it for production purposes.
Also not sure if it's still actively maintained or not, I have a PR sitting for ~1 month now. Perhaps fork it if you find it useful?
Thanks for the reply. I also found this library which has asnyc schema registry support. Hope this helps
It's interesting and @markhulia I see how I can use your library and maybe implement it inside aiokafka. When #708 is done, and I ended my job, I analyze and add avro schema registry.
Duplicates #616