aiokafka icon indicating copy to clipboard operation
aiokafka copied to clipboard

Add Avro schema registry support

Open markhulia opened this issue 4 years ago • 4 comments
trafficstars

Describe the solution you'd like It would be nice to have support for schema registry the way confluent_kafka has it

Additional context Avro has a JSON like data model, but can be represented as either JSON or in a compact binary form. It dramatically increases data quality by keeping it clean and consistent

markhulia avatar Dec 30 '20 11:12 markhulia

Not sure if appropriate here, but I've been using https://github.com/lsst-sqre/kafkit in combination with aiokafka which has been working pretty well.

It's not a very widely known library though, judging by github stars or by issues/pull requests. It is however a pretty small library, so personally I felt safe vetting and using it for production purposes.

Also not sure if it's still actively maintained or not, I have a PR sitting for ~1 month now. Perhaps fork it if you find it useful?

ulrikjohansson avatar Dec 30 '20 19:12 ulrikjohansson

Not sure if appropriate here, but I've been using https://github.com/lsst-sqre/kafkit in combination with aiokafka which has been working pretty well.

It's not a very widely known library though, judging by github stars or by issues/pull requests. It is however a pretty small library, so personally I felt safe vetting and using it for production purposes.

Also not sure if it's still actively maintained or not, I have a PR sitting for ~1 month now. Perhaps fork it if you find it useful?

Thanks for the reply. I also found this library which has asnyc schema registry support. Hope this helps

markhulia avatar Jan 14 '21 12:01 markhulia

It's interesting and @markhulia I see how I can use your library and maybe implement it inside aiokafka. When #708 is done, and I ended my job, I analyze and add avro schema registry.

sycured avatar Jan 15 '21 23:01 sycured

Duplicates #616

OneCricketeer avatar Feb 07 '21 23:02 OneCricketeer