karapace icon indicating copy to clipboard operation
karapace copied to clipboard

Investigate aiokafka

Open gabriel-tincu opened this issue 4 years ago • 2 comments

https://github.com/aio-libs/aiokafka is a bit behind the curve but may still provide enough to justify adoption.

POC for the Schema Registry API: https://github.com/aiven/karapace/compare/gabi-aiokafka

gabriel-tincu avatar Mar 19 '20 12:03 gabriel-tincu

As it stands ATM, there were some issues with the client constructor / bootstrapping in real environments (call to bootstrap would block indefinitely) This issue will remain open however as aiokafka is a much better fit for Karapace due to its async nature

gabriel-tincu avatar May 13 '20 11:05 gabriel-tincu

Perhaps the best approach here is to use confluent-kafka-python. The library is licensed with Apache-2.0, seems to be better maintained, and it is a wrapper around the C implementation which should be a bit faster. The other OSS implementations are really lagging behind in merging bugfixes and new features.

hackaugusto avatar Jul 12 '21 09:07 hackaugusto

Aiokafka is used in Karapace.

jjaakola-aiven avatar Sep 07 '22 11:09 jjaakola-aiven