xk6-kafka icon indicating copy to clipboard operation
xk6-kafka copied to clipboard

Implement Protocol Buffer serdes

Open mostafa opened this issue 2 years ago • 8 comments

Related:

  • #51

Note to self: For implementing protobuf, I should use jhump/protoreflect, which internally uses yoheimuta/go-protoparser. The sample code is in the gRPC client of k6. The protobuf-dynamic Java library could be an inspiration.

mostafa avatar May 28 '22 15:05 mostafa

Hi @mostafa - just wondering if you plan to address this issue anytime soon? Support for protobuf would be a great addition to Kafka xk6.

lsolovey avatar Jun 24 '22 14:06 lsolovey

@lsolovey I tried implementing it once, but it is more complicated than it looks, but I'll probably do it as some point, given enough upvotes. I'd be happy to see contributions, though. 😄

mostafa avatar Jun 24 '22 21:06 mostafa

@mostafa, I'm looking help on protobuf. Do you have any latest code on this to share? Thanks In advance!

nrellanti avatar Sep 22 '22 21:09 nrellanti

@nrellanti Do you want to help develop it? If so, the links I mentioned here are the starting point. You need to build something like avro.go that extends the Serdes interface.

mostafa avatar Sep 23 '22 08:09 mostafa

@mostafa , looking something like proto.go scripts from you in the scripts folder. If you have protobuf code, I will help testing the code in local.

nrellanti avatar Sep 23 '22 14:09 nrellanti

@nrellanti Thanks for offering help with testing, but the feature itself is not implemented yet.

mostafa avatar Sep 23 '22 21:09 mostafa