goavro icon indicating copy to clipboard operation
goavro copied to clipboard

use RCP client / server

Open sebglon opened this issue 9 years ago • 4 comments

Is it possible to use RPC client / server to exchange AVRO data?

sebglon avatar Jul 01 '16 13:07 sebglon

For information, the avro spec: https://avro.apache.org/docs/1.8.0/spec.html#Protocol+Declaration

sebglon avatar Jul 05 '16 07:07 sebglon

It is entirely possible to use an RPC client and server model on top of Avro encoded data. I've done this, and we've even included examples in the library to show one way of going about this.

Please see the two files for working examples:

  • https://github.com/linkedin/goavro/blob/master/examples/net/client/main.go
  • https://github.com/linkedin/goavro/blob/master/examples/net/server/main.go

However, goavro does not today support the Avro RPC protocol because of time constraints. I'd be very happy to discuss and collaborate with another developer who has time to devote to implementing Avro RPC in a way similar to how Avro OCF support was added as an extension to the core encoding and decoding capabilities.

karrick avatar Aug 11 '16 15:08 karrick

implemented on #62

sebglon avatar Aug 29 '16 09:08 sebglon

There is an implementation of the Avro IPC protocol in the project https://github.com/myzhan/avroipc with supporting of Flume clients. I suppose it should be separated from the main goavro project because Avro IPC may be used in different clients (and the Flume client is one of them) and may have many features that are not related to the main goavro project.

But if you have ideas on how to migrate some parts of Avro IPC in this process we may discuss them.

vykulakov avatar Feb 09 '20 06:02 vykulakov