skeuomorph icon indicating copy to clipboard operation
skeuomorph copied to clipboard

support avro logical type?

Open chenharryhua opened this issue 5 years ago • 5 comments

chenharryhua avatar Aug 24 '20 23:08 chenharryhua

@chenharryhua can you provide more information about what you mean by this issue? Is there a specific use case you have in mind that skeuomorph doesn't cover?

dmarticus avatar Aug 25 '20 00:08 dmarticus

My bad. I try to use skeuomorph in my project to transform avro schema to/from spark struct-type. my attempt looks like this: https://github.com/chenharryhua/nanjin/blob/master/spark/src/main/scala/com/github/chenharryhua/nanjin/spark/NJDataTypeF.scala . skeuomorph looks like a more general/idiomatic way to do it. but seems there are two missing parts in AvroF, one is how to transform avro logical type to AvroF and another is how to deal with decimal.

chenharryhua avatar Aug 25 '20 02:08 chenharryhua

No problem at all! Thanks for sharing your example; I'll look into this more tomorrow and let you know what I find.

dmarticus avatar Aug 25 '20 03:08 dmarticus

Confirmed that your assessment around the missing parts of AvroF is correct. Great catch! We'll triage this issue in our backlog and would happily welcome a PR if you have a good idea for the implementation :)

dmarticus avatar Aug 25 '20 22:08 dmarticus

Thank you, @dmarticus. I will have a try later. I am uncertain about how to transform AvroF to MuF once the logical type is added and its impact on Probuf schema which I thought also need to transform to MuF

chenharryhua avatar Aug 25 '20 23:08 chenharryhua