scio icon indicating copy to clipboard operation
scio copied to clipboard

Published 20 hours ago • verified publisher icon spotify

Avro logical types support

Open RustedBones opened this issue 3 years ago • 2 comments

Scio does run with avro model defining logical types as defined in the avro specification.

Avro 1.8 generates broken java code which does not allow full support of the feature but avro 1.9.2 works fine.

Since Beam can work with both avro 1.8 and avro 1.9, this is an attempt to run Scio with avro 1.9 and check logical type support

RustedBones avatar Nov 23 '21 15:11 RustedBones

See https://github.com/apache/beam/pull/16271

RustedBones avatar Dec 17 '21 15:12 RustedBones

Would unblock #1949 for the avro 1.9 possible support

RustedBones avatar Apr 20 '22 15:04 RustedBones

Closing. waiting for upstream fix

RustedBones avatar Jun 13 '23 09:06 RustedBones