avro icon indicating copy to clipboard operation
avro copied to clipboard

logicalType - keep property

Open jwtryg opened this issue 6 months ago • 3 comments

Currently when parsing an avro schema, the schema.go file contains a number of reserved properties that are removed from the schemas. These reserved properties include the logicalType property.

However, some projects, like apache iceberg, uses a number of logical types that are not included in the avro specification (see this) and therefore don't have corresponding LogicalTypes defined. When parsing such an avro schema, these unknown logicalTypes are then simply ignored and furthermore removed from the schema propertiies which makes them impossible to detect.

My suggestion for a simple solution is that the logicalType properties are kept by removing it from the list of schemaReserved properties. Or do you have other alternatives?

jwtryg avatar Aug 16 '24 09:08 jwtryg