avro_ex
avro_ex copied to clipboard
default values of `null` are removed from schema in `encode_schema`
trafficstars
Heyo 👋
Ran into an edge case today where a schema defined in JSON containing nullable unions would have the "default": null portion stripped out if it was run through a sequence of AvroEx.decode_schema -> AvroEx.encode_schema.
Example:
schema = AvroEx.decode_schema!(~S({
"type": "record",
"name": "Record",
"fields": [
{"type": ["null", "int"], "name": "nullable", "default": null}
]
}))
AvroEx.encode_schema(schema)
Output:
"{\"fields\":[{\"name\":\"nullable\",\"type\":[{\"type\":\"null\"},{\"type\":\"int\"}]}],\"name\":\"Record\",\"type\":\"record\"}"
I haven't dug too deep, but other primitives seem okay:
schema = AvroEx.decode_schema!(~S({
"type": "record",
"name": "Record",
"fields": [
{"type": ["null", "int"], "name": "nullable", "default": 5}
]
}))
AvroEx.encode_schema(schema)
"{\"fields\":[{\"default\":5,\"name\":\"nullable\",\"type\":[{\"type\":\"null\"},{\"type\":\"int\"}]}],\"name\":\"Record\",\"type\":\"record\"}"
Using v2.0.1
Thanks for the report @otosky :)
@marpo60 told me he is working on a fix