goavro
goavro copied to clipboard
linkedin
The spec states "A logical type is always serialized using its underlying Avro type so that values are encoded in exactly the same way as the equivalent Avro type that...
While trying to replicate the Snowflake Kafka Connector functionality using [Benthos](https://benthos.dev/), I noticed that in Java they are [adding](https://github.com/snowflakedb/snowflake-kafka-connector/blob/9eaecdd625e13c708188dd6fad589dcc2b360903/src/main/java/com/snowflake/kafka/connector/records/SnowflakeAvroConverter.java#L199) `genericData.addLogicalTypeConversion(new Conversions.DecimalConversion())` in addition to the implicit conversions when converting AVRO...
Saw such files in the wild Getting the following error: ``` failed to read avro file: cannot decode when block count is not greater than 0: 0 ```
TextualFromNative output is not deterministic due to the underlying map type used for the data struct. Ideally the method should be deterministic similarly to what the [json.Marshal](https://golang.org/pkg/encoding/json/#Marshal) already does by...
This is my take on resolving the #222. I used a simple approach of extracting the keys and sorting them in a deterministic way. Hopefully this is ok or can...
I've encountered a case where it would have been helpful to validate that a string in a field, `{"type": ["null", {"type": "string", "logicalType": "uuid"}], "default": null}`, was in fact a...
If you have similar record lists to append to a file, reusing some internal slices saves memory and seems to significantly improve the performances. On my computer: | Configuration |...
## Context I see the OCF Writer append function has the signature ```go func (ocfw *OCFWriter) Append(data interface{}) error ``` Inside this we are having a reflection based code to...
AppendBinary appends one or more avro data from pulsar/kafka to an OCF file in a block.
I have looked at the https://github.com/linkedin/goavro/issues/106 but I am not using any unions. My schema is as follows; { "type": "record", "name": "Event", "namespace": "com.xyz.event", "fields": [ { "name": "eventId",...
