parquet-go
parquet-go copied to clipboard
segmentio
Go library to read/write Parquet files
Rarely, Tempo compactors will panic with a message like the following: ``` runtime: marked free object in span 0x7fe7b258fb40, elemsize=64 freeindex=0 (bad use of unsafe.Pointer? try -d=checkptr) 0xc0a06da000 free unmarked...
I'm attempting to serialize time objects, I thought I would be able to do that as either a timestamp or a date. Here is what I tried: ``` type Data...
I will work on a better reproduction scenario shortly, just trying to get this somewhere for posterity. Fairly low priority. e.g. this panics. ``` a := parquet.SchemaOf(MyStructA{}) a.Deconstruct(nil, MyStructB{}) ```...
It's currently difficult to use `NewReader` / `NewGenericReader` in a situation where an invalid file might be read, since they can panic when trying to read an invalid file. This...
This PR adds a test case to show issue #302. Turns out the problem is from the `optional` tag not the fact that the value is map.
* Copy page stats from page headers to chunk metadata so it ends up in the file trailer. * Test case to verify presence of statistics in a generated file
Hello there, First of all thank you for your work and this wonderful library! I am having trouble using byte stream split on an optional parquet field. Say we have...
When parsing a file with repeated groups, if the read schema does not _exactly_ match the file schema, the reader fails to parse the file. This seems to happen because...
After adding a new uint64 column to our [go struct](https://github.com/grafana/tempo/blob/parquet/tempodb/encoding/vparquet/schema.go#L138), we are unable to read data files written previously without this column, using `parquet.Reader.Read(struct)`. The library detects the schema drift,...
This code was suggested by @vc42-2. We have tested it in an environment writing 66k rows/second. Without this change we would see this panic ~10-20 times an hour. This change...