parquet-dotnet icon indicating copy to clipboard operation
parquet-dotnet copied to clipboard

[BUG]: DataFrame loading doesn't support short (int16) columns.

Open mateli opened this issue 1 year ago • 1 comments

Library Version

4.23.3

OS

Windows/Debian

OS Architecture

64 bit

How to reproduce?

Load any parquet file with a Int16 column into a dataframe.

GetTypedDataFast() would need:

            if(col.DataType == typeof(short)) {
	            return ((PrimitiveDataFrameColumn<short>)col).ToArray();
            }
            if(col.DataType == typeof(ushort)) {
	            return ((PrimitiveDataFrameColumn<ushort>)col).ToArray();
            }

Failing test

No response

mateli avatar Jan 26 '24 08:01 mateli

Also the new DateOnly datatype is missing in bot serialization and deserialization.

mateli avatar Feb 01 '24 13:02 mateli