ChoETL
ChoETL copied to clipboard
Json field is causing System.InvalidCastException when converting json to parquet
ChoETL.JSON, Version="1.2.1.50" ChoETL.Parquet, Version="1.0.1.24 Having this field "ContainsComments": 0 in the json file is causing the following exception when trying to convert json to parquet System.InvalidCastException: At least one element in the source array could not be cast down to the destination array type.
im using this code to create the parquet file
using var reader = ChoJSONReader.LoadText(testFileContent);
using var writer = new ChoParquetWriter(parquetFilePath).ErrorMode(ChoErrorMode.IgnoreAndContinue);
writer.Write(reader);
writer.Close();
pls take https://www.nuget.org/packages/ChoETL.Parquet/1.0.1.25-beta1 and give it try. Let me know.
If you run into issue, pls share more details with sample json. Thanksl