ChoETL

ChoETL copied to clipboard

Complex json to parquet does not write all column data if json array of objects has different length

1

Same issue exists when two objects have same array length but one of the nested objects is `null`. ``` var json = JsonSerializer.Serialize(rows); using (var r = ChoJSONReader.LoadText(json).UseJsonSerialization()) { using...

ghost

Flatten Complex Json structure

12

I have these line of code: ``` using (var r = new ChoJSONReader("data.json") .Configure(c => c.ThrowAndStopOnMissingField = true) .Configure(c => c.DefaultArrayHandling = true) .Configure(c => c.FlattenNode = true) .Configure(c =>...

CreaterCalvin

CRLF not being added to the end of Fixed Length Files.

2

Not completely sure if this is an issue or just a convention that you've chosen but, when I use the fixed file writer. It's adding a CRLF to every line...

damienspivak

Hi @Cinchoo, your library is very good when it could look up and flatten it to Data Table. In my scenario, I would like to transform all fields from a...

zhenyuan0502

Consider making [XmlElement] the default in nested XML files

1

I have some C# class objects that represent Visual Studio XML files that have multiple levels of nesting of XML elements. Currently, each nested XML field must be declared with...

kevinj2016

XML read fails on unknown xmlns field

8

I am trying to read a standard Visual Studio NET Framework project file using ChoXmlReader (v1.1.28) as shown below. I'm running .28 because I have many project files that use...

kevinj2016

Column renaming and nested structures

1

I want to create a parquet file with this schema: ``` public class CompleteFile { public string DataSource { get; set; } public long? DataType { get; set; } public...

mat-berna

csv to json including null

2

I'm attempting to perform the reverse of #143 In my case I would like to *not* include any fields where the resulting value is missing. ``` using System; using System.Text;...

nklincoln

Nested array (Not flat)

11

Apologies if this is very simple, but I can't figure it out: e.g. JSON ``` { FirstName : "something", SomeProperties: [ {lala: "a"}, {lala : "b"}, etc ] } ```...

evak6979

ChoParquetWriter throwing error on writing parquet from a csv column which is of type datetimeoffset(datetime column as varchar from csv works fine)

2

Hi, Below error is thrown while trying to create a parquet from csv file having datetime column (1900-01-01T00:00:00.0000000) Code Snippet for setting column config FROM CSV: var field = new...

Moniezz