Anton Gorev comments

Repositories
Issues
Comments

Results 3 comments of


                                            Anton Gorev

GC overhead while ingesting big excel files

I was testing with an Excel file of 1GB with 10 similarly generated sheets: 12 columns, each column has random strings of equal length and the number of rows is...

GC overhead while ingesting big excel files

https://github.com/crealytics/spark-excel/compare/master...kvirund:patch-1 This works for me. I am still running performance tests but reading of that 1GB file went through just fine.

[BUG] Data is not being read using streaming approach.

Sure. This one should work. It is reproducible on any file generated using the Streaming Excel Workbook library when it is being read with the `maxRowsInMemory` parameter (i.e. using the...