Deedle icon indicating copy to clipboard operation
Deedle copied to clipboard

OutOfMemoryException when using Frame.ReadCsv

Open julien-leclercq opened this issue 9 years ago • 0 comments

So I want to get stats on a big csv file, I firstly used the FSharp.Data.CsvProvider but then I realized that Deedle could be appropriate for the stuff I am doing. BUT this is what I've done :

Frame.ReadCsv("PathToMyOverThan1GBfile.csv")

This is what I got (I am running this on an Ubuntu Server with the last available mono version and my fsharpi is on 64 bits)

System.OutOfMemoryException: Out of memory
  at <StartupCode$FSI_0002>.$FSI_0002.main@ () <0x417c20e0 + 0x001d3> in <filename unknown>:0 
  at (wrapper managed-to-native) System.Reflection.MonoMethod:InternalInvoke (System.Reflection.MonoMethod,object,object[],System.Exception&)
  at System.Reflection.MonoMethod.Invoke (System.Object obj, BindingFlags invokeAttr, System.Reflection.Binder binder, System.Object[] parameters, System.Globalization.CultureInfo culture) <0x7fda9575a5d0 + 0x000a1> in <filename unknown>:0 
Stopped due to error

julien-leclercq avatar Jul 21 '16 14:07 julien-leclercq