pgfutter gets killed when uploading large csv file

Open fabianbaier opened this issue 8 years ago • 1 comments

Hi,

When trying to upload a 1.87GB csv file with a few million rows through pgfutter, around 40% in of the upload it fails without much information:

 756.80 MB / 1.87 GB [==============================================================================================================================================================================>-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------]  39.62% 45s    74 Killed                  pgfutter --pw $dbpw --schema public --table my_upload_table csv upload.csv

Is there something like a verbose option to better troubleshoot and see why it is failing?

I think it could be a wrong formatted row in my csv file and/or OOM. Help appreciated.

Best, FB

Jul 14 '17 23:07 fabianbaier

think i'm hitting a similar issue https://github.com/lukasmartinelli/pgfutter/issues/42

Aug 27 '17 13:08 arjunbanker