sas7bdat icon indicating copy to clipboard operation
sas7bdat copied to clipboard

Error when reading in 46 mln row file

Open arseniostaer opened this issue 13 years ago • 2 comments

Hi Matt,

Found this error when using read.sas7bdat 0.2 on a win SAS x32 file, 46 mln row, 3 variables, 900 mb size, R 2.13 on win7 64 machine.

Error in (off + 1):(off + len) : NA/NaN argument In addition: Warning messages: 1: closing unused connection 3 (T:/Research/DBs/CRSP_CUSIP/crsp_permno_tic

The other files are read ok. Don't know what to do.

Thanks a lot for your work!

Arsenio

arseniostaer avatar Aug 24 '12 00:08 arseniostaer

Never seen that error before. It could be due to the file size. Did it run for a bit before throwing an error?

Matt

On Thu, Aug 23, 2012 at 7:24 PM, arseniostaer [email protected]:

Hi Matt,

Found this error when using read.sas7bdat 0.2 on a win SAS x32 file, 46 mln row, 3 variables, 900 mb size, R 2.13 on win7 64 machine.

Error in (off + 1):(off + len) : NA/NaN argument In addition: Warning messages: 1: closing unused connection 3 (T:/Research/DBs/CRSP_CUSIP/crsp_permno_tic

The other files are read ok. Don't know what to do.

Thanks a lot for your work!

Arsenio

— Reply to this email directly or view it on GitHubhttps://github.com/BioStatMatt/sas7bdat/issues/1.

BioStatMatt avatar Aug 24 '12 00:08 BioStatMatt

Re: [sas7bdat] Error when reading in 46 mln row file (#1) Matt, The file itself is not big, 900 mb. I ran your package on 3-4 gigs sas7bdat files 2mln rows and 100+ vars with no problem, even if it took 30-60 minutes to read it in.  It ran for a while, maybe a minute?  As i said before, your package is a savior for SAS-R folks like me. Arsenio Thursday, August 23, 2012, 5:31:30 PM, you wrote: Never seen that error before. It could be due to the file size. Did it run  for a bit before throwing an error?  Matt  On Thu, Aug 23, 2012 at 7:24 PM, arseniostaer [email protected]

Hi Matt,    Found this error when using read.sas7bdat 0.2 on a win SAS x32 file, 46  mln row, 3 variables, 900 mb size, R 2.13 on win7 64 machine.    Error in (off + 1):(off + len) : NA/NaN argument  In addition: Warning messages:  1: closing unused connection 3 (T:/Research/DBs/CRSP_CUSIP/crsp_permno_tic    The other files are read ok. Don't know what to do.    Thanks a lot for your work!    Arsenio    —  Reply to this email directly or view it on GitHubhttps://github.com/BioStatMatt/sas7bdat/issues/1.     — Reply to this email directly or view it on GitHub. 

arseniostaer avatar Aug 24 '12 00:08 arseniostaer