python-swat icon indicating copy to clipboard operation
python-swat copied to clipboard

moving data from cas to data frame (pandas) takes forever . i have binary connection

Open witkophdw opened this issue 3 years ago • 1 comments
trafficstars

I have dataset (2,3 gb) in cas and want to bring to data frame, so I can pandas . this takes more than 30 minutes. we have a large sas viya environment (6 TB cas). i am using a binary connection, so It should work with large(r) data. this is not big data.

command bring data from cas to a data frame. df= indata.to_frame()

why does this takes forever.

witkophdw avatar Jun 30 '22 14:06 witkophdw

@witkophdw , Have you found the way to load larger castable into dataframe in faster way.?

spgathade avatar Apr 12 '23 08:04 spgathade