python-swat
python-swat copied to clipboard
moving data from cas to data frame (pandas) takes forever . i have binary connection
trafficstars
I have dataset (2,3 gb) in cas and want to bring to data frame, so I can pandas . this takes more than 30 minutes. we have a large sas viya environment (6 TB cas). i am using a binary connection, so It should work with large(r) data. this is not big data.
command bring data from cas to a data frame. df= indata.to_frame()
why does this takes forever.
@witkophdw , Have you found the way to load larger castable into dataframe in faster way.?