python-swat icon indicating copy to clipboard operation
python-swat copied to clipboard

no data limit when using to_frame

Open pestyld opened this issue 4 years ago • 2 comments
trafficstars

When you use to_methods like to_csv, or any of the plotting methods on a CAS table the swat.options.cas.dataset.max_rows_fetched options limits to the default of 10,000. This makes sense to prevent you from pulling an extremely large table to the client.

However, when I use the to_frame method the option does not take effect and CAS attempts to transfer the entire CAS table to the client into a DataFrame. When the table is large it causes the following error:

SWATError: Unable to connect to any URL in the list

Which causes my CAS server to reset and removes all promoted CAS tables. Seems like the data limit should apply to the to_frame method as well.

pestyld avatar Nov 03 '21 22:11 pestyld

Thank you for the suggestion. I will look into it.

bkemper24 avatar Jan 20 '22 18:01 bkemper24

When using to_frame(). Getting JSONDecodeError while fetching larger CASTable. CASTAble has more than 10 lakh rows.

spgathade avatar Apr 11 '23 14:04 spgathade