python-swat
python-swat copied to clipboard
no data limit when using to_frame
When you use to_methods like to_csv, or any of the plotting methods on a CAS table the swat.options.cas.dataset.max_rows_fetched options limits to the default of 10,000. This makes sense to prevent you from pulling an extremely large table to the client.
However, when I use the to_frame method the option does not take effect and CAS attempts to transfer the entire CAS table to the client into a DataFrame. When the table is large it causes the following error:
SWATError: Unable to connect to any URL in the list
Which causes my CAS server to reset and removes all promoted CAS tables. Seems like the data limit should apply to the to_frame method as well.
Thank you for the suggestion. I will look into it.
When using to_frame(). Getting JSONDecodeError while fetching larger CASTable. CASTAble has more than 10 lakh rows.