tinyows icon indicating copy to clipboard operation
tinyows copied to clipboard

Retrieve (big) data chunked from database

Open ocourtin opened this issue 13 years ago • 2 comments

Right now PostgreSQL is called in GetFeature with a single request, could be interresting to find a way to retrieve datas in several pieces, and so to begin to send them back to client earlier.

At least for quite big dataset.

ocourtin avatar Nov 14 '12 22:11 ocourtin

For big results in general, if you don't do a bunch of FETCH calls you'll end up with the whole result set sent to the client and then iterated on, which could blow out memory if your limits are small enough.

pramsey avatar Nov 14 '12 22:11 pramsey

You're right Paul ! Right now network is the first bottleneck, but definitly not a reason to not improve it...

ocourtin avatar Nov 15 '12 08:11 ocourtin