sqld icon indicating copy to clipboard operation
sqld copied to clipboard

Limits on payload size prevents taking db exports

Open avinassh opened this issue 2 years ago • 2 comments

A user in discord was not able to take export:

turso db shell mighty-night .dump > my_db.sql
Error: failed to execute SQL: SELECT * FROM 'users'
Response is too large

discord - https://discord.com/channels/933071162680958986/1146289112970707014

I believe it's due to the limits we have set on the payload size. I think we should add a better mechanism to take exports

avinassh avatar Aug 30 '23 05:08 avinassh

The .dump command implemented in libsql-shell-go could internally paginate results from the queries it issues.

CodingDoug avatar Aug 30 '23 13:08 CodingDoug

We should expose an endpoint for dumps that streams the dump instead. The .dump mega command should call that endpoint

MarinPostma avatar Sep 02 '23 18:09 MarinPostma