Ensure ability to use AWS S3 compatible data stores
S3 is not just AWS's protocol but a protocol for many other systems. Dolt's support for S3 compatible apis would be great.
Like you want to be able to push to a remote from Dolt that has an S3 compatible API? And you want that supported in the remote syntax? Can you give us an example of one you want that we can build to?
https://www.s3-client.com/s3-compatible-storage-solutions.html
Here's a list.
I would start with https://min.io/
Dolt's S3 storage requires Dynamo as well, to store manifest contents. In order for S3 compatible storage offerings to work, we would need to implement a file-based s3 manifest, as is currently the case with GCS remotes.
@timsehn Any update on this?
@timsehn Any update on this?
We support S3, filesystem, GCS, and a custom remote server called remotesrv. We don't have much demand for more supported remote types.
https://docs.dolthub.com/sql-reference/version-control/remotes
just +1'ing here as someone exploring dolt. I'd love a more generic s3/ MinIO compatible remote (supposing this would have to be added as a new nbs/blobstore). This doesn't look overly difficult to write given the others already implemented and would be a huge value.