cardi icon indicating copy to clipboard operation
cardi copied to clipboard

Provide a "Zero data" storage backend to be storage provider agnostic

Open almereyda opened this issue 3 years ago • 4 comments

The https://unhosted.org movement gave birth to https://remotestorage.io and predated https://solidproject.org, which both provide agnostic storage options for frontend-only browser applications. This decouples the storage backend from commercial providers and is a lean self-hosting option.

Cardi would fit very well into the list of existing "zero data" apps that can be seen at https://0data.app/

Integration of these providers is very straightforward and allows to use simple web applications completely with free software, where no commercial providers are neccessary anymore. Maybe this is worth a look for Cardi?

almereyda avatar Mar 13 '21 23:03 almereyda

Hey I'm sorry I didn't notice this for a minute there, thanks for your comment!

Yeah in fact I just discovered those "zero data" style of projects a few weeks ago for the first time, which is the primary reason I didn't consider using one of them for Cardi 😛

Truly good idea to suggest these, and totally in line with what I'm trying to accomplish with this. The https://remotestorage.io in particular I did look into when I first learned about it, but, it actually seems like it'd be quite difficult to integrate with Cardi for the simple reason of being not oriented towards structured data whatsoever 😞 Seems more focused on files and blobs than tabular data with columns (which we do actually make quite a bit of use of with Cardi, like the primary/sort keys of DDB and the ability to fetch just a subset of rows based on an attribute filter).

While we could just store a huge JSON or SQLite file in there and pull the whole thing down every time you load Cardi, it'd actually be quite large as you get into the hundreds of notes.

That being said I'd still love to do something like this, since I agree it's a lot more sensible to ask people to hook up a Remote Storage account than to make some weird AWS creds, lol. I'll continue to think on it and let you know (or of course let me know if I've overlooked something)!

pickledish avatar May 15 '21 19:05 pickledish

I would be interested to hear what @rosano would have to say about this specific use case of a remote storage provider.

Note you can always also just store plain JSON files in a remote storage. Yet I understand there is a storage and data transfer capacity limit applying here.

In solidproject.org, this caveat is respected by defaulting to JSON-LD as structured data storage, with all overhead and goodies one gets from an RDF encoding of one's data.

almereyda avatar May 17 '21 14:05 almereyda

my way to implement/integrate would be to store each 'note' as a json object. we were just talking about the importance of databases in this context https://twitter.com/andy_matuschak/status/1393639509359665152, unfortunately might be far off but maybe for now you could bolt it on top of any 0data protocol (i mentioned sqlite via webassembly in the thread).

rosano avatar May 17 '21 14:05 rosano

Thank you for the pointers!

On Mon, 17 May 2021 at 16:53, Rosano @.***> wrote:

my way to implement/integrate would be to store each 'note' as a json object. we were just talking about the importance of databases in this context https://twitter.com/andy_matuschak/status/1393639509359665152, unfortunately might be far off but maybe for now you could bolt it on top of any 0data protocol (i mentioned sqlite via webassembly in the thread).

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/pickledish/cardi/issues/2#issuecomment-842390352, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAMRV7BVNK5WAHCBW4XSKLTTOEUVTANCNFSM4ZEJVN6Q .

almereyda avatar May 17 '21 19:05 almereyda