superhighway84 icon indicating copy to clipboard operation
superhighway84 copied to clipboard

Integrate with IPFS file management to share large content

Open a8underscore opened this issue 3 years ago • 3 comments

is there a solution to "Key: 'Article.Body' Error:Field validation for 'Body' failed on the 'max' tag"?

thank you

a8underscore avatar Dec 28 '21 00:12 a8underscore

Not right now, because I limited the the maximum post size, in order to avoid the database growing too fast too early.

There are a few considerations that need to be thought about before the database grows too big. At some point there probably has to be sharding in place, in order for people to still be able to use it without dealing with gigabytes of data.

Anyway, how big was the post you were trying to submit? Afair I limited it to ~512kb, which should be fair enough for text posts.

mrusme avatar Dec 28 '21 04:12 mrusme

I think it was a bit over 1GB

Maybe to help scaling, each "section" could be its own "file" (not sure how that works exactly, database?) that can optionally be downloaded?

a8underscore avatar Dec 28 '21 04:12 a8underscore

Oh, 1GB is certainly not going to work as an article. I see where you're coming from (the USENET, hehehe) but for this type of bin stuff we will need an integration with the IPFS file storage.

Ideally an article will only contain the hash to the file and make use of IPFS' file management capabilities to share/retrieve the file.

This is a rather complex topic (because integration needs to be really smooth, otherwise people will simply add a MEGA link to their article and call it a day) and more like something for the 0.1.0 or maybe even 1.0.0 version.

mrusme avatar Dec 28 '21 05:12 mrusme