SLEEP documentation missing?

[benepo]

The dat paper mentions a data format called SLEEP and references "it's own paper" but I can't find that paper or details on it. Is SLEEP a proprietary format for just metadata used internally by dat or chunked source data similar to how HDFS stores raw data?

[derhuerst]

There is more information in sleep.md. Also, it appears that the sleep part has been moved out recently.

[benepo]

Thanks! So SLEEP is just for metadata or does it encode the payload data as well? Some documentation says it's 9 files but the documentation you provided says 1 (sleep.dat)

P.S. The @sleep link in the readme.md doesn't resolve to an actual link for some reason.

[joehand]

So SLEEP is just for metadata or does it encode the payload data as well? Some documentation says it's 9 files but the documentation you provided says 1 (sleep.dat)

Sorry, the SLEEP docs are still a bit wip. Sleep is 9 files and the payload data is optionally included. By default in SLEEP, the content is stored in a single append-only file. But you can also store the files data "as files", so you can access them as normal files.

Dat aims to make it easy to plug in other storage formats, none of the formats are proprietary. For instance, you can plug in an http storage provider: https://github.com/datproject/dat-http