Out-of-memory Example/Explanation/Documentation

[samukweku]

I am linking to a question on SO, regarding out-of-memory datasets. I dont have the proper understanding to answer, and would also love to learn more about this. Tagging @st-pasha @oleksiyskononenko.

SO link

[st-pasha]

Out-of-memory datasets are those that stored on disk in Jay format. When you open such dataset, it does not load the data into memory - instead, all data remains on disk and then transferred into memory on the go as it becomes actually needed.

[GitHunter0]

@st-pasha , can you elaborate on that, is there some documentation available? Thank you