superduper icon indicating copy to clipboard operation
superduper copied to clipboard

Model inputs unloaded to memory

Open kartik4949 opened this issue 1 year ago • 1 comments

Model inputs are loaded in memory i.e if there is a 100 million documents collection. For a model to run on it, we load all documents on memory before passing it to the model.

kartik4949 avatar Dec 30 '23 19:12 kartik4949

Please add more details: which methods/ classes are the primary offenders? You may even add some code-snippets here.

blythed avatar Jan 01 '24 11:01 blythed