scarches icon indicating copy to clipboard operation
scarches copied to clipboard

Speed improvement

Open moinfar opened this issue 2 years ago • 2 comments

Speed improvement in:

  1. Data Splitting (scPoli when cell_types are available)
  2. Ptorch data loader: Now we fetch cells in batches when using MultiConditionAnnotatedDataset rather than cell-by-cell and then combining them in custom_collate. This may result in significant dataloader speedup, especially when loading sparse data.

moinfar avatar Oct 27 '23 15:10 moinfar

Hi! what's the status here? can this be merged?

jan-engelmann avatar Mar 13 '24 14:03 jan-engelmann

@moinfar sorry for being slow on this. Have you rerun the scpoli tutorials with this PR to check that everything is fine?

Koncopd avatar Apr 05 '24 11:04 Koncopd