tidySingleCellExperiment icon indicating copy to clipboard operation
tidySingleCellExperiment copied to clipboard

Speed up `nest` and `unnest` for massive datasets in `tidySingleCellExperiment`

Open stemangiola opened this issue 2 years ago • 4 comments

There is an example in the tidyseurat repository of how we can speed out nesting for very simple use cases using the split and merge functionality of Surat

stemangiola avatar Jul 19 '23 05:07 stemangiola

@LiNk-NY this is one of the challenges I was mentioning.

stemangiola avatar Aug 07 '23 12:08 stemangiola

Hello, I would be happy to have a go at solving this.

william-hutchison avatar Aug 09 '23 01:08 william-hutchison

I have been able to considerably speed up nesting of a single column by using SingleCellExperiment's [] subsetting, but find my nested objects don't always cleanly unnest.

I will keep working at this, but if anyone else would like to have a go feel free! The changes I have made are available here for reference: https://github.com/william-hutchison/tidySingleCellExperiment/tree/master.

william-hutchison avatar Aug 10 '23 05:08 william-hutchison