BioNextflow icon indicating copy to clipboard operation
BioNextflow copied to clipboard

deeplexicon produces different demultiplexing results for GPU and CPU mode.

Open adalisan opened this issue 2 years ago • 8 comments

For the RNA samples I am running, demultiplexing gives significantly different results. GPU mode results has a lot more unknown assignments and very small number of bc3 barcoded reads. Meanwhile CPU mode produces much more reasonable results.

adalisan avatar Jul 10 '23 14:07 adalisan

Are you using cuda10?

lucacozzuto avatar Jul 12 '23 10:07 lucacozzuto

Hi!

Could you tell us in which GPU and cuda version are you currently running MoP? Thanks!

ADelgadoT avatar Jul 12 '23 10:07 ADelgadoT

Hi @adalisan , deeplexicon doesn't support never Nvidia architectures. Unfortunately the MoP team can't solve this.

lpryszcz avatar Jul 12 '23 15:07 lpryszcz

@lpryszcz oh... You should definitely have big WARNING messages for this. Despite a lot of experience with GPUs, I definitely did not expect this. Failing to do inference is one thing, but giving wrong results was definitely not within my expectations.

adalisan avatar Jul 13 '23 16:07 adalisan

Yes, I think I am using cuda 11 with a variety of GPU architectures, some are older and some newer

adalisan avatar Jul 13 '23 16:07 adalisan

It may be possible to use CUDA 10 in our environment using bash modules. Would that work, with the same deeplexicon containers?

adalisan avatar Jul 13 '23 16:07 adalisan

@lucacozzuto I agree we should warn the users about the issue. @adalisan we were trying to warn from the level of the program, but we couldn't make it feasible. what's really odd, when you execute deeplexicon without Docker, it fails nicely. but inside docker it runs and produces wrong results.

It may be possible to use CUDA 10 in our environment using bash modules. Would that work, with the same deeplexicon containers?

adding CUDA10 won't help, because support for newer architectures comes only in CUDA11, while deeplexicon was built against CUDA10. so until deeplexicon is updated, we can't really provide support for newer Nvidia GPUs. On the bright side, we're working on our own demultiplexing tool. so stay tuned.

lpryszcz avatar Jul 14 '23 10:07 lpryszcz

Thanks @adalisan - we have now updated this info in the DeePlexiCon README and added a WARNING as well as the requriement of CUDA v10. As @lpryszcz mentioned above, we will be releasing very soon (hopefully a couple of weeks) a new version of MasterOfPores (version 3) that contains a new demultiplexing algorithm that works with newer GPU architectures. Thanks!

enovoa avatar Jan 12 '24 21:01 enovoa