modules icon indicating copy to clipboard operation
modules copied to clipboard

Unicycler nftest

Open FloWuenne opened this issue 1 year ago • 9 comments

PR checklist

Adds nf-test for unicycler module.

FloWuenne avatar Apr 30 '24 13:04 FloWuenne

@maxulysse as fast as lightning there

ngspp avatar Apr 30 '24 13:04 ngspp

Still need to finalize the nf-test output assertions. @maxulysse and I were troubleshotting that togther 😉 @ngspp

FloWuenne avatar Apr 30 '24 13:04 FloWuenne

@maxulysse as fast as lightning there

As I was saying to @FloWuenne, it's a mistake I made before, so it was an easy fix

maxulysse avatar Apr 30 '24 13:04 maxulysse

@FloWuenne you can add the other tests

maxulysse avatar Apr 30 '24 15:04 maxulysse

There seems to be an issue with the conda env. I have replicated outside of nextflow as well and get the same error. Don't know how to fix it at this point. Any ideas @JoseEspinosa @d4straub ?

FloWuenne avatar Apr 30 '24 18:04 FloWuenne

The problem with conda might be due to

The most significant one is that Unicycler now enforces that SPAdes cannot be a version later than v3.13.0. This is because after that version, SPAdes stopped saving intermediate files that Unicycler needs. Unicycler users that had later versions of SPAdes were getting suboptimal assemblies.

fixed in https://github.com/rrwick/Unicycler/releases/tag/v0.4.9. If that is the case, either using 0.4.9 instead of 0.4.8 or fixing spades version in the environment.yml might fix it. (Sorry, didnt test)

d4straub avatar May 02 '24 06:05 d4straub

@d4straub There is actually no package on bioconda or containers on quay.io biocontainers for version 0.4.9? Trying out 0.5.0 instead to see if that works! https://bioconda.github.io/recipes/unicycler/README.html

FloWuenne avatar May 02 '24 15:05 FloWuenne

So I tried running with version 0.5.0 both conda and Docker and actually both fail with test data!

=== ERRORs:
 * 0:00:02.379     6M / 136M  ERROR   General                 (kmer_coverage_model.cpp   : 187)   Invalid kmer coverage histogram, make sure that the coverage is indeed uniform
 * system call for: "['/workspace/modules/.nf-test/tests/ec5addf7ea2590db79a5c8d180299d3d/work/conda/unicycler-66b9a73317c352e54972e624abe20c82/bin/spades-core', '/workspace/modules/.nf-test/tests/ec5addf7ea2590db79a5c8d180299d3d/work/97/630766f4ff131b3da613cfc9a21f36/spades_assembly/K81/configs/config.info', '/workspace/modules/.nf-test/tests/ec5addf7ea2590db79a5c8d180299d3d/work/97/630766f4ff131b3da613cfc9a21f36/spades_assembly/K81/configs/isolate_mode.info']" finished abnormally, OS return value: 21

FloWuenne avatar May 02 '24 15:05 FloWuenne

Sorry for the misleading idea. Assemblers and small test data are often problematic in my experience. Unfortunately I dont have a better idea how to solve that.

d4straub avatar May 03 '24 06:05 d4straub

Any plan to get round this?

SPPearce avatar Jun 13 '24 20:06 SPPearce

@SPPearce I have to admit that I have no idea how to fix it at this point and unfortunately don't have time at the moment to dig deeper. If anybody has a good idea or lead how to fix this, would love some suggestions!

FloWuenne avatar Jun 13 '24 21:06 FloWuenne

@FloWuenne , I found some nanopore data for bacteroides_fragilis existed, works with just long reads only (short reads too seemed to take too long)

SPPearce avatar Jun 15 '24 17:06 SPPearce

Amazing @SPPearce ! Looks like all tests pass now. I won't merge because it's my PR, but I think your changes look good, so please feel free to merge yourself! 😊

FloWuenne avatar Jun 16 '24 11:06 FloWuenne

Hm, looks like it might have just taken too long to pull the singularity image in the CI? Testing now on Gitpod to see if it works there!

FloWuenne avatar Jun 18 '24 17:06 FloWuenne

I think it is a general connection issue yes, will probably sort itself out

SPPearce avatar Jun 18 '24 17:06 SPPearce

@SPPearce Just tested and yes singularity did work in Gitpod. Also removed the obsolete snapshots from main.nf.test.snap!

FloWuenne avatar Jun 18 '24 17:06 FloWuenne