bowtie2 icon indicating copy to clipboard operation
bowtie2 copied to clipboard

SwAligner::alignGatherEE16 trying to alloc 32TB in expandCopyExact

Open tuxsoft opened this issue 1 year ago • 1 comments

I have absolutely no knowledge in this field, but I tired to help someone who is getting a crash when trying to sequence some data. (Linux X86_64) I could tell alloc() failed, so I added a swapfile of 32GB thinking it would solve the issue to no avail. After building from src and debugging I discover the cause is a crazy 32TB alloc() request.

The data is: https://ftp.ncbi.nlm.nih.gov/genomes/all/GCA/014/183/145/GCA_014183145.1_ASM1418314v1/GCA_014183145.1_ASM1418314v1_genomic.fna.gz

The index files seem to create okay and have no problems. I tried both the query input FASTA from ncbi.nlm.nih.gov and one I created from the Index files with the same result.

tuxsoft avatar Aug 07 '22 19:08 tuxsoft

I am not sure how that happened. I went ahead and built the same index and my peak memory footprint was 1.3GB. This was with the optimised binary. I would expect the debug build to use slightly more than that since it performs sanity checks, but not to the extent of consuming 32TBs worth.

ch4rr0 avatar Nov 09 '23 19:11 ch4rr0