haslr icon indicating copy to clipboard operation
haslr copied to clipboard

Short Homo Sapien Assembly from Genome in a Bottle Data

Open NTNguyen13 opened this issue 4 years ago • 10 comments

Hi, I'm trying HASLR using data from GIAB: https://github.com/genome-in-a-bottle/giab_data_indexes/tree/master/NA12878

  • All PacBio HIFI reads (~30X), cat into a single fastq.gz file.
  • Subsampled Illumina Short Reads from 300X to 55X, cat into 2 paired-end fastq files.

I used haslr with this command

haslr.py \
    -t 14 \
    -g 3g \
    -l $long_read \
    -x corrected \
    -s $short_read \
    -o ~/NA12878/Assembly_HASLR_55X_30X \

However, the result asm.final.fa only have 576MB in size, and only cover around 10% of the GRCh38, reported by QUAST. I even tried to increase genome_size option to 4G, and --cov-l from 25 to 30, but HASLR still generate exactly the same lr*x.fasta and asm.final.fa. I even tried using only cat on 2 original long read file, but the lr*x.fasta is still the same.

What have possibly go wrong in my case?

NTNguyen13 avatar Oct 26 '20 04:10 NTNguyen13

Hi,

I'm highly interested in the answer to this issue as I have exactly the same problem with very small final assemblies.

I would appreciated your help,

Thanks,

Maxime

CourcelleM avatar Oct 26 '20 09:10 CourcelleM

You might use kmergenie to estimate the „optimal“ k for the Illumina reads then try that instead of the default 49.

jelber2 avatar Oct 26 '20 11:10 jelber2

Thanks! I will try it out. However, I still don't understand why the long read subsampling produces the same file despite using 2 different long read files, or different subsampling threshold

NTNguyen13 avatar Oct 27 '20 02:10 NTNguyen13

After changing k=19 according to kmergenie, I got another error:

ERROR: "haslr_assemble" returned non-zero exit status

NTNguyen13 avatar Oct 27 '20 15:10 NTNguyen13

Are you sure kmergenie gave you a k=19? I was expecting something more like k~101 depending on the read length. Not sure about the new error.

jelber2 avatar Oct 27 '20 15:10 jelber2

@NTNguyen13 thanks for reporting low-sized final assembly, as well as the error with k=19. I'm going to follow the steps you have done and see if I can reproduce what you get. In general, if the average length of long reads is low I could expect to see more fragmented and lower-sized final assembly (this is because "shorter" long reads might not be able to connect distant unique short read contigs). However, I'm going to check if this is the case here. With regards to k=19, my suspicion is that contigs generated by Minia are very short and therefore not useful for HASLR. I'll try both cases and get back to you.

haghshenas avatar Oct 27 '20 16:10 haghshenas

NA12878_R1_15X_merge_kmer.dat.pdf

@jelber2 hi, this is the histogram of kmer size @haghshenas thank you for your support. I suspect that the problem come from using cat on fastq.gz file of CCS. I tried 3 screnarios:

  • #1 Using 1 original read: lr25x.fasta size is ~30GB
  • #2 Cat 2 original reads: lr25x.fasta size is ~5.2GB
  • #3 Cat all original reads: lr25x.fasta size is ~5.2GB. File content is exactly the same with the #2 scenario.

But I also tried using the lr25x.fasta of #1 scenario with short read k=19, it resulted in

[28-Oct-2020 09:56:26] aligning long reads to short read assembly using minimap2... failed
ERROR: "minimap2" returned non-zero exit status

Edit: I tried with k=49, it still gives non-zero exit status for minimap2

NTNguyen13 avatar Oct 28 '20 04:10 NTNguyen13

hi @haghshenas, I re-downloaded the Long read file, this time I use sra-toolkit to download the SRA files, then convert them to fastq to make sure all files are well-preserved.

However, the same problem about subsampling long read still persist:

    1. Set --cov-l 10, file size ~26.1 GB
    1. Set --cov-l 25, file size ~26.1 GB
    1. Set --cov-l 30, file size ~26.1 GB

NTNguyen13 avatar Nov 04 '20 09:11 NTNguyen13

for checking integrity of Long read fastq file, I aligned it to HG38 using minimap2, the coverage is around 30X, as expected.

image

NTNguyen13 avatar Nov 09 '20 03:11 NTNguyen13

Did this issue ever get resolved? I am also having very short genome assemblies compared to the reference genome.

iek avatar Sep 17 '21 17:09 iek