RATTLE icon indicating copy to clipboard operation
RATTLE copied to clipboard

Segmentation Fault in Correcting Step

Open qhauck16 opened this issue 4 years ago • 20 comments

Hi, I'm attempting to use rattle on multiple fastq files from cDNA (actually, the files come from a bam file back-converted into a fastq using bedtools bamToFastq, as I'm interested in a specific set of reads). Anyways, I have been able to run the clustering step fine on multiple of these files after filtering using the code commented on another issue (I was originally having the std:bad alloc error), but the ./rattle correct step throws a segfault:

Reading fasta file... Done
Segmentation fault (core dumped)                                                 ] 1154/147477 (0.782495%)

I am not very experienced at reading fastq files, as I have only recently begun working with them, but as far as I can tell, the fastq files have no obvious issues at the read number indicated by the number it fails at (the same number is consistently the issue when run with one thread)

Any help is appreciated! Best, Quinn

qhauck16 avatar Aug 09 '20 06:08 qhauck16

Hi!

The easiest way for me to debug this is to get the fastq file. Is it possible in this case?

Thanks

novikk avatar Aug 09 '20 14:08 novikk

Yes, how should I contact you?

qhauck16 avatar Aug 09 '20 17:08 qhauck16

You can send it via email to ivan.delarubia at upf.edu

Thanks!

novikk avatar Aug 09 '20 17:08 novikk

Hey, just thought I'd chip in to mention I've seen a similar problem. Segfault within the first second of running rattle correct:

Reading fasta file... Done Segmentation fault (core dumped)

Happy to send fastq along to the email address you gave above if useful. It's a subsampled file so only 50,000 ONT reads.

claumer avatar Aug 10 '20 22:08 claumer

Thank you! It helps to perform clustering. But the next step again gives the error:

Reading fasta file... Done
Segmentation fault (core dumped)

My command was: extract_clusters -i my_linux_modified.fastq -c clusters.out -o clusters

Kirovez avatar Aug 14 '20 08:08 Kirovez

Hi @Kirovez , remember to add the "--fastq" flag.

In the upcoming updates this won't be necessary but it is still required right now.

novikk avatar Aug 14 '20 10:08 novikk

Hi, I had the same problem mentioned above in the "rattle correct" step:

Reading fasta file... Done Segmentation fault (core dumped)

Did you find the solution to this issue?

Thanks!

pfrank76 avatar Sep 22 '20 09:09 pfrank76

Hi,

The problem was not solved, unfortunately. I tried several ways but the error is still there ( If you find the solution, please, let me know as well.

Regards!

Ilya

https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail Без вирусов. www.avast.ru https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

вт, 22 сент. 2020 г. в 12:47, pfrank76 [email protected]:

Hi, I had the same problem mentioned above in the "rattle correct" step:

Reading fasta file... Done Segmentation fault (core dumped)

Did you find the solution to this issue?

Thanks!

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/comprna/RATTLE/issues/18#issuecomment-696618531, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEJVWPA2O4OPFMQKOBI7QITSHBXCVANCNFSM4PZBLJTA .

--

Dr. Ilya V. Kirov, PhD

Principal Investigator | @ilyavkirov https://twitter.com/ilyavkirov

{ All-Russia Research Institute of Agricultural Biotechnology, Laboratory of marker-assisted and genomic selection of plants, Timiryazevskaya str., 42, 127550, Moscow, Russian Federation };

Kirovez avatar Sep 22 '20 09:09 Kirovez

Hello, I ran into a similar issue during the correcting step. @novikk do you have any advice/updates on fixes coming to rattle?

bauerlev avatar Apr 01 '21 20:04 bauerlev

I believe I am facing a similar challenge using cDNA data. Any fixes yet?

eKariuki-sleepy avatar Sep 27 '21 11:09 eKariuki-sleepy

Thanks for the message. We're looking into it. E.

On Mon, 27 Sept 2021 at 21:56, Eric G. Kariuki @.***> wrote:

I believe I am facing a similar challenge using cDNA data. Any fixes yet?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/comprna/RATTLE/issues/18#issuecomment-927800586, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADCZKB7N43EL4K7RCTG7UQTUEBLXBANCNFSM4PZBLJTA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

-- Prof. E Eyras EMBL Australia Group Leader The John Curtin School of Medical Research - Australian National University https://github.com/comprna http://scholar.google.com/citations?user=LiojlGoAAAAJ

EduEyras avatar Sep 27 '21 12:09 EduEyras

Hi all,

In case anyone still watching this issue. We have an update to fix this issue now.

Thanks, Eileen

eileen-xue avatar Mar 29 '22 03:03 eileen-xue

Hi,

The RATTLE should work with GCC version 9.3.

Could you please provide your RATTLE command line to give us more information? This can help us better diagnose the issue.

Thanks, Eileen

On Tue, 26 Jul 2022 at 06:18, Levi Lee @.***> wrote:

Hello, I believe I'm running into this same issue. Doess the GCC version need to be exactly 9.4.0? I've tried with 9.3 and 10.1 and both fail. I've also tried with varying numbers of CPUs and varying RAM. Do you have any troubleshooting tips for me?

— Reply to this email directly, view it on GitHub https://github.com/comprna/RATTLE/issues/18#issuecomment-1194577359, or unsubscribe https://github.com/notifications/unsubscribe-auth/AJUKNU3TLIE3QGDNQ4MV4ELVV3ZCTANCNFSM4PZBLJTA . You are receiving this because you commented.Message ID: @.***>

eileen-xue avatar Jul 25 '22 23:07 eileen-xue

Eileen, here is my script. I've given the job 10 cores and 50G of memory. For clarification the error I'm receiving is an "Illegal instruction (core dumped)"

ml GCCcore/10.1.0 ml GCC/10.1.0

mkdir clusters_extracted clusters_corrected2

RATTLE/rattle cluster -i coff_filt_cdna_genespace.fastq.gz -t 10

RATTLE/rattle extract_clusters -i coff_filt_cdna_genespace.fastq.gz -c clusters.out -o clusters_extracted/ --fastq

RATTLE/./rattle correct -i coff_filt_cdna_genespace.fastq.gz -c clusters.out -o clusters_corrected2/ -t 10

bauerlev avatar Jul 27 '22 19:07 bauerlev

Hi Levi,

Try to use the gcc version 9.3.0. Also, which CPU do you use? Does it support sse4.1? RATTLE sub-module spoa has this error "Illegal instruction (core dumped)" with some old processors.

Thanks, Eileen

eileen-xue avatar Jul 28 '22 02:07 eileen-xue

Thank you for this tip! It's hard to tell what CPUs I'm using as I run my jobs on a large university hpcc, but I was able to play around and find a dev-node that ran the toy dataset and run the job using those resources. Also learned that "illegal instruction" in general indicates software incompatibility for all programs which was a good lesson to learn.

bauerlev avatar Aug 04 '22 18:08 bauerlev

hi, I'm also experiencing Segmentation fault (core dumped) during with rattle correct (the latest version from github). I tried on two different computers, both with SSE4.1 support and GCC v9.4. The same error happens with toy dataset. The commands I'm using

s=test.rna; f=~/src/RATTLE/toyset/rna/input/sample.fastq
mkdir -p rattle/$s/clusters
~/src/RATTLE/rattle cluster -t 4 --rna --iso -i $f -o rattle/$s/clusters
~/src/RATTLE/rattle correct -t 4 -i $f -c rattle/$s/clusters -o rattle/$s
~/src/RATTLE/rattle polish -t 4 -i rattle/$s/consensi.fq -o rattle/$s 

lpryszcz avatar Oct 13 '23 12:10 lpryszcz

Hi,

In your RATTLE correct command, it should be -c rattle/$s/clusters/clusters.out which points to clusters.out file location, not the folder location.

Eileen

eileen-xue avatar Oct 13 '23 12:10 eileen-xue

thank you! pointing to clusters.out works. could rattle report more meaningful I/O error?

lpryszcz avatar Oct 13 '23 13:10 lpryszcz

RATTLE checks whether the input and output files or folder exits and provides error report. However, it won't check whether it points to a file or a folder.

eileen-xue avatar Oct 16 '23 02:10 eileen-xue