AnnotSV icon indicating copy to clipboard operation
AnnotSV copied to clipboard

VCF field format issue

Open gevro opened this issue 1 year ago • 27 comments

Hi, The new AnnotSV VCF output format has an issue -- many numeric fields are being given Type=String. This breaks downstream pipelines that then do not allow proper numeric type filtering on "String" fields.

For example: ##INFO=<ID=B_inv_AFmax,Number=1,Type=String... ##INFO=<ID=B_gain_AFmax,Number=1,Type=String...

Can you please fix this?

Thanks

gevro avatar Aug 11 '23 17:08 gevro

Hi,

Unfortunately, I can't help you with such an issue. The VCF output is produced with variantconvert. Can you switch and create an issue on the variantconvert GitHub?

Best, Véronique

lgmgeo avatar Aug 17 '23 09:08 lgmgeo

Ok

gevro avatar Aug 17 '23 17:08 gevro

Hi, I am reaching out to variantconvert, on this issue (https://github.com/SamuelNicaise/variantconvert/issues/27), but am not hearing back. Is there another way to fix this bug?

gevro avatar Oct 20 '23 02:10 gevro

I contacted the author, I know he is actively working on a new version. He should give you an answer quickly.

lgmgeo avatar Oct 20 '23 08:10 lgmgeo

Hello, I'm curious if you heard an update about this?

gevro avatar Oct 27 '23 11:10 gevro

yes, but unfortunately I don't have any time slot to provide...

lgmgeo avatar Oct 28 '23 18:10 lgmgeo

The variantconvert developper expects a fix to be available by the end of the year at worst. https://github.com/SamuelNicaise/variantconvert/issues/27#issuecomment-1784828701

lgmgeo avatar Oct 31 '23 09:10 lgmgeo

Hi, The above issue with variantconvert has still not been fixed which makes it very hard to use the VCF output of annotSV. I'm having trouble having a response there. Is there any other way to address this issue? Thanks!

gevro avatar Feb 05 '24 17:02 gevro

This bothers me a lot, but I don't have the skills to debug this. It's really specific to variantconvert. I will ask the developer if this can be done quickly.

lgmgeo avatar Feb 05 '24 19:02 lgmgeo

Thanks for the new version! Any news on the variantconvert bug?

gevro avatar Feb 20 '24 17:02 gevro

variantconvert: A new version should be posted in 1 or 2 weeks

lgmgeo avatar Feb 20 '24 18:02 lgmgeo

Is there a different way for annotSV to generate VCF either with a different tool or writing this to be part of annotSV?

Because it doesn't seem that variantconvert is being maintained anymore, and I doubt that the bug fix will be made.

Thanks

gevro avatar Mar 20 '24 16:03 gevro

I don't know any other tool to generate VCF.

If variantconvert is not updated, I will take the time to develop a module to generate VCFs this summer.

lgmgeo avatar Mar 21 '24 07:03 lgmgeo

Ok thank you!

gevro avatar Mar 21 '24 14:03 gevro

Hi, Variantconvert was finally updated: https://github.com/SamuelNicaise/variantconvert/issues/27#issuecomment-2063711704

Can you now incorporate this into the next version of AnnotSV? When might that be? Thanks!

gevro avatar Apr 18 '24 14:04 gevro

Yes, that's great. variantconvert version 2.0.0 is posted and this should fix the bug. I'm going on vacation this evening. I'll take care of it when I get back.

lgmgeo avatar Apr 19 '24 08:04 lgmgeo

AnnotSV 3.4.1 is posted with an updated version of variantconvert (v2.0.1).

The variantconvert conversion mode can be set by the user in AnnotSV (see the -variantconvertMode options). Instead of combining all full and split annotations (default mode: combined), variantconvert can represent each full or split annotation on one line (mode: full&split), or only "full" annotation can be kept (mode: full).

Regarding on your needs, please set the -variantconvertModeoption to full or fullsplit.

Can you confirm that this fixes your bug?

lgmgeo avatar May 06 '24 13:05 lgmgeo

Thanks! I will check

gevro avatar May 06 '24 13:05 gevro

Hi, any news?

lgmgeo avatar May 27 '24 06:05 lgmgeo

We will test in a few days

gevro avatar May 27 '24 11:05 gevro

Is there a way to upgrade annotSV while keeping our custom annotations / configurations and also the genecards annotation?

gevro avatar May 27 '24 20:05 gevro

Sorry, no way to do a "real" upgrade.

You need to install the new version:

make PREFIX=. install

Then:

  • Either use your previous annotations with the -annotationsDir option.
  • Or install the annotations de novo with:
make PREFIX=. install-human-annotation

and replace the $ANNOTSV/share/AnnotSV/Annotations_Human/Users/ directory with the previous one as well as the $ANNOTSV/etc/AnnotSV/configfile with the previous one.

lgmgeo avatar May 28 '24 06:05 lgmgeo

Using the latest annotSV version, for some reason it is not finding variantconvert. Python 3.9 is giving an error that it couldn't find the variantconvert module.

gevro avatar May 28 '24 13:05 gevro

Does the following directory exist?

ls -l $ANNOTSV/share/python3/variantconvert

Can you show me the complete output?

lgmgeo avatar May 28 '24 13:05 lgmgeo

Yes it does. I already deleted the log so I don't have the complete output.

What I have done is I now went into this directory: $ANNOTSV/share/python3/variantconvert

and then I ran pip install -e .

Would this be an ok attempt to fix the problem?

gevro avatar May 28 '24 13:05 gevro

This step should be done when running AnnotSV for the first time and this should create the $ANNOTSV/share/python3/variantconvert/pipinstall.flag file. Can you give me the content of this file?

lgmgeo avatar May 28 '24 13:05 lgmgeo

The first time I ran it I had python 3.8. I think that explains the error.

But then the next time I ran it, I had python 3.9 but it couldn't find variantconvert.

Is it possible that the prior error pipinstall.flag makes AnnotSV think that it installed even though it didn't?

In that case, is my fix of manually installing it ok? Or should I uninstall variantconvert and try again?

Defaulting to user installation because normal site-packages is not writeable
Obtaining file:///gpfs/data/evronylab/bin/AnnotSV/share/python3/variantconvert
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
ERROR: Package 'variantconvert' requires a different Python: 3.7.2 not in '>=3.8'
WARNING: You are using pip version 20.2.2; however, version 24.0 is available.
You should consider upgrading via the '/gpfs/share/apps/python/cpu/3.7.2/bin/python3.7 -m pip install --upgrade pip' command.

gevro avatar May 28 '24 13:05 gevro

I think I will just uninstall variantconvert and delete the pipinstall.flag file and rerun and see if that works.

gevro avatar May 28 '24 13:05 gevro

Ok that seems to have fixed the problem.

gevro avatar May 28 '24 14:05 gevro

Is it possible that the prior error pipinstall.flag makes AnnotSV think that it installed even though it didn't?

Absolutely

In that case, is my fix of manually installing it ok?

Yes

I think I will just uninstall variantconvert and delete the pipinstall.flag file and rerun and see if that works.

Perfect too

In your output, I see:

ERROR: Package 'variantconvert' requires a different Python: 3.7.2 not in '>=3.8'

Python 3.8 is required. This seems not to be the case on your run.

lgmgeo avatar May 28 '24 14:05 lgmgeo