MassBank-data icon indicating copy to clipboard operation
MassBank-data copied to clipboard

Upload and link raw mass spectral data

Open tsufz opened this issue 5 years ago • 22 comments

#MetSoc2019, Towards FAIR Spectral Libraries workshop. There is a request to make raw mass spectral files associated with MassBank records available for the public via any repository. Should be vendor's format, not mzML.

tsufz avatar Jun 24 '19 07:06 tsufz

Its already on the roadmap, but technical procedure is still undefined. We have this as WP in our next de.NBI funding period.

We can use this issue for discussion. You suggest any repository. This needs to be defined. I doubt that github is the right place because of the size of the data, because data might not be text based and will most likely not changed once it has been deposed.

meier-rene avatar Jun 24 '19 08:06 meier-rene

I have been using Zenodo a lot recently and am very happy so far - diverse datasets and very few issues (>56 datasets and only one failure on one file associated with one that I could solve in the end). I have not yet tried with larger datasets but it may be worth starting. Advantage for European sides: the cross-linking with OpenAIRE is nice for our reporting requirements. The other efficient alternative I could think of is GNPS MassIVE FTP links - we have this for our Swiss Wastewater study. Zenodo gives a DOI and authorship, cross linking and a whole lot more features on the repository side; MassIVE comes with all that GNPS offers if it works on your files (it didn't work on mine tho).

schymane avatar Jun 24 '19 08:06 schymane

We are also discussing internal possibilities here ... we would have the capabilities but they are not up and running even internally yet for us as a group, our BioCore are running this for others.

schymane avatar Jun 24 '19 08:06 schymane

I was just thinking about our UFZ repository for our records. However, they still not have DOI and thus the landing page and URL may change at any time....

tsufz avatar Jun 25 '19 05:06 tsufz

However, we may firstly indroduce a new tag for the linking or should be use the comment tag?

tsufz avatar Jun 25 '19 05:06 tsufz

If this is something we want to try to implement systematically, I would prefer a new tag rather than overloading the COMMENT field with too many diverse comments. Either e.g. a RAW_DATA entry in the first section, or SP$RAW_DATA?

schymane avatar Jun 25 '19 06:06 schymane

I would kind of like to use MassIVE or alternatively MetaboLights or MetabolomicsWorkbench so we don't fragment (pun intended) mass spec data over even more repositories. But if Zenodo is getting mass-spectrified already then I guess the argument is not so strong.

meowcat avatar Jun 25 '19 06:06 meowcat

Yes to considering MetaboLights and the MetabolomicsWorkbench but I have also heard a lot of feedback that it takes a while to get data into those two ...

schymane avatar Jun 25 '19 07:06 schymane

Does Metabolights store raw data (meaning ventors' format, not mzML)? Actually, we have to store both vendor and open format.... I will talk to Reza Salek to discuss opportunities.

tsufz avatar Jun 25 '19 08:06 tsufz

Yes, it does store raw data formats. Keeva from MetaboLights is also present at the Metabolomics2019 conference.

On Tue, 25 Jun 2019, 10:33 Tobias Schulze, [email protected] wrote:

Does Metabolights store raw data (meaning ventors' format, not mzML)? Actually, we have to store both vendor and open format.... I will talk to Reza Salek to discuss opportunities.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/MassBank/MassBank-data/issues/79?email_source=notifications&email_token=AARV56FQJWIWBCJFQIWGTZ3P4HJ45A5CNFSM4H23ZJPKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYPPGWY#issuecomment-505344859, or mute the thread https://github.com/notifications/unsubscribe-auth/AARV56C4PCLI5K7AEAMTAITP4HJ45ANCNFSM4H23ZJPA .

justinjjvanderhooft avatar Jun 25 '19 08:06 justinjjvanderhooft

Yes, it does store raw data formats. Keeva from MetaboLights is also present at the Metabolomics2019 conference. On Tue, 25 Jun 2019, 10:33 Tobias Schulze, @.***> wrote: Does Metabolights store raw data (meaning ventors' format, not mzML)? Actually, we have to store both vendor and open format.... I will talk to Reza Salek to discuss opportunities. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#79?email_source=notifications&email_token=AARV56FQJWIWBCJFQIWGTZ3P4HJ45A5CNFSM4H23ZJPKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYPPGWY#issuecomment-505344859>, or mute the thread https://github.com/notifications/unsubscribe-auth/AARV56C4PCLI5K7AEAMTAITP4HJ45ANCNFSM4H23ZJPA .

Thanks for the advice, I already contacted Keeva.

tsufz avatar Jun 25 '19 08:06 tsufz

If referencing one or more individual spectra in some repository, the PSI spectrum identifier could be used, which directly indexes individual scans in raw data: http://www.psidev.info/usi we need to find a few examples of prototypes already implementing this. Yours, Steffen

sneumann avatar Jun 25 '19 09:06 sneumann

Sebastian's request was to be able to obtain the input spectrum/spectra used in a record prior to processing. And MetaboLights can (also) store vendor data, see MTBLS297, Sciex MTBLS2, Bruker and some more if we search for them. Yours, Steffen

sneumann avatar Jun 25 '19 10:06 sneumann

As Example: These records were done by Michele from MTBLS38: https://msbi.ipb-halle.de/MassBank/Result.jsp?type=rcdidx&idxtype=site&srchkey=MetaboLights&sortKey=name&sortAction=1&pageNo=1&exec= where the raw data is in MTBLS38 and has been imported to GNPS: https://www.omicsdi.org/dataset/gnps/MSV000082791 and in particular ftp://massive.ucsd.edu/MSV000082791/ccms_peak/raw/MTBLS38/(-)-epigallocatechin.mzXML and I'll talk to Mingxun how to adress one particular scan in there.

sneumann avatar Jun 25 '19 14:06 sneumann

Response from Ming: https://massive.ucsd.edu/ProteoSAFe/usi.jsp#%7B%22usi%22%3A%22mzspec%3AMSV000082791%3A(-)-epigallocatechin%3Ascan%3A1000%22%7D

Using the identifier: mzspec:MSV000082791:(-)-epigallocatechin:scan:1000

and then it is left to RMassBank etc. to specify the actual scan(s) to link

sneumann avatar Jun 25 '19 15:06 sneumann

Here is a reference to the twitter conversation over the weekend: https://twitter.com/martiwag/status/1145011749554393089

Main outcomes:

  • GNPS now gives DOIs
  • Should try if we can integrate GNPS and Zenodo (=> reporting benefits for EU)
  • GNPS discussions to follow up with @mwang87
  • Alternatives also MetaboLights and MetabolomicsWB
  • Role of DFSP to be discussed within NORMAN
  • Metadata fields needed gnps_metadata

schymane avatar Jul 01 '19 07:07 schymane

Using the identifier: mzspec:MSV000082791:(-)-epigallocatechin:scan:1000

I think this would fit nicely

meowcat avatar Jul 01 '19 07:07 meowcat

For the record Zenodo has 50 GB uploads - or contact them for larger.

schymane avatar Jul 01 '19 07:07 schymane

Using the identifier: mzspec:MSV000082791:(-)-epigallocatechin:scan:1000

I think this would fit nicely

Yes, but to hyperlink this would be difficult, we are wondering whether this should go in a MS$RAW: GNPS COMMENT field, since to create a hyperlink to the dataset alone we just need the MSVXXXX number

schymane avatar Jul 01 '19 07:07 schymane

Metadata fieds in NORMAN DCTs: http://norman-data.eu/DCT_NTS.xlsx

=> sampling description sheet

schymane avatar Jul 01 '19 09:07 schymane

You beat me to it Emma!

On Mon, 1 Jul 2019, 11:35 Emma Schymanski, [email protected] wrote:

Metadata fieds in NORMAN DCTs: http://norman-data.eu/DCT_NTS.xlsx

=> sampling description sheet

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/MassBank/MassBank-data/issues/79?email_source=notifications&email_token=AARV56CQCFEFZTX7L3HKFVLP5HFXLA5CNFSM4H23ZJPKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODY5SFYQ#issuecomment-507192034, or mute the thread https://github.com/notifications/unsubscribe-auth/AARV56H2UFFTAK3ZUQWEMP3P5HFXLANCNFSM4H23ZJPA .

justinjjvanderhooft avatar Jul 01 '19 09:07 justinjjvanderhooft

Here is the way to link to MassIVE datasets: https://massive.ucsd.edu/ProteoSAFe/QueryMSV?id=MSV000084010 with the example of DOI: 10.25345/C50S8G

Thanks @mwang87

schymane avatar Jul 01 '19 14:07 schymane