Spectra icon indicating copy to clipboard operation
Spectra copied to clipboard

MsBackendHdf5Peaks cannot load large mzML files simultaneously

Open plantton opened this issue 4 years ago • 2 comments

I'm currently using MsBackendHdf5Peaks backend to load several mzML files simultaneously:

fls <- "./*.mzML"  
sps <- Spectra(fls, source = MsBackendMzR(), backend = MsBackendHdf5Peaks(), hdf5path = getwd())

The average size of these mzML files is 600 to 700 MB. But the loading code above will simply freeze my desktop (16 GB RAM) after several minutes. One possible solution is to set BPPARAM = SerialParam() in the function, but then it's meaningless to set parallel processing parameter.

The maximum number of mzML can be read in parallel is 5 on my desktop.

plantton avatar Sep 23 '20 10:09 plantton