EdgeML icon indicating copy to clipboard operation
EdgeML copied to clipboard

process_google.py MemoryError

Open pushkalkatara opened this issue 4 years ago • 1 comments

The script process_google.py reads all the .wav in a numpy array which might cause a memory error on many systems. Either use of disk storage through numpy.memmap or storing array as .HDF5 with PyTables or use of some library like Pandas might solve this issue.

pushkalkatara avatar Aug 21 '19 13:08 pushkalkatara

Error reproduction

Traceback (most recent call last):
  File "process_google.py", line 257, in <module>
    numFilt, samplerate, winlen, winstep)
  File "process_google.py", line 173, in extractFeatures
    allSamples = np.zeros((len(fileList), maxlen))
MemoryError

pushkalkatara avatar Aug 21 '19 13:08 pushkalkatara