qiskit-machine-learning icon indicating copy to clipboard operation
qiskit-machine-learning copied to clipboard

Published 20 hours ago • verified publisher icon qiskit-community

Memory Error while using VQC

Open Ilyaant opened this issue 1 year ago • 3 comments

Hello! While fitting VQC on a (3599, 20) training dataset I faced the following exception:

MemoryError: Unable to allocate 1.64 GiB for an array with shape (1048576,) and data type <U420

Could you please explain the error to me? I'm working on a machine with 120 GB of RAM and don't understand how the program cannot allocate 1.64 GB. Is there a way solve the problem?

The idea I have is to divide the dataset into smaller parts and fit the VQC on them. But here's another question: can I call the fit() method multiple times on different data chunks, or will the model be training from scratch each time?

Still, I don't like this idea, I'd want to do something with the memory usage limitation. Thank you!

Ilyaant avatar Oct 03 '24 21:10 Ilyaant