spikeinterface icon indicating copy to clipboard operation
spikeinterface copied to clipboard

export_to_phy() not respecting n_jobs

Open cheydrick opened this issue 9 months ago • 14 comments

The "Fitting PCA" step in the export to Phy process isn't respecting the n_jobs argument anymore.

I have set the global n_jobs parameter to 4 with: si.set_global_job_kwargs(n_jobs=4)

When using SpikeInterface from April 17 (commit hash 33d478ab9) I can see that only four cores are being used while export_to_phy() is running. fittingpca_Apr17

However, when using SpikeInterface from May 6 (commit hash 42e1f024a) the "Fitting PCA" step is saturating all cores: fittingpca_may6

Thanks, Chris [email protected]

cheydrick avatar May 07 '24 15:05 cheydrick