kalepy icon indicating copy to clipboard operation
kalepy copied to clipboard

Multithreading

Open apereiroc opened this issue 2 years ago • 1 comments

Hi, thanks for this very powerful package. My analysis group and I are trying to incorporate it into one of our LHCb analyses, the results are very promising.

However, we are missing a multithreading functionality. We have to deal with many millions of events and this can take many hours or days in a single core. I managed to add myself a numba parallel range inside kernels.py/_evaluate_numba function, but would be great to have an option in the constructor or an additional method (or whatever) to do this automatically.

apereiroc avatar Jun 09 '22 15:06 apereiroc

Hi @apereiroc I'm glad to hear the package is working well for you! This is an excellent idea, and something I really hadn't thought much about so far. So far, the package overall has had very minimal speed optimization, which I think is very important to work on. Any implementations/recommendations you have are very welcome either as general ideas or specific code PRs!

lzkelley avatar Jun 10 '22 16:06 lzkelley