What is the max number of engines supported in a cluster?

[DavidIRoitman]

Hi,

I couldn't find the answer in the docs so asking here. What is the max number of engines I can run simultaneously in my cluster? I don't mean in one server, but in the entire cluster.

Thanks.

[minrk]

"supported" is a tough word, but it really depends on your task size and resources available. IPP behaves reliably in most circumstances with ~100 engines, but some folks use it up to 1k with sufficient tuning and appropriate configuration. I wouldn't recommend using ipyparallel much beyond that.