FEDOT
FEDOT copied to clipboard
Make experiment for calculating overhead in using multiprocessing
Perform experiment:
- Run fitting n pipelines in multiprocessing mode
- Run fitting n pipelines in single process mode
- Calculate overhead for creating a process
I also have these thoughts:
- This experiment should be done as something reproducible (let's say, as a file in cases or examples) -- so we could run it on different systems if needed and later for new FEDOT versions. Thus we will be able to monitor performance improvements.
- Would be good to separate effects from multiprocessing from effects from cache. So trying to run same thing with & without OperationsCache seems a good idea.
- A good experimental question is: what's the minimum size of population to win the overhead and get real benefits?
All this would help to make performance improvements in FEDOT with much better understanding.
Results of experiments can be obtained here https://arxiv.org/abs/2301.05102