incense icon indicating copy to clipboard operation
incense copied to clipboard

Slow when loading many experiments over network

Open ondrejbiza opened this issue 3 years ago • 0 comments

Hi, thanks for maintaining this cool library!

One problem I have encountered is that loading hundreds of experiments, each with several metrics, takes a very long time when done over a network.

E.g. loading 300 runs takes around a minute for me.

I think the problem is that the library sends a request to retrieve metrics for each run separately. With 300 runs, loading the runs takes only around 5 seconds (one request) and the next 55 seconds (300 requests) are spent loading the metrics.

Would it be possible to load the runs and the metrics jointly with one request? MongoDB should be able to fill in the metrics by their object IDs automatically I believe.

Thanks, Ondrej

ondrejbiza avatar Jul 14 '20 18:07 ondrejbiza