Improve selecting experiments for plots visualization

[mnrozhkov]

o show plots in VSCode, people need to select experiments to which they want to show plots. There are a few points we could improve to make UX better. This issue discusses some ideas.

Currently, there are two issues that require attention.

1. The experiment for the "workspace" is currently not being selected by default.
2. The number of experiments that can be visualized in plots is restricted to 7.

What is the problem?

Step 1 - After the first experiment run, I select my new experiment [rindy-kobs] to show plots. It works fine!

Step 2 - I run a new experiments, and see a second plot added from my new [based-tarp] experiment. So far it's great!

Step 3-5 - I run 5 more experiments... everything looks good

Step 6 - After more then 7 experiments, I can't see new plots automatically -

Starting from this point, the current behavior is not convenient anymore. When running a new experiment, I expect to see the corresponding plot - it's the first priority. Instead, for every new experiment, I need

• to uncheck the old one
• and select a new one

In my mind there are 2 scenarios that might improve the UX:

Scenario 1 - Only manual selection

1. Display plots only for the most recent experiment (workspace) by default.
2. Every time a new run is initiated, the previous experiment is automatically deselected. (This prevents the automatic increment of selected experiments.)
3. To ensure automatic plotting, the user must choose an experiment to keep it selected.

Scenario 2 - Automatically select the most recent experiment after 7 runs

1. Keep the current behavior until 7 experiments selected.
2. After that, for every new run initiated, the previous experiment is automatically deselected. Automatically select the most recent experiment
3. Keep "manual" selection for subsequent experiments

WDYT? How do you feel about this? Looking for your ideas and feedback 🙌