check metrics before creating experiments

[mitchdraft]

in some cases, an experiment may be "Failed" before it begins. If the experiment is started, it won't be recalled until after one cycle of prometheus updates. Before creating experiments, first check that they are not already complete