Allow configurable retry mechanism with exponential backoff

[mikasenghaas]

For large-scale evals against API models we often hit rate limits, would be nice to be able to configure exponential backoff with staggered delays etc.

[FedericoBonel]

Since many of these proposals would require some component search functionality, this might also be related to #186.

[renenielsendk]

@chrisvxd @FedericoBonel I would love the idea to override any of the proposals or outcome, since we probably wan't to display a modal popup with a visual rendering of the components

Example a '+' that opens

[FedericoBonel]

Awesome idea, thanks @renenielsendk!