Jeffrey Martin

@OJ, can you provide env details to compare? What as the goal with RMI that you hit an issue with? Can you offer expected results if enhanced vs current result?...

@pedramamini, did you include passing `max_tokens` in your json config? Can you offer details on when this occurs? Possibly specific targeted models and probe combinations. Comparable reports may also give...

The original intent of this may have been addressed in the plugin processing refactors from #711 and #768. Further evolution of the plugin cache can add more tests to document...

I suspect this is related to error handling and backoff. When run based on the example, this I am not reproducing the `400` error and the probe runs for 12...

Related to #768, #479

As to item 1, I suspect some invalid configuration could be evaluated prior to download however many of options that could produce exceptions or errors require the model files to...

There is an important caveat here, `api_key` and other `key` values should be masked to avoid placing sensitive data in logs, especially if the logging here is desired to be...

Additional recommended revision of note, as the generator has been revised to `supports_multiple_generations = False` the code in the class can be significantly simplified to remove accounting for `COHERE_GENERATION_LIMIT` as...

I would like the `static` dataset behaviour to stay consistent once released, the paper author's feedback received suggested multiple variations of past tense phrasing maybe a minimum requirement. @leondz maybe...

I would suggest automatically utilized files should stick to one format and support for others format requires explicit filename with extension. Official project packages should not ship with ambiguous file...