bugbug
bugbug copied to clipboard
[code_review] Generate comments with multiple models/configs or multiple approaches
An ensemble to generate more comments, with a filtering step to only output actually unique ones. For example, GPT-4o + Mistral. Or, GPT-4o with the patch in the default order + GPT-4o with the patch in random order.
https://github.com/mozilla/bugbug/commit/4028e2dec9c56c9c0022d5e5138eaed3f363df79 was the first step for this.
This depends on #4580 for the evaluation. This also depends on #4582 and #4587 to choose what to put in the mix.