Mehdi Z.

Results 4 comments of Mehdi Z.

[Bug]: Generation sometimes slows to a crawl for all requests when there is a DRY sampler request

I think this has to be expected, since DRY relies on purely CPU based operation. Aphrodite needs to process one request at a time for the CPU part of the...

[Bug]: Generation sometimes slows to a crawl for all requests when there is a DRY sampler request

@AlpinDale Thanks for your reactivity, very impressive ! I will look into it then. Also, do we agree that, as of now, the implementation considers the same `dry_sequence_breaker_ids` [for each...

[Bug]: Generation sometimes slows to a crawl for all requests when there is a DRY sampler request

Right now, I do not see issues compared to the ooba implementation, looks faithful to the ooba implementation (just noticed 2 typos, see comments)

[Bug]: Generation sometimes slows to a crawl for all requests when there is a DRY sampler request

@Nero10578 did [this PR](https://github.com/PygmalionAI/aphrodite-engine/pull/868) fix the issue on your end?