scylla-tools-java icon indicating copy to clipboard operation
scylla-tools-java copied to clipboard

[cassandra-stress] c-s should be able to handle OverloadedException

Open fruch opened this issue 1 year ago • 2 comments

The error says "java.io.IOException: Operation x10 on key(s) [32374c4b364e33324e30]: Error executing: (OverloadedException): Queried host (127.0.83.1/127.0.83.1:9042) was overloaded: Too many in flight hints: 10485991".

on cases of such errors, c-s should throttle back given this error. see https://github.com/scylladb/scylla-enterprise/issues/3306#issuecomment-1706529424

@bhalevy maybe you want to elaborate what is means ? c-s should apply a rate-limiting, where the rate limit should be taken from ?

fruch avatar Sep 05 '23 13:09 fruch

I really don't know if we want to maintain CassandraStress and develop such features for it. We should have our own load generator in Python that we can fully control for dtests.

bhalevy avatar Sep 05 '23 13:09 bhalevy

The code is there in the driver, but I'm unsure what the behavior is. https://github.com/scylladb/java-driver/blob/d291df6b35f7903c0b2d935754aebcb5b35bcd81/driver-core/src/main/java/com/datastax/driver/core/Responses.java#L40

mykaul avatar Sep 05 '23 14:09 mykaul