Lucas Kent

KafkaSinkCluster IncrementalFetchRequests/session_id with multiple partitions

1

kafka documentation on IncrementalFetchRequests/session_id https://cwiki.apache.org/confluence/display/KAFKA/KIP-227%3A+Introduce+Incremental+FetchRequests+to+Increase+Partition+Scalability Shotover currently does not properly handle Incremental FetchRequests with a topic containing multiple partitions. Consider the following scenario: 1. shotover routes a fetch request. 2....

When python producer terminates it generates this log in shotover (for whichever node it was connected to at the time i think: ``` 17 03:51:10 i495b4929 shotover-proxy[147000]: 2024-04-17T03:51:10.530285Z ERROR shotover::server:...

As per the spec: https://kafka.apache.org/protocol.html#sasl_handshake  When SaslHandshakeRequest is v0 it will send SaslAuthenticate messages without the kafka header or body, just the raw sasl message. Our implementation works fine...

I will do this as an example

prereq: https://github.com/shotover/shotover-proxy/issues/1609 This is part of https://github.com/shotover/shotover-proxy/issues/1507. Specifically the checkbox `swap single sinks to use SinkConnection::try_recv instead of SinkConnection::recv` Kafka has two sink transforms: KafkaSinkSingle and KafkaSinkCluster KafkaSinkCluster [has already...

This is made a lot easier now since pubsub support is now handled at the codec layer, instead of within RedisSinkSingle as it was originally implemented. Possibly it already works...

Port RedisSinkSingle to try_recv

1

closes https://github.com/shotover/shotover-proxy/issues/1609 Progress towards https://github.com/shotover/shotover-proxy/issues/1507 checking CI I hit a problem with `cassandra_int_tests::cassandra_redis_cache`. `SimpleRedisCache` will send requests into the same connection from two locations in the transforms logic. * One...

cassandra 5.0 vector type CREATE/INSERT support

5

makes progress towards: https://github.com/scylladb/scylla-rust-driver/issues/1014 The vector type is introduced by the currently in beta cassandra 5. See: https://cassandra.apache.org/doc/latest/cassandra/reference/vector-data-type.html Scylla does not support vector types and so the tests are setup...

metadata refresh is really expensive!

4

I am using scylla-rust-driver as the driver in a cassandra benchmark. When that benchmark reaches 60s passed, throughput roughly halves for a few seconds and I have tracked this down...

Updating to syn 2.0 is quite straightforward, just needed to change a field to a method call. I would appreciate a patch release after this is merged.