Avi Kivity

ScyllaDB has O(nr_nodes * 3 * nr_service_levels) connections per shard, and the same number of incoming connections. With 100 nodes, 100 shards, we have 60,000 connections. We can afford at...

Cross-AZ traffic is actually more expensive. Cross-AZ costs 1c per direction, so 2c/FB. Cross-region costs 2c/GB, but ScyllaDB sends one cross-region message for inter-region replication and (at least) two cross-zone...

Perhaps we should be offloading this. VPNs support compression. I don't know if the compression is per-packet or streaming (in TCP mode). https://openvpn.net/community-resources/reference-manual-for-openvpn-2-4/.

> > ScyllaDB has O(nr_nodes * 3 * nr_service_levels) connections per shard, and the same number of incoming connections. > > With 100 nodes, 100 shards, we have 60,000 connections....

What about reducing the compression level? won't that reduce memory requirements?

Thanks. We have an ongoing discussion (you were mentioned) here: https://groups.google.com/g/seastar-dev/c/CpUOtC2NJLM

@tchaikov tests fail

It still fails.

This is a bad use case, since it will have quadratic behavior. Maybe it's a bad idea to implement push_back as it encourages bad performance.

/cc @nyh