wave icon indicating copy to clipboard operation
wave copied to clipboard

[Enhancement] - Redis Support clustered mode.

Open gavinelder opened this issue 1 year ago • 4 comments

Background

Enterprise customers typically deploy Redis in cluster mode for production environments to ensure high availability and scalability. Wave's current Redis deployment only supports standalone mode, which doesn't align with enterprise operational requirements for resilient services.

This requires customers to either accept reduced reliability or seek additional approvals for operating Redis in a non-standard configuration within their environment.

Requirements

  • Enable Redis cluster mode support
  • Support horizontal scaling
  • Allow seamless failover

Success Criteria

  • No single point of failure in Redis layer

References

https://redis.io/docs/latest/operate/oss_and_stack/management/scaling/ https://aws.amazon.com/blogs/database/work-with-cluster-mode-on-amazon-elasticache-for-redis/

gavinelder avatar Oct 22 '24 08:10 gavinelder

@munishchouhan was anything solution found for this?

pditommaso avatar Nov 04 '24 14:11 pditommaso

@munishchouhan was anything solution found for this?

yes, jedis does support cluster mode We can add a flag for cluster and implement client for this I will work on this, after creating registry dashboards https://redis.io/docs/latest/develop/connect/clients/java/jedis/#:~:text=Jedis%20is%20a%20synchronous%20Java,Redis%20or%20Redis%20Stack%20server.

munishchouhan avatar Nov 04 '24 14:11 munishchouhan

RedisStorage in Spillway does not support JedisCluster

Reason: JedisCluster doesn’t support Pipeline and Transaction https://github.com/redis/jedis/issues/1065

munishchouhan avatar Nov 06 '24 08:11 munishchouhan

Relevent links: https://github.com/brianfrankcooper/YCSB/pull/1535/files

munishchouhan avatar Nov 06 '24 08:11 munishchouhan