bloomd icon indicating copy to clipboard operation
bloomd copied to clipboard

Add support for a WAL

Open armon opened this issue 10 years ago • 3 comments

If we add support for a write-ahead-log, then external tools can be used to setup log streaming and build a sane high availability setup.

armon avatar Nov 25 '13 01:11 armon

I know this is asking to pull in more pieces, but how about offloading this to a separate commit log system (something like Kafka), and then implementing a consumer for that instead? If the end (and only) objective is to do HA, that is.

jf avatar Jan 13 '16 05:01 jf

@jf Totally. Many ways to architect around this. At my old job where we used bloomd we simply had a separate log that went to S3 that we could replay in the event of a failure, so it was never a high priority to support native HA.

armon avatar Jan 14 '16 01:01 armon

It will be a great enhancement if a mechanism like 'binlog' is implemented internally.

onesuper avatar Jan 22 '18 11:01 onesuper