dice icon indicating copy to clipboard operation
dice copied to clipboard

Segmented Write Ahead Log

Open VishalMCF opened this issue 1 year ago • 8 comments

Currently, we are dumping all the data in the string format in a file defined in the config.

Just wanted to know if using segmented log is in the roadmap or not. If yes then we can implement it using the library https://github.com/arriqaaq/aol

I have been exploring this library quite for a while. I understand its internals. Just need to learn how encoding and decoding works there.

VishalMCF avatar Jun 20 '24 07:06 VishalMCF

@VishalMCF @arpitbbhayani

Have a WAL implementation of my own. Please check it out https://github.com/stym06/rebuf

stym06 avatar Jul 09 '24 05:07 stym06

@stym06 Is it being used in production anywhere?

VishalMCF avatar Jul 09 '24 13:07 VishalMCF

No its not production ready. There are a lot of bugs. Will be fixing them in the coming days

stym06 avatar Jul 09 '24 15:07 stym06

@stym06 Well what you have done is very original and impressive. The reason I suggested tidwall's because it is being used in production.

VishalMCF avatar Jul 10 '24 06:07 VishalMCF

Right. Its a naive implementation till now!

stym06 avatar Jul 10 '24 08:07 stym06

Thanks for sharing. It was not in our roadmap yet. But definitely worth putting it in Icebox. Thanks @stym06 and @VishalMCF

arpitbbhayani avatar Jul 12 '24 09:07 arpitbbhayani

Hi, I worked on Postgresql's WAL, recovery and replication stuff,@VishalMCF @arpitbbhayani anyone working on these stuff, I'd love to hop in.

srinathv2 avatar Jul 31 '24 01:07 srinathv2

@srinathv2 this is not a priority for us right now, we are still focussed on being a transient database.

arpitbbhayani avatar Sep 08 '24 12:09 arpitbbhayani