Stefanos Mousafeiris comments

Results 95 comments of


                                            Stefanos Mousafeiris

Create persistence layers that persist the Shape Log for a `ShapeStream` instance for faster loading of shapes (and offline loading)

I can pick this up - my suggestion is a composable `ShapeStreamPersister` that accepts a `ShapeStream` and another instance with a specified `Storage` interface (perhaps `set`, `get`, `delete`? something sensible),...

feat(sync-service): Clean up publication filters

Regarding https://github.com/electric-sql/electric/issues/1831 - we need to figure out _when_ we need `REPLICA IDENTITY FULL` and make it so that it is only set when necessary (and column filters are removed...

feat(sync-service): Clean up publication filters

benchmark this

feat(sync-service): Clean up publication filters

benchmark this

Slow to respond concurrent requests for new shapes

https://github.com/electric-sql/electric/pull/1787 should address sending requests directly to the shape workers There's more work that's easily done to remove responsibilities from `ShapeCache`, but I'd rather do it after merging the above...

Slow to respond concurrent requests for new shapes

Closing this as it has been addressed

Clean up publication filters when shapes are removed

The cleanups in general can be scheduled, but it is important to note that not cleaning them up also means that we're processing data through the replication stream that we...

Clean up publication filters when shapes are removed

@balegas it would require a bit of rewiring but I think we could do the following: 1. Boot up Electric and recover any persisted shapes 2. Build and maintain index...

feat: Move operations from `ShapeCache` to `Shape.Consumer`

@balegas PR should be ready, @robacourt has been kind enough to kick off a benchmark run for this PR so we can see results on Monday and hopefully merge (?)...

Stack shutdown terminates replication client

I'm assuming this is because we've established a replication connection but are not replying to keepalives - perhaps we've: 1. marked `:consumers_ready` from shape cache, since that could happen relatively...