electric

electric copied to clipboard

Add a hard limit to the transaction size

1

Electric loads entire transactions from Postgres logical replication into memory before starting to write to shape logs. For very large transactions this might exhaust memory, crashing the server. While we...

balegas

Electric crashes during loading of large amount of data into Postgres, and restarts with an empty shape.

7

Working on the PGlite Linearlite demo. I have a script that resets the Docker images (Postgres + Electric) and then loads a number of issue and comments (I've been aiming...

samwillis

append unit to otel attributes

2

e.g. for `decode_message_duration` I don't know if this is ms or (probably) μs Appending the unit is needed whenever it's ambiguous.

KyleAMathews

Move `stream.subscribe()` to be part of the constructor

22

e.g. `new ShapeStream({ subscribe: () => {} })` The problem with `.subscribe()` is then people get the sense that they can subscribe whenever and they'll get the full stream where...

KyleAMathews

Chunking of responses doesn't apply to the initial snapshot.

1

We chunk responses to 10mb (uncompressed), this isn't applied to the initial snapshot. I'm seeing initial sync that are the whole shapes data. In the case of the linearlite+pglite demo...

samwillis

This implements #1885. When configured, the lock connection and the database pool will connect to this pooled URL. By default, when `DATABASE_POOL_URL` is not set, all connections are open using...

alco

Increase private cache duration for live requests.

4

This is another specific suggestion deriving from the discussion in #2050. Right now, live requests are served with: ``` Cache-control: public, max-age=5, stale-while-revalidate=5 ``` This means they are only cached...

thruflo

Separate `DATABASE_URL`s for replication and query connections.

3

I've been doing a pass on deployment docs, including verifying the steps to connect to managed Postgres providers. In a few cases (Supabase, GCP, etc.) they provide a direct IP...

thruflo

We catch WHERE clause evaluation erros to prevent the replication stream from stopping because of a malformed/unsupported where clause evaluation. We should emit metrics about these occurrences to learn the...

balegas

Add an admin endpoint to clear the entire cache

2

It'd be convenient if e.g. disk space is running out or if there's some bug in shape creation that people need to work around. It's a bit of a last...

KyleAMathews