peerdb
peerdb copied to clipboard
PeerDB-io
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
This is accomplished by clearing out the metric from the MetricsMap once Observed/Collected. Use a query like: ``` max(peerdb_cdc_slot_lag_MB{}) without(k8s_pod_name, k8s_pod_uid, k8s_pod_ip, k8s_pod_start_time, k8s_node_name) ``` to deduplicate metrics across pods,...
Before we were setting initial load off for queues in handler With #1675 and #1683, these steps aren't required
Adds an error log for when decoding column data fails in pull records
Ensure we get nice interval values when reading rows in cdc functionally tested by switching to iso_8601 and back during cdc
v2
TODO test TODO make a config option or detect PG version TODO toast TODO don't persist in catalog TODO move in memory buffer to cdcStore for disk spill
The background is this code: - https://github.com/PeerDB-io/peerdb/blob/main/flow/connectors/bigquery/bigquery.go#L236-L239 - https://github.com/PeerDB-io/peerdb/blob/main/flow/connectors/bigquery/qvalue_convert.go#L41-L43 Basically, the `ALTER TABLE` statement is missing the array type if the new column is a list - it will create...
## API Endpoint to Resume Mirror With Specified Syncs This PR introduces an endpoint in our Flow API to resume mirrors with a request of custom number of syncs. The...
- [ ] Mirror Templates/Drafts: I want to be able to define create mirror templates which I can load and edit instead of typing in the fields again - [...