Jeremy Taylor

A transaction submitted by >1.20.0 should not cause the 1.20.0 indexer to halt

3

There's been a report of a `1.22.2-rc1` tx submission resulting in an existing `1.20.0` node halting with: ``` java.lang.Exception: Transaction ingester aborted. at xtdb.node$await_tx.invokeStatic(node.clj:59) at xtdb.node$await_tx.invoke(node.clj:35) at xtdb.node.XtdbNode.await_tx(node.clj:157) at xtdb.node.XtdbNode.sync(node.clj:145)...

For context, the transaction ingester already wraps the underlying `fetch-docs` protocol with a check that validates the response (`strict-fetch-docs`) to ensure full consistency of the state of the index-store. Therefore,...

e.g. [this](https://play.xtdb.com/?version=2.0.0-SNAPSHOT&type=sql&txs=W3sic3lzdGVtLXRpbWUiOm51bGwsInR4cyI6IklOU0VSVCBJTlRPIGRvY3MgKF9pZCwgZm9vKSBWQUxVRVMgKDEsICdiYXInKTtcbklOU0VSVCBJTlRPIGRvY3MyIChfaWQsIGZvbykgVkFMVUVTICgxLCAnYmF6Jyk7In1d&query=U0VMRUNUIF9pZCwgZm9vIEZST00gZG9jcyBKT0lOIGRvY3MyIE9OIF9pZA%3D%3D) ambiguous column reference error where the ID is printed as `xt$id` (and not `_id`, which would be more helpful to the user), or similarly [this](https://play.xtdb.com/?version=2.0.0-SNAPSHOT&type=sql&txs=W3sic3lzdGVtLXRpbWUiOm51bGwsInR4cyI6IklOU0VSVCBJTlRPIGRvY3MgKF9pZCwgZm9vKSBWQUxVRVMgKDEsICdiYXInKTtcbklOU0VSVCBJTlRPIGRvY3MyIChfaWQsIGZvbykgVkFMVUVTICgxLCAnYmF6Jyk7In1d&query=U0VMRUNUICogRlJPTSBkb2NzIEpPSU4gZG9jczIgT04gZG9jcy5faWQgPSBkb2NzMi5faWQ%3D)

`LAGS` `IMMEDIATELY LAGS` etc. are implemented internally by not exposed via the new planner yet https://github.com/search?q=repo%3Axtdb%2Fxtdb%20immediately%20lags&type=code

To avoid hitting any "No space left on device" errors (or causing other processes in the system to hit such errors), XTDB's local disk caches should support configurable limits (e.g....

Users can insert data without application-supplied IDs

1

Various solutions exist, to be discussed, e.g.: 1. SQL UUID function / json-ld UUID-insert tag (deterministic - of course!) 2. User-defined SQL SEQUENCEs 3. Driver-generated helpers

ADBC driver for production in-process usage

1

Opening this issue as a place to collect requirements for any possible future ADBC work. Possible scenarios where ADBC could be useful: 1. Library similar to `iceberg-core`+`iceberg-arrow`, "can my data...

Hyphen in DML nested quoted column reference causes ingestion to stop

3

i.e. `INSERT INTO docs (xt$id, value) VALUES (1, {"hyphen bug": 1})` works `INSERT INTO docs (xt$id, value) VALUES (1, {"hyphen-bug": 1})` fails with: ``` Error: java.util.concurrent.ExecutionException clojure.lang.ExceptionInfo: Ingestion stopped: unknown...

End-to-end handling of various `pg_type` array types

6

Tools like postgres.js can expect to be able to query for and consequently handle various `pg_type` array types. Arrays of basic scalars should ideally work, but arrays of objects or...

JSON exists as an OID (114) but it is not currently tested: https://github.com/xtdb/xtdb/blob/5b1d46061662eb356ab7db40ca47ba899814b308/src/test/clojure/xtdb/pgwire_test.clj#L1277 Attempting to use it via Postgres.js (with `json: {to: 2950}` and `sql.typed.json("foo")`) results in: ``` java.lang.NullPointerException: Cannot...