rindexer icon indicating copy to clipboard operation
rindexer copied to clipboard

[Feature Request] Support for SQLite Database

Open bh2smith opened this issue 5 months ago • 6 comments

Some projects (e.g. https://github.com/deluXtreme/subindexer/) might be small enough that warrant the extra postgres image. However, the CSV files aren't so easily queryable.

I've quickly put together an untested implementation in this fork:

https://github.com/bh2smith/rindexer/pull/1

bh2smith avatar Nov 13 '25 15:11 bh2smith

im super open for you getting this into rindexer if you have the bandwidth for it - i know SQLIte only has 5 types so that be the main bits as well

joshstevens19 avatar Nov 13 '25 16:11 joshstevens19

Well I have already made a draft (might be AI slop). Testing locally now - but the docker image build takes FOREVER... is this normal (its already been 800 seconds)..... and it failed. Is there some other way to test this locally without building the image?

 3 warnings found (use docker --debug to expand):
 - FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 1)
 - FromPlatformFlagConstDisallowed: FROM --platform flag should not use constant value "linux/amd64" (line 1)
 - FromPlatformFlagConstDisallowed: FROM --platform flag should not use constant value "linux/amd64" (line 19)
Dockerfile:17
--------------------
  15 |     
  16 |     # Build for standard Linux (glibc) instead of musl
  17 | >>> RUN RUSTFLAGS='-C target-cpu=x86-64-v2' cargo build --release --features jemalloc,reth --workspace --exclude rindexer_rust_playground
  18 |     
  19 |     FROM --platform=linux/amd64 debian:bookworm-slim
--------------------
ERROR: failed to build: failed to solve: ResourceExhausted: process "/bin/sh -c RUSTFLAGS='-C target-cpu=x86-64-v2' cargo build --release --features jemalloc,reth --workspace --exclude rindexer_rust_playground" did not complete successfully: cannot allocate memory

View build details: docker-desktop://dashboard/build/desktop-linux/desktop-linux/ibnnrkopq30vcyjngkjy020g6

bh2smith avatar Nov 13 '25 16:11 bh2smith

yeah you can run the commands on the CLI https://github.com/joshstevens19/rindexer/blob/master/cli/Makefile - i use that to test all the time if i want a custom project i have one outside the project make a make file to point to it and then it start it up etc haha the docker image is NGMI for local testing

joshstevens19 avatar Nov 15 '25 18:11 joshstevens19

sorry for the delay traveling to argentina @bh2smith excited about this addition

joshstevens19 avatar Nov 15 '25 18:11 joshstevens19

I'll pick it up again tomorrow. 🍻

bh2smith avatar Nov 16 '25 10:11 bh2smith

So I think the PR is ready for review. However there were a lot of disjoint parts and I may have missed some (tested traces and events). Also included an example. Please let me know if something if something is missing.

bh2smith avatar Nov 18 '25 20:11 bh2smith