embedJs icon indicating copy to clipboard operation
embedJs copied to clipboard

Question: what is the purpose of "stores"

Open punkish opened this issue 1 year ago • 3 comments

Per the docs,

EmbedJs comes with built-in support for data persistance beyond vector embeddings. The kind of data that can be persisted includes -
  • Loaders and chunks loaded and their metadata,
  • Loader specific caching,
  • Conversation history

What is the purpose of this datastore? I see the schema as below for the stores db but I can't figure out the use for this other than perhaps for the conversations table, in case, I want to show the users their history of questions. But, in that case, how would I identify which questions belong to which user? (assuming, I have a system with multiple users, most likely a web-based Q&A app).

CREATE TABLE conversations (
            id              TEXT PRIMARY KEY,
            conversationId  TEXT NOT NULL,
            content         TEXT NOT NULL,
            timestamp       TEXT NOT NULL,
            actor           TEXT NOT NULL,
            sources         TEXT
        );
CREATE TABLE loaders (
            id              TEXT PRIMARY KEY,
            type            TEXT NOT NULL,
            chunksProcessed INTEGER,
            metadata        TEXT
        );
CREATE TABLE loaderCustomData (
            key             TEXT PRIMARY KEY,
            loaderId        TEXT NOT NULL,
            value           TEXT
        );

punkish avatar Jan 07 '25 21:01 punkish

This issue is stale because it has been open for 14 days with no activity.

github-actions[bot] avatar Jan 23 '25 00:01 github-actions[bot]

This issue was closed because it has been inactive for 30 days since being marked as stale.

github-actions[bot] avatar Feb 23 '25 00:02 github-actions[bot]

@punkish Can you reopen the issue? I'm wondering the same thing...

millette avatar Oct 14 '25 14:10 millette

This issue is stale because it has been open for 14 days with no activity.

github-actions[bot] avatar Nov 29 '25 00:11 github-actions[bot]