chatgpt-your-files icon indicating copy to clipboard operation
chatgpt-your-files copied to clipboard

Partial NULL embeddings

Open Nishanth-Gobi opened this issue 8 months ago • 2 comments

Bug report

Describe the bug

On file uploads, the embedding function fails to create vectors for some of the chunks with the below message,

InvalidWorkerCreation: worker did not respond in time
    at async UserWorker.create (ext:sb_user_workers/user_workers.js:155:15)
    at async Object.handler (file:///home/deno/main/index.ts:153:22)
    at async respond (ext:sb_core_main_js/js/http.js:162:14) {
  name: "InvalidWorkerCreation"
}

I am using the new Supabase.ai.Session() API and am on Edge v1.53.3, but it still happens sometimes at random.

To Reproduce

Steps to reproduce the behavior, please provide code snippets or a repository:

  1. Run main locally
  2. Upload a couple of markdown files one after the other

Expected behavior

All chunks to have their corresponding vectors.

Screenshots

image

System information

  • OS: macOS
  • Version of supabase-js: latest
  • Version of Node.js: 22.1.0

Additional context

@gregnr this seems to be different from what you mentioned could be the reason for partial NULLs in #30

Nishanth-Gobi avatar Jun 05 '24 02:06 Nishanth-Gobi