chatgpt-your-files
chatgpt-your-files copied to clipboard
Partial NULL embeddings
Bug report
Describe the bug
On file uploads, the embedding function fails to create vectors for some of the chunks with the below message,
InvalidWorkerCreation: worker did not respond in time
at async UserWorker.create (ext:sb_user_workers/user_workers.js:155:15)
at async Object.handler (file:///home/deno/main/index.ts:153:22)
at async respond (ext:sb_core_main_js/js/http.js:162:14) {
name: "InvalidWorkerCreation"
}
I am using the new Supabase.ai.Session()
API and am on Edge v1.53.3
, but it still happens sometimes at random.
To Reproduce
Steps to reproduce the behavior, please provide code snippets or a repository:
- Run main locally
- Upload a couple of markdown files one after the other
Expected behavior
All chunks to have their corresponding vectors.
Screenshots
System information
- OS: macOS
- Version of supabase-js: latest
- Version of Node.js: 22.1.0
Additional context
@gregnr this seems to be different from what you mentioned could be the reason for partial NULLs in #30