jupyter-ai icon indicating copy to clipboard operation
jupyter-ai copied to clipboard

Folders can be learned with /learn multiple times

Open 3coins opened this issue 2 years ago • 4 comments
trafficstars

Summary

If a directory has been already indexed with a previous /learn command, and is submitted for learning again, this proceeds without any warning. However, when the /ask command is used subsequently, the response contains all the extra context because of the duplicate document in the vector store.

Note: So, far only observed this issue with the anthropic:claude-v1.2 model. With openai:gpt-3.5-turbo, the LLM seems to work ok through the duplicate content.

3coins avatar May 03 '23 18:05 3coins

Is this still an issue? Do any other models demonstrate it?

JasonWeill avatar Jul 28 '23 00:07 JasonWeill

@3coins Please verify

JasonWeill avatar Aug 28 '23 18:08 JasonWeill

Could not replicate the issue with Anthropic claude-v1.2, but noticed that the /learn command is duplicating the data in the vector store.

Screenshot 2023-08-29 at 10 13 07 PM

3coins avatar Aug 30 '23 05:08 3coins

I still see the behavior @3coins mentioned above. Not sure whether this is a bug we need to fix; although the UI looks unusual, it is normal to learn a folder more than once, since its contents may change.

JasonWeill avatar Oct 31 '23 00:10 JasonWeill