Enable Memory ?

[yorks-dev]

Hey seems like the gpt is not made to deal with memory. it can not remember context. how can i make it to remember context ?

[reconSuave]

You need a handler for memory and context. Something like the python library 'chatbotAI' might be the kind of thing you're looking for, I haven't used that library specifically so look into it, but I think basically that's the kind of thing you want.

Language models don't actually have any memory or ability to contextualize, it's a matter of priming the response for context (like ChatGPT, for example, gives an illusion of remembering because when the chat interface queries the model, it prepends a selection of keywords / contextual info to your query, and also probably subtracts away from the response some elements that are non-contextual or contradictory. It does that behind the scenes so it appears to remember, but really it's just being fed some extra context primers and presenting the response to appear contextual).

You might try simply prefacing your query with a summary of the conversation when context is important. There are more sophisticated ways to handle that process programmatically too, run some searches on PyPI and NPM for chatbot context handlers, basically I think it would require adding a module to this app that did some pre-processing of queries and formatting them to get responses that appear contextual.