UEHttpGPT icon indicating copy to clipboard operation
UEHttpGPT copied to clipboard

Feature: Embedding API calls

Open nonlin opened this issue 2 years ago • 0 comments

Would like to first mention that the potential for this opensource plugin is quite high. This could be a true competitor to the likes of Conavi and InWorld by being more transparent about the source LLM/backend rather than obfuscating the fact that GPT is being used.

InWorld and Convai basically have some ease of use features that this tool can provide as well and as a bonus do all within Unreal without making any extra accounts or any extra web portals.

One example feature is Knowledge and Long Term Memory.

InWorld and Convai basically implement Knowledge and Long Term Memory via embeddings, caching them to a vector databases and fetching them later for added context.

If this plugin can make embedding api calls, users can cache them locally on their machine and achieve similar results. The plugin could be expanded further to be more than just an HTTP interface and become a more character driven AI creator tool just like the paid subscription ones (InWorld/Convai).

I plan to add this but flagging it here in case someone gets to it before I do as I'm also working on other essential features to make this plugin work more like InWorld/Convai in terms of ease of use.

nonlin avatar Aug 30 '23 15:08 nonlin