kieranx

[Feature] Return token usage

5

In the official OpenAI API, token usage is returned, e.g. "total_tokens": 1340 There seems to be no way to get this same info in LLPhant -- this is very basic...

no chat history when using QuestionAnswering/RAG

9

Hi, Especially for chat use cases, end users expect the AI they're talking to, to have context of the ongoing conversation. Currently in LLPhant, each question you ask when using...