Vijay Saraswat
Vijay Saraswat
Five minutes now, definitely stuck. So two errors: the traceback above which appears to indicate some check is not being made for the size of the prompt before the query...
I see -- the "stuck" problem is simply an artifact of some kind of buffering bug -- the output of the program "Some characters could not be decoded, and were...
Yes, would much appreciate making this agnostic to LLMs. An do this in such a way that it can work in enterprise environments, which typically have a proxy channeling all...