[ ]

I've been sitting on it for a couple of days, but I have an implementation of the API from oobabooga's text-generation-webui in a simple script: https://gist.github.com/BlankParenthesis/4f490630b6307ec441364ab64f3ce900 Since this is basically...

I posted it in another issue at some point, but I have a script which sounds like what you want here: https://gist.github.com/BlankParenthesis/4f490630b6307ec441364ab64f3ce900 It mimics ooba's text-generation-webui API so it works...

Some further testing has revealed that this is indeed not an appropriate fix for the underlying cause: while this prevents crashing when encountering it, the reported required indent levels are...