Sebastian Dusterwald

Results 2 comments of Sebastian Dusterwald

I am pretty sure that the maximum context size limit parameter is bugged currently. I also get an OOM error after a while on my 4090 when trying to run...

Looks like it is fixed now with the latest updates. Just pulled the latest version and maximum context appears to be respected now. Based on the git changes it looks...