Keith Grennan comments

Results 16 comments of


                                            Keith Grennan

Steve cannot be started via docker - reason unknown

If there's no error in the log, it could be an out-of-memory error.

Problem Starting Steve behind a proxy server with docker

The Dockerfile in this repo has a number of problems. Doing the entire build in the "run" stage is not a good pattern. You're welcome to try the Dockerfile I...

Community feedback wanted: Migrate from Java 11 to Java 17

Upgrade to Java 17 sounds good to me!

Include a Dockerfile

fwiw i just tried to do this, unfortunately this project doesn't lend itself to super straightforward containerization, it reads and writes a couple different kinds of files to local disk...

Hiding tabBar on a per route basis

[Misc]: Throughput/Latency for guided_json with ~100% GPU cache utilization

Just anecdotally I am still seeing a 20x slowdown doing batch generation with `JSONLogitsProcessor` enabled, even with @lapp0's PR. Let me know if i can provide more information.