Kiersten Stokes
Kiersten Stokes
## Description This PR is currently three commits: - one that adds support for REST, which necessitates updating `com.fasterxml.jackson.core:jackson-core` and `:jackson-databind` to be >2.11 in the root pom - one...
## Description The previous `io.jsonwebtoken.jjwt:0.9.0` is not compatible with Java 11 at runtime. For versions 10.0.0 and beyond, the `jjwt` api and implementation are split into separate artifacts. ## Motivation...
This PR adds a Dockerfile that can be used to build and run an image that executes an example `lm_eval` command or custom commands as described in the README. Related:...
I started thinking about this after testing a model hosted via Kserve inference service, which supports OpenAI APIs for certain serving runtimes. My setup uses an ingress gateway (no DNS)...
**Is your feature request related to a problem? Please describe.** Due to the increasing complexity of subclassing in the backend code, it may be worth it to look into the...