Justin Pflueger

icon indicating a website link https://www.linkedin.com/in/justinpflueger

icon company TBD icon location Fort Collins, Colorado

Results 2 comments of Justin Pflueger

Provide an Open AI API-compatible API component :-)

Yes! This is something I'm actively working on in a different repository [jpflueger/spin-llm-prompts](https://github.com/jpflueger/spin-llm-prompts). Right now I'm still adjusting the API to be compatible. Once I get the `completions` component in...

Using `limits` with the shim makes the pod fail.

Just wanted to add my findings in here as well. It seems like there is a CPU spike during startup that is throttled by the resource limits. This might not...