kaito
kaito copied to clipboard
Azure
Kubernetes AI Toolchain Operator
**Describe the bug** Kaito workspace controller seems to be only compatible with Karpenter version prior [v0.33.0 ](https://github.com/kubernetes-sigs/karpenter/releases/tag/v0.33.0 ) as they deprecated the machine CRD (karpenter.sh/v1alpha5) in that release and the...
**Reason for Change**: Minor setup tuning image versions and run params. Falcon currently populated, phi-2 and mistral todos.
**Reason for Change**: @etredal - Adds model version endpoint
Since there are many moving pieces this is a big PR that needs to test the whole flow - this will be getting continously broken down into smaller PRs. 1....
Currently this just supports text-to-image. Not Image Inpainting, Super-Resolution or Depth-to-Image Need these dependencies on machine: ``` RUN apt-get update && apt-get install ffmpeg libsm6 libxext6 -y ``` Accelerate launch:...
This PR introduces ONNX and updates the git action - preset image build - for building new images on self-hosted VM.
Having a OpenAI compatible endpoints would make it easier for developers to use different models with the same code base. **Describe the solution you'd like** Beyond just having the compatible...
**Is your feature request related to a problem? Please describe.** Kaito managed add-on on AKS deploys the gpu-provisioner and the workspace-controller in a managed fashion. Both apps (pods) are coming...
Host API kaito/presets/inference/text-generation/api_spec.json in GitHub Pages
So far, the default inference parameters mainly come from the library defaults. We have found the default values were changed in the library without any justifications and we also found...
