bumblebee-model-harness icon indicating copy to clipboard operation
bumblebee-model-harness copied to clipboard

Published 20 hours ago • verified publisher icon fly-apps
→

Metadata

Minimal Elixir application that can host AI models on Fly.io GPUs and make them available via WireGuard to remote clustered Elixir applications for improved development experiences.

Results 3 bumblebee-model-harness issues
Sort by recently updated
recently updated
newest added

Example app fails to work on fly.io

Just tryings things out: This example app does not seem to work - some of the logs are: ``` 2024-04-24T14:28:49Z app[90806e10f54578] ord [info]14:28:49.265 [info] kernel reported version is: NOT_FOUND: could...

jesteracer avatar jesteracer

working on updated Dockerfile

brainlid avatar brainlid

Disable MIG before booting the app

FWIW, I don't think this should be merged as this is a temporary work around for something that we will eventually handle internally here. Just putting this up for now...

matthewlehner avatar matthewlehner

← Metadata

27
Stars
5
Forks
Watchers

Owner

verified publisher icon fly-apps

Metadata

Minimal Elixir application that can host AI models on Fly.io GPUs and make them available via WireGuard to remote clustered Elixir applications for improved development experiences.

Back