flame

flame copied to clipboard

Hi, I attempted a simple Flame example in an existing app, but I'm running into an issue where the FLAME instance is killed immediately, but the caller sees a timeout....

Doerge

Hot start a new node when a percentage of max_concurrency is reached

1

Currently FLAME will only start a new node when the maximum concurrency is reached which can lead to cold starts during heavy load. Adding a new parameter for "spinup_at_percentage" and...

DeemoONeill

Add hotstart_threshold to flame.pool

4

upon the concurrency exceeding the threshold a new node is added to the pool. This allows for pre-empting load and is intended for usecases where a cold-start is costly, such...

DeemoONeill

FlyBackend supports mounting volume

1

I'm using FLAME for my project to run ML workload running on Fly. To avoid download the 4GB model data every time starting a FLAME runner, a Fly volume needs...

LiboShen

Adds mounts to fly backend

3

I'm working on getting some elastic LLM inference set up using phoenix, fly, and FLAME and needed volumes attached to my flame workers so that I don't need to download...

benbot

can't test async: (DBConnection.OwnershipError) cannot find ownership process

1

testing flame calls that involve the repo get hung up on the ownership process. edit: simplified example ```ex defmodule MyAppTest do test "flame accessing the db" do FLAME.call(MyPool, fn ->...

dustinfarris

chrismccord

Add telemetry events

1

chrismccord

chrismccord

Some issues to solve will be to ensure shared code paths allow executing anonymous functions, as well as net kernel not being started in distributed mode in dev/test

chrismccord