risedangel

Have you tried the web server support ont "Settings > Application > enable webserver" ? you need some simple coding to send and receive though.

hey @yoinked-h , can you further assist me about how you manage to train a retnet model? I cant seem to manage it ? If possible can you share a...

I got it working through running it eith openai model serve and https://docs.llamaindex.ai/en/v0.9.48/api_reference/llms/openai_like.html

both for standart and openai serving

The problem is, i have tried to serve the model in two different card. Both on 3090 and rtx 6000 ada generation. Mosel serving ate up all the vram in...

https://github.com/OptimalScale/LMFlow this tool seems to suppot it.

@danielhanchen hi, any news?