awesome-cuda-and-hpc icon indicating copy to clipboard operation
awesome-cuda-and-hpc copied to clipboard

Published 20 hours ago • verified publisher icon codingonion

recommadation to a new light-weight llm serving framework--SFLLLM

Open wejoncy opened this issue 3 weeks ago • 0 comments
trafficstars

https://github.com/wejoncy/sfllm Hi This can be worked on Windows/Linux/Macos or any torch compatiable OS. For Learning purpose but with impressive performance.

wejoncy avatar Oct 29 '25 09:10 wejoncy