TriForce
TriForce copied to clipboard
Adapt to open source inference framework
Have you considered incorporating this work into an open source inference framework, such as vLLM?
Yeah, this is a good idea!