text-generation-inference icon indicating copy to clipboard operation
text-generation-inference copied to clipboard

How to give custom model code for TGI to run.

Open ashwani-bhat opened this issue 9 months ago • 0 comments
trafficstars

Is there a way to give custom model inference code for TGI to run during invocation?

ashwani-bhat avatar Jan 27 '25 10:01 ashwani-bhat