Christmas

icon location When people eat to live, And I live to eat.

Results 1 comments of Christmas

How to pass hidden_states to llm directly, when using inflight batching?

> We do not have support in the runtime for that at the moment. Is this something that could be handled inside the engine, @QiJune ? @MartinMarciniszyn Is it support...