jetstream-pytorch icon indicating copy to clipboard operation
jetstream-pytorch copied to clipboard

Return Tuple(interleaveEngList, prefillEngineList, decodeEngineList) in create ray engine

Open FanhaiLu1 opened this issue 8 months ago • 0 comments

Right now, ray engine return interleave engine and a tuple separately. In the end, we would like to return a stable Tuple list for both of them.

FanhaiLu1 avatar May 29 '24 22:05 FanhaiLu1