jetstream-pytorch
jetstream-pytorch copied to clipboard
Return Tuple(interleaveEngList, prefillEngineList, decodeEngineList) in create ray engine
Right now, ray engine return interleave engine and a tuple separately. In the end, we would like to return a stable Tuple list for both of them.