jobright-jiyuan
Results
2
comments of
jobright-jiyuan
> Fair point, thanks for checking out the code so far. > > `.to(torch.float32)` -> required if we want to continue to make operations in `.cpu()` > > Well, if...
> how would I be able to submit a forward pass to multiple cuda streams I think it's something like this ``` stream = torch.cuda.Stream() with torch.cuda.stream(stream): model.forward(batch_to_device(inputs)) ``` The...