Will Constable
Will Constable
@lessw2020 i was just cleaning up old PRs and closing many, is this one still in the running or should we abandon it? feel free to reopen
i think i abandoned this becuase even with this fix the PP tracer would not work due to other issues with the fused-rmsnorm custom op registration. did we figure out...
squashed
@nunoplopes Thanks for reaching out! We are also continuing on the branch `lazy_tensor_staging` in the subfolder `lazy_tensor_core`, where you can see README and API_GUIDE for more info about the current...
We are in the process of merging lazy tensor support into pytorch master right now. (You can already see some files landing in `torch/csrc/lazy/...`. It will probably take us the...
> elaborate a bit more about the TorchScript backend It's still WIP, but the idea is to construct a lazy trace of 'functional ATen ops', which are then trivially convertible...
im not convinced. i should be easy to convince since at the moment i'm fighting with tracer issue after tracer issue. however, if the answer is "turn off safety so...
We'll be integrating PipPy into TorchTrain soon, and along with that we'll get meta-initialization or cpu-initialization working nicely as an example for folks to see. Are you unblocked for now?
Ok makes sense to me. @shuqiangzhang @zdevito can finish the review while I'm out