text-generation-inference icon indicating copy to clipboard operation
text-generation-inference copied to clipboard

feat: explore torch.compile on MLP and other ops

Open drbh opened this issue 1 year ago • 0 comments

WIP

This PR explores the differences using torch.compile on select ops and starte work on reproducible benches

drbh avatar Apr 09 '24 02:04 drbh