text-generation-inference
text-generation-inference copied to clipboard
feat: explore torch.compile on MLP and other ops
WIP
This PR explores the differences using torch.compile on select ops and starte work on reproducible benches