torchchat icon indicating copy to clipboard operation
torchchat copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

[AOTI] Add a --max-seq-length option for export

Open desertfire opened this issue 6 months ago • 1 comments

Summary: This improves best tokens/sec from 73 to 85.

desertfire avatar Aug 07 '24 13:08 desertfire