gpt-fast icon indicating copy to clipboard operation
gpt-fast copied to clipboard

Published 20 hours ago • verified publisher icon pytorch-labs

About benchmark results

Open 1787648106 opened this issue 1 year ago • 1 comments

Amaizing work! How was the benchmark results obtained? Is it just the generation speed measured when the GPU power limited 330W?

1787648106 avatar Dec 03 '23 08:12 1787648106

Yes. GPU power limit is an unfortunate limitation of the particular hardware setup I'm using - it's not required.

Chillee avatar Dec 04 '23 19:12 Chillee