DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

use `Flops Profiler` to test `model.generate()`

Open CaffreyR opened this issue 3 years ago • 4 comments

Fix issue #2514

Nowadays, the Flops Profiler can test forward for transformers such as bert, but for t5, it actually uses model.generate() during inference. So how to use Flops Profiler to test model.generate() ?

CaffreyR avatar Nov 17 '22 14:11 CaffreyR

@microsoft-github-policy-service agree

CaffreyR avatar Nov 17 '22 14:11 CaffreyR

@CaffreyR, thanks for the PR. Can you please remove the binary files? Thanks!

tjruwase avatar Nov 18 '22 11:11 tjruwase

Hi @tjruwase , do you mean the .DS_Store? I have deleted it.

CaffreyR avatar Nov 18 '22 11:11 CaffreyR

@cli99 can you review this PR?

jeffra avatar Nov 18 '22 19:11 jeffra