DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard
verified publisher icon microsoft

Collect CUDA Graphs for Unique Input Signatures

Open DannyBruno opened this issue 2 years ago • 1 comments

Collect unique cuda graph based on input signatures. Solves bug where w/ cuda graph enabled increasing batch size will break. Added unit test.

DannyBruno avatar Feb 24 '23 19:02 DannyBruno

Hello @MrNosaj Currently your best option is to just log in and post the post yourself while agentGPT develops the content!! AgentGPT is currently developing a system to make this a reality please stay tuned!!

jasangill1 avatar Jul 22 '23 20:07 jasangill1