petals icon indicating copy to clipboard operation
petals copied to clipboard

Published 20 hours ago • verified publisher icon bigscience-workshop

Update install instructions to cuda 11.8

Open vadi2 opened this issue 11 months ago • 3 comments

Update install instructions to cuda 11.8 - seems safe enough.

vadi2 avatar Aug 06 '23 07:08 vadi2

Hi @vadi2,

Thanks for the PR!

Could you please clarify why it's useful and if this drops support for any old GPUs?

borzunov avatar Aug 06 '23 12:08 borzunov

I'm not sure if it drops support for any older GPUs, but it is useful because it gives a 2x speedup on Ada architectures: https://gpux.ai/blog/sdxl_50_faster

vadi2 avatar Aug 08 '23 07:08 vadi2

@vadi2 Got it! I'll double-check that with colleagues and get back to merging this.

borzunov avatar Aug 09 '23 03:08 borzunov