DisCo icon indicating copy to clipboard operation
DisCo copied to clipboard

Very slow xformers install on the Colab

Open ShawnFumo opened this issue 1 year ago • 3 comments

Hi,

I'm trying to run the Colab linked on the readme of the repo, and in Step 2 on the last xformers line, it is taking a very long time. So far it is 4 hours and it is still doing new messages like:

 0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads
  ptxas info    : Used 254 registers
  ptxas info    : Compiling entry function '_Z24flash_fwd_splitkv_kernelI23Flash_fwd_kernel_traitsILi96ELi64ELi128ELi4ELb0ELb0EN7cutlass6half_tE19Flash_kernel_traitsILi96ELi64ELi128ELi4ES2_EELb1ELb0ELb0ELb1ELb1ELb1EEv16Flash_fwd_params' for 'sm_90'
  ptxas info    : Function properties for _Z24flash_fwd_splitkv_kernelI23Flash_fwd_kernel_traitsILi96ELi64ELi128ELi4ELb0ELb0EN7cutlass6half_tE19Flash_kernel_traitsILi96ELi64ELi128ELi4ES2_EELb1ELb0ELb0ELb1ELb1ELb1EEv16Flash_fwd_params
      0 bytes stack frame, 0 bytes spill stores, 0 bytes spill loads

Is this normal? I know it says this section is for acceleration. How much will it affect things to not install that? Also, the Colab defaulted to V100 High-RAM as the runtime. Is that the correct runtime (I'm on Colab Pro)?

ShawnFumo avatar Dec 04 '23 20:12 ShawnFumo