unsloth
unsloth copied to clipboard
unslothai
RuntimeError: Internal Triton PTX codegen error: In All unmodified Google Colabs
-Edit: Every full error code for all of the google collabs can be found in my comment to this post right below this all nicely formatted :)
For the unsloth Google Colab ph-3 I'm getting this issue when I run everything even without any modifications to the google colab
https://colab.research.google.com/drive/1NvkBmkHfucGO3Ve9s1NKZvMNlw5p83ym?usp=sharing#scrollTo=yqxqAZ7KJ4oL
==((====))== Unsloth - 2x faster free finetuning | Num GPUs = 1 \ /| Num examples = 51,760 | Num Epochs = 1 O^O/ _/ \ Ba==((====))== Unsloth - 2x faster free finetuning | Num GPUs = 1 \ /| Num examples = 51,760 | Num Epochs = 1 O^O/ _/ \ Batch size per device = 2 | Gradient Accumulation steps = 4 \ / Total batch size = 8 | Total steps = 60 "-____-" Number of trainable parameters = 29,884,416
RuntimeError Traceback (most recent call last)
34 frames /usr/local/lib/python3.10/dist-packages/triton/compiler/backends/cuda.py in make_cubin(src, metadata, opt, capability) 192 metadata["name"] = get_kernel_name(src, pattern='// .globl') 193 ptxas, _ = path_to_ptxas() --> 194 return compile_ptx_to_cubin(src, ptxas, capability, opt.enable_fp_fusion) 195 196 def add_stages(self, stages, options):
RuntimeError: Internal Triton PTX codegen error: ptxas /tmp/compile-ptx-src-38292b, line 100; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 100; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 102; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 102; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 104; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 104; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 106; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 106; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 108; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 108; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 110; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 110; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 112; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 112; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 114; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 114; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 116; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 116; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 118; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 118; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 120; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 120; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 122; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 122; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 124; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 124; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 126; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 126; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 128; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 128; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 130; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 130; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 316; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 316; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 318; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 318; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 320; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 320; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 322; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 322; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 324; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 324; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 326; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 326; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 328; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 328; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 330; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 330; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 332; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 332; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 334; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 334; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 336; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 336; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 338; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 338; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 340; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 340; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 342; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 342; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 344; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 344; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 346; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 346; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 350; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 350; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 354; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 354; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 358; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 358; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 362; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 362; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 366; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 366; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 370; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 370; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 374; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 374; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 378; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 378; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 382; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 382; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 386; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 386; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 390; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 390; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 394; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 394; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 398; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 398; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 402; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 402; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 406; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 406; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 410; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 410; error : Feature '.bf16' requires .target sm_80 or higher ptxas fatal : Ptx assembly aborted due to errorstch size per device = 2 | Gradient Accumulation steps = 4 \ / Total batch size = 8 | Total steps = 60 "-____-" Number of trainable parameters = 29,884,416
RuntimeError Traceback (most recent call last)
34 frames /usr/local/lib/python3.10/dist-packages/triton/compiler/backends/cuda.py in make_cubin(src, metadata, opt, capability) 192 metadata["name"] = get_kernel_name(src, pattern='// .globl') 193 ptxas, _ = path_to_ptxas() --> 194 return compile_ptx_to_cubin(src, ptxas, capability, opt.enable_fp_fusion) 195 196 def add_stages(self, stages, options):
RuntimeError: Internal Triton PTX codegen error: ptxas /tmp/compile-ptx-src-38292b, line 100; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 100; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 102; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 102; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 104; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 104; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 106; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 106; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 108; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 108; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 110; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 110; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 112; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 112; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 114; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 114; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 116; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 116; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 118; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 118; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 120; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 120; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 122; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 122; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 124; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 124; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 126; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 126; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 128; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 128; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 130; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 130; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 316; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 316; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 318; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 318; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 320; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 320; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 322; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 322; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 324; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 324; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 326; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 326; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 328; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 328; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 330; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 330; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 332; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 332; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 334; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 334; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 336; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 336; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 338; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 338; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 340; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 340; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 342; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 342; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 344; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 344; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 346; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 346; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 350; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 350; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 354; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 354; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 358; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 358; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 362; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 362; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 366; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 366; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 370; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 370; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 374; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 374; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 378; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 378; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 382; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 382; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 386; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 386; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 390; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 390; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 394; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 394; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 398; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 398; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 402; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 402; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 406; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 406; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 410; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-38292b, line 410; error : Feature '.bf16' requires .target sm_80 or higher ptxas fatal : Ptx assembly aborted due to errors
Colab Notebooks Encountering error with(IE All of them)
Tinyllama Google Colab: Tinyllama Notebook
Full Error Log
==((====))== Unsloth - 2x faster free finetuning | Num GPUs = 1 \\ /| Num examples = 3,013 | Num Epochs = 1 O^O/ \_/ \ Batch size per device = 2 | Gradient Accumulation steps = 4 \ / Total batch size = 8 | Total steps = 376 "-____-" Number of trainable parameters = 25,231,360 --------------------------------------------------------------------------- RuntimeError Traceback (most recent call last)in () ----> 1 trainer_stats = trainer.train() | 31 frames /usr/local/lib/python3.10/dist-packages/triton/compiler/backends/cuda.py in make_cubin(src, metadata, opt, capability) 192 metadata["name"] = get_kernel_name(src, pattern='// .globl') 193 ptxas, _ = path_to_ptxas() --> 194 return compile_ptx_to_cubin(src, ptxas, capability, opt.enable_fp_fusion) 195 196 def add_stages(self, stages, options):
RuntimeError: Internal Triton PTX codegen error: ptxas /tmp/compile-ptx-src-24fb46, line 80; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 80; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 82; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 82; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 84; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 84; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 86; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 86; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 88; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 88; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 90; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 90; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 92; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 92; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 94; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 94; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 246; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 246; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 248; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 248; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 250; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 250; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 252; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 252; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 254; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 254; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 256; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 256; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 258; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 258; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 260; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 260; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 264; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 264; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 268; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 268; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 272; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 272; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 276; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 276; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 280; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 280; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 284; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 284; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 288; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 288; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 292; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-24fb46, line 292; error : Feature '.bf16' requires .target sm_80 or higher ptxas fatal : Ptx assembly aborted due to errors
DPO Zephyr Unsloth Example.ipynb Google Colab: DPO Zephyr Unsloth Example.ipynb Notebook
Full Error Log
==((====))== Unsloth - 2x faster free finetuning | Num GPUs = 1 \\ /| Num examples = 305 | Num Epochs = 3 O^O/ \_/ \ Batch size per device = 2 | Gradient Accumulation steps = 4 \ / Total batch size = 8 | Total steps = 114 "-____-" Number of trainable parameters = 167,772,160 --------------------------------------------------------------------------- RuntimeError Traceback (most recent call last)in () ----> 1 dpo_trainer.train() | 35 frames /usr/local/lib/python3.10/dist-packages/triton/compiler/backends/cuda.py in make_cubin(src, metadata, opt, capability) 192 metadata["name"] = get_kernel_name(src, pattern='// .globl') 193 ptxas, _ = path_to_ptxas() --> 194 return compile_ptx_to_cubin(src, ptxas, capability, opt.enable_fp_fusion) 195 196 def add_stages(self, stages, options):
RuntimeError: Internal Triton PTX codegen error: ptxas /tmp/compile-ptx-src-8e57cd, line 100; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 100; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 102; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 102; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 104; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 104; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 106; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 106; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 108; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 108; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 110; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 110; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 112; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 112; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 114; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 114; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 116; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 116; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 118; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 118; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 120; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 120; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 122; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 122; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 124; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 124; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 126; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 126; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 128; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 128; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 130; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 130; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 316; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 316; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 318; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 318; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 320; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 320; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 322; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 322; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 324; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 324; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 326; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 326; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 328; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 328; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 330; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 330; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 332; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 332; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 334; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 334; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 336; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 336; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 338; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 338; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 340; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 340; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 342; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 342; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 344; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 344; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 346; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 346; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 350; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 350; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 354; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 354; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 358; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 358; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 362; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 362; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 366; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 366; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 370; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 370; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 374; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 374; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 378; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 378; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 382; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 382; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 386; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 386; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 390; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 390; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 394; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 394; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 398; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 398; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 402; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 402; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 406; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 406; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 410; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-8e57cd, line 410; error : Feature '.bf16' requires .target sm_80 or higher ptxas fatal : Ptx assembly aborted due to errors
ORPO Unsloth Example.ipynb Google Colab: ORPO Unsloth Example.ipynb Notebook
Full Error Log
==((====))== Unsloth - 2x faster free finetuning | Num GPUs = 1 \\ /| Num examples = 16,000 | Num Epochs = 1 O^O/ \_/ \ Batch size per device = 2 | Gradient Accumulation steps = 4 \ / Total batch size = 8 | Total steps = 30 "-____-" Number of trainable parameters = 41,943,040 --------------------------------------------------------------------------- RuntimeError Traceback (most recent call last)in () ----> 1 orpo_trainer.train() | 35 frames /usr/local/lib/python3.10/dist-packages/triton/compiler/backends/cuda.py in make_cubin(src, metadata, opt, capability) 192 metadata["name"] = get_kernel_name(src, pattern='// .globl') 193 ptxas, _ = path_to_ptxas() --> 194 return compile_ptx_to_cubin(src, ptxas, capability, opt.enable_fp_fusion) 195 196 def add_stages(self, stages, options):
RuntimeError: Internal Triton PTX codegen error: ptxas /tmp/compile-ptx-src-481fab, line 100; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 100; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 102; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 102; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 104; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 104; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 106; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 106; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 108; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 108; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 110; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 110; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 112; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 112; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 114; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 114; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 116; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 116; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 118; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 118; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 120; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 120; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 122; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 122; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 124; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 124; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 126; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 126; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 128; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 128; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 130; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 130; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 316; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 316; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 318; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 318; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 320; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 320; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 322; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 322; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 324; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 324; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 326; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 326; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 328; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 328; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 330; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 330; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 332; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 332; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 334; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 334; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 336; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 336; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 338; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 338; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 340; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 340; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 342; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 342; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 344; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 344; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 346; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 346; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 350; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 350; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 354; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 354; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 358; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 358; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 362; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 362; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 366; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 366; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 370; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 370; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 374; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 374; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 378; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 378; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 382; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 382; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 386; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 386; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 390; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 390; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 394; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 394; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 398; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 398; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 402; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 402; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 406; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 406; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 410; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-481fab, line 410; error : Feature '.bf16' requires .target sm_80 or higher ptxas fatal : Ptx assembly aborted due to errors
Alpaca + Phi-3 3.8b full example.ipynb Google Colab: Alpaca + Phi-3 3.8b full example.ipynb Notebook
Full Error Log
==((====))== Unsloth - 2x faster free finetuning | Num GPUs = 1 \\ /| Num examples = 51,760 | Num Epochs = 1 O^O/ \_/ \ Batch size per device = 2 | Gradient Accumulation steps = 4 \ / Total batch size = 8 | Total steps = 60 "-____-" Number of trainable parameters = 29,884,416 --------------------------------------------------------------------------- RuntimeError Traceback (most recent call last)in () ----> 1 trainer_stats = trainer.train() | 34 frames /usr/local/lib/python3.10/dist-packages/triton/compiler/backends/cuda.py in make_cubin(src, metadata, opt, capability) 192 metadata["name"] = get_kernel_name(src, pattern='// .globl') 193 ptxas, _ = path_to_ptxas() --> 194 return compile_ptx_to_cubin(src, ptxas, capability, opt.enable_fp_fusion) 195 196 def add_stages(self, stages, options):
RuntimeError: Internal Triton PTX codegen error: ptxas /tmp/compile-ptx-src-77bd7a, line 100; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 100; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 102; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 102; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 104; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 104; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 106; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 106; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 108; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 108; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 110; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 110; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 112; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 112; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 114; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 114; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 116; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 116; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 118; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 118; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 120; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 120; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 122; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 122; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 124; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 124; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 126; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 126; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 128; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 128; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 130; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 130; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 316; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 316; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 318; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 318; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 320; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 320; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 322; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 322; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 324; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 324; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 326; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 326; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 328; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 328; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 330; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 330; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 332; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 332; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 334; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 334; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 336; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 336; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 338; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 338; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 340; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 340; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 342; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 342; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 344; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 344; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 346; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 346; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 350; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 350; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 354; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 354; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 358; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 358; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 362; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 362; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 366; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 366; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 370; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 370; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 374; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 374; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 378; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 378; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 382; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 382; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 386; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 386; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 390; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 390; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 394; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 394; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 398; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 398; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 402; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 402; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 406; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 406; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 410; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-77bd7a, line 410; error : Feature '.bf16' requires .target sm_80 or higher ptxas fatal : Ptx assembly aborted due to errors
Alpaca + Mistral 7b full example.ipynb Google Colab: Alpaca + Mistral 7b full example.ipynb Notebook
Full Error Log
==((====))== Unsloth - 2x faster free finetuning | Num GPUs = 1 \\ /| Num examples = 51,760 | Num Epochs = 1 O^O/ \_/ \ Batch size per device = 2 | Gradient Accumulation steps = 4 \ / Total batch size = 8 | Total steps = 60 "-____-" Number of trainable parameters = 41,943,040 --------------------------------------------------------------------------- RuntimeError Traceback (most recent call last)in () ----> 1 trainer_stats = trainer.train() | 34 frames /usr/local/lib/python3.10/dist-packages/triton/compiler/backends/cuda.py in make_cubin(src, metadata, opt, capability) 192 metadata["name"] = get_kernel_name(src, pattern='// .globl') 193 ptxas, _ = path_to_ptxas() --> 194 return compile_ptx_to_cubin(src, ptxas, capability, opt.enable_fp_fusion) 195 196 def add_stages(self, stages, options):
RuntimeError: Internal Triton PTX codegen error: ptxas /tmp/compile-ptx-src-7b2833, line 100; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 100; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 102; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 102; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 104; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 104; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 106; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 106; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 108; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 108; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 110; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 110; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 112; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 112; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 114; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 114; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 116; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 116; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 118; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 118; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 120; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 120; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 122; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 122; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 124; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 124; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 126; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 126; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 128; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 128; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 130; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 130; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 316; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 316; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 318; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 318; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 320; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 320; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 322; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 322; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 324; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 324; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 326; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 326; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 328; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 328; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 330; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 330; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 332; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 332; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 334; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 334; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 336; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 336; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 338; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 338; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 340; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 340; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 342; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 342; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 344; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 344; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 346; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 346; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 350; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 350; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 354; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 354; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 358; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 358; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 362; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 362; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 366; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 366; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 370; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 370; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 374; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 374; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 378; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 378; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 382; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 382; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 386; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 386; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 390; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 390; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 394; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 394; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 398; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 398; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 402; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 402; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 406; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 406; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 410; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-7b2833, line 410; error : Feature '.bf16' requires .target sm_80 or higher ptxas fatal : Ptx assembly aborted due to errors
Alpaca + Gemma 7b full example.ipynb Google Colab: Alpaca + Gemma 7b full example.ipynb Notebook
Full Error Log
==((====))== Unsloth - 2x faster free finetuning | Num GPUs = 1 \\ /| Num examples = 51,760 | Num Epochs = 1 O^O/ \_/ \ Batch size per device = 2 | Gradient Accumulation steps = 4 \ / Total batch size = 8 | Total steps = 60 "-____-" Number of trainable parameters = 50,003,968 --------------------------------------------------------------------------- RuntimeError Traceback (most recent call last)in () ----> 1 trainer_stats = trainer.train() | 34 frames /usr/local/lib/python3.10/dist-packages/triton/compiler/backends/cuda.py in make_cubin(src, metadata, opt, capability) 192 metadata["name"] = get_kernel_name(src, pattern='// .globl') 193 ptxas, _ = path_to_ptxas() --> 194 return compile_ptx_to_cubin(src, ptxas, capability, opt.enable_fp_fusion) 195 196 def add_stages(self, stages, options):
RuntimeError: Internal Triton PTX codegen error: ptxas /tmp/compile-ptx-src-0a6771, line 101; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 101; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 103; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 103; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 105; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 105; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 107; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 107; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 109; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 109; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 111; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 111; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 113; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 113; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 115; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 115; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 117; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 117; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 119; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 119; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 121; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 121; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 123; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 123; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 125; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 125; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 127; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 127; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 129; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 129; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 131; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 131; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 172; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 172; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 174; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 174; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 176; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 176; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 178; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 178; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 180; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 180; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 182; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 182; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 184; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 184; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 186; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 186; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 188; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 188; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 190; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 190; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 192; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 192; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 194; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 194; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 196; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 196; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 198; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 198; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 200; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 200; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 202; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 202; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 390; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 390; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 392; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 392; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 394; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 394; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 396; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 396; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 398; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 398; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 400; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 400; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 402; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 402; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 404; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 404; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 406; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 406; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 408; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 408; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 410; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 410; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 412; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 412; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 414; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 414; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 416; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 416; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 418; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 418; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 420; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-0a6771, line 420; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas fatal : Ptx assembly aborted due to errors
Alpaca + Llama-3 8b full example.ipynb Google Colab: Alpaca + Llama-3 8b full example.ipynb Notebook
Full Error Log
==((====))== Unsloth - 2x faster free finetuning | Num GPUs = 1 \\ /| Num examples = 51,760 | Num Epochs = 1 O^O/ \_/ \ Batch size per device = 2 | Gradient Accumulation steps = 4 \ / Total batch size = 8 | Total steps = 60 "-____-" Number of trainable parameters = 41,943,040 --------------------------------------------------------------------------- RuntimeError Traceback (most recent call last)in () ----> 1 trainer_stats = trainer.train() | 34 frames /usr/local/lib/python3.10/dist-packages/triton/compiler/backends/cuda.py in make_cubin(src, metadata, opt, capability) 192 metadata["name"] = get_kernel_name(src, pattern='// .globl') 193 ptxas, _ = path_to_ptxas() --> 194 return compile_ptx_to_cubin(src, ptxas, capability, opt.enable_fp_fusion) 195 196 def add_stages(self, stages, options):
RuntimeError: Internal Triton PTX codegen error: ptxas /tmp/compile-ptx-src-15740b, line 100; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 100; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 102; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 102; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 104; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 104; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 106; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 106; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 108; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 108; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 110; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 110; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 112; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 112; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 114; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 114; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 116; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 116; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 118; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 118; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 120; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 120; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 122; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 122; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 124; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 124; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 126; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 126; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 128; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 128; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 130; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 130; error : Feature 'cvt with .f32.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 316; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 316; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 318; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 318; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 320; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 320; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 322; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 322; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 324; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 324; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 326; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 326; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 328; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 328; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 330; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 330; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 332; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 332; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 334; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 334; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 336; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 336; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 338; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 338; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 340; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 340; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 342; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 342; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 344; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 344; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 346; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 346; error : Feature 'cvt.bf16.f32' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 350; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 350; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 354; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 354; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 358; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 358; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 362; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 362; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 366; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 366; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 370; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 370; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 374; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 374; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 378; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 378; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 382; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 382; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 386; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 386; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 390; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 390; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 394; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 394; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 398; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 398; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 402; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 402; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 406; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 406; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 410; error : Feature '.bf16' requires .target sm_80 or higher ptxas /tmp/compile-ptx-src-15740b, line 410; error : Feature '.bf16' requires .target sm_80 or higher ptxas fatal : Ptx assembly aborted due to errors
Same here, facing issues in loading the model and running inference on colab. Assistance needed. Same error logs.
For now
%%capture
# Installs Unsloth, Xformers (Flash Attention) and all other packages!
!pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
!pip install --no-deps "torch<2.3.0" "xformers<0.0.26" trl peft accelerate bitsandbytes
should work for T4s
I'm currently updating people via Twitter: https://x.com/danielhanchen/status/1792982364894929083
In terms of the issue, it seems like Pytorch 2.3 is saying T4s can support bfloat16, but it actually cannot.
@raj-chinagundi @DrewThomasson Fixed! Please change all install instructions at the top to
%%capture
# Installs Unsloth, Xformers (Flash Attention) and all other packages!
!pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
!pip install --no-deps xformers trl peft accelerate bitsandbytes
then change the SFTTrainer from
fp16 = not torch.cuda.is_bf16_supported(),
bf16 = torch.cuda.is_bf16_supported(),
to (plus place from unsloth import is_bfloat16_supported)
# Do from unsloth import is_bfloat16_supported
fp16 = not is_bfloat16_supported(),
bf16 = is_bfloat16_supported(),
%%capture
# Installs Unsloth, Xformers (Flash Attention) and all other packages!
!pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
!pip install --no-deps "torch<2.3.0" "xformers<0.0.26" trl peft accelerate bitsandbytes
this fixed for me and its running inference