CUDA error: no kernel image is available for execution on the device CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1 Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. error Progress Step 0 of 3000 Job Name

VAM-Cassi0pia-30img

Assigned GPUs

GPUs: 0

Speed

?

Running 1 job C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\cuda_init_.py:287: UserWarning: NVIDIA GeForce RTX 5060 Ti with CUDA capability sm_120 is not compatible with the current PyTorch installation. The current PyTorch install supports CUDA capabilities sm_50 sm_60 sm_61 sm_70 sm_75 sm_80 sm_86 sm_90. If you want to use the NVIDIA GeForce RTX 5060 Ti GPU with PyTorch, please check the instructions at https://pytorch.org/get-started/locally/ warnings.warn(

( blah blah job details)

Error running job: CUDA error: no kernel image is available for execution on the device CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1 Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions.

Result:

0 completed jobs
1 failure ======================================== Traceback (most recent call last): Traceback (most recent call last): File "C:\StabilityMatrix\Packages\AI-Toolkit\run.py", line 120, in File "C:\StabilityMatrix\Packages\AI-Toolkit\run.py", line 120, in main()main() File "C:\StabilityMatrix\Packages\AI-Toolkit\run.py", line 108, in main File "C:\StabilityMatrix\Packages\AI-Toolkit\run.py", line 108, in main raise eraise e File "C:\StabilityMatrix\Packages\AI-Toolkit\run.py", line 96, in main File "C:\StabilityMatrix\Packages\AI-Toolkit\run.py", line 96, in main job.run()job.run() File "C:\StabilityMatrix\Packages\AI-Toolkit\jobs\ExtensionJob.py", line 22, in run File "C:\StabilityMatrix\Packages\AI-Toolkit\jobs\ExtensionJob.py", line 22, in run process.run()process.run() File "C:\StabilityMatrix\Packages\AI-Toolkit\jobs\process\BaseSDTrainProcess.py", line 2003, in run File "C:\StabilityMatrix\Packages\AI-Toolkit\jobs\process\BaseSDTrainProcess.py", line 2003, in run self.hook_before_train_loop()self.hook_before_train_loop() File "C:\StabilityMatrix\Packages\AI-Toolkit\extensions_built_in\sd_trainer\DiffusionTrainer.py", line 279, in hook_before_train_loop File "C:\StabilityMatrix\Packages\AI-Toolkit\extensions_built_in\sd_trainer\DiffusionTrainer.py", line 279, in hook_before_train_loop super().hook_before_train_loop()super().hook_before_train_loop() File "C:\StabilityMatrix\Packages\AI-Toolkit\extensions_built_in\sd_trainer\SDTrainer.py", line 261, in hook_before_train_loop File "C:\StabilityMatrix\Packages\AI-Toolkit\extensions_built_in\sd_trainer\SDTrainer.py", line 261, in hook_before_train_loop self.unconditional_embeds = self.sd.encode_prompt(self.unconditional_embeds = self.sd.encode_prompt( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\StabilityMatrix\Packages\AI-Toolkit\toolkit\stable_diffusion_model.py", line 2388, in encode_prompt File "C:\StabilityMatrix\Packages\AI-Toolkit\toolkit\stable_diffusion_model.py", line 2388, in encode_prompt train_tools.encode_prompts_xl(train_tools.encode_prompts_xl( File "C:\StabilityMatrix\Packages\AI-Toolkit\toolkit\train_tools.py", line 311, in encode_prompts_xl File "C:\StabilityMatrix\Packages\AI-Toolkit\toolkit\train_tools.py", line 311, in encode_prompts_xl text_embeds, pooled_text_embeds = text_encode_xl(text_embeds, pooled_text_embeds = text_encode_xl( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\StabilityMatrix\Packages\AI-Toolkit\toolkit\train_tools.py", line 243, in text_encode_xl File "C:\StabilityMatrix\Packages\AI-Toolkit\toolkit\train_tools.py", line 243, in text_encode_xl prompt_embeds = text_encoder(prompt_embeds = text_encoder( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl return self._call_impl(*args, **kwargs)return self._call_impl(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl return forward_call(*args, **kwargs)return forward_call(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\transformers\utils\generic.py", line 969, in wrapper File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\transformers\utils\generic.py", line 969, in wrapper output = func(self, *args, **kwargs)output = func(self, *args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\transformers\models\clip\modeling_clip.py", line 745, in forward File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\transformers\models\clip\modeling_clip.py", line 745, in forward return self.text_model(return self.text_model( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl return self._call_impl(*args, **kwargs)return self._call_impl(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl return forward_call(*args, **kwargs)return forward_call(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\transformers\utils\generic.py", line 969, in wrapper File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\transformers\utils\generic.py", line 969, in wrapper output = func(self, *args, **kwargs)output = func(self, *args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\transformers\models\clip\modeling_clip.py", line 643, in forward File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\transformers\models\clip\modeling_clip.py", line 643, in forward hidden_states = self.embeddings(input_ids=input_ids, position_ids=position_ids)hidden_states = self.embeddings(input_ids=input_ids, position_ids=position_ids) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl return self._call_impl(*args, **kwargs)return self._call_impl(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl return forward_call(*args, **kwargs)return forward_call(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\transformers\models\clip\modeling_clip.py", line 268, in forward File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\transformers\models\clip\modeling_clip.py", line 268, in forward inputs_embeds = self.token_embedding(input_ids)inputs_embeds = self.token_embedding(input_ids) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl return self._call_impl(*args, **kwargs)return self._call_impl(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl return forward_call(*args, **kwargs)return forward_call(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\sparse.py", line 190, in forward File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\modules\sparse.py", line 190, in forward return F.embedding(return F.embedding( ^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\functional.py", line 2551, in embedding File "C:\StabilityMatrix\Packages\AI-Toolkit\venv\Lib\site-packages\torch\nn\functional.py", line 2551, in embedding return torch.embedding(weight, input, padding_idx, scale_grad_by_freq, sparse)return torch.embedding(weight, input, padding_idx, scale_grad_by_freq, sparse) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ RuntimeErrorRuntimeError: : CUDA error: no kernel image is available for execution on the device CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1 Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. CUDA error: no kernel image is available for execution on the device CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1 Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. AMD Ryzen 5 5600X 6-Core Processor CPU Load

17.4% Memory

43.0% 20.6 GB / 47.9 GB

NVIDIA GeForce RTX 5060 Ti

0

Temperature

41°C

Fan Speed

0%

GPU Load

0% Memory

49.3% 7.9 GB / 15.9 GB

Clock Speed

210 MHz

Power Draw

7.7W / 180.0W

Checkpoints 0 No checkpoints available Overview Samples Config File

Nov 27 '25 14:11 justanotherbug

https://www.techpowerup.com/download/techpowerup-nvcleanstall/

Do a clean install of the drivers.

Nov 27 '25 23:11 meknidirta

same here

Nov 29 '25 16:11 bronyowl

nvCleanInstall failed i'm going to try Display Driver Uninstaller (DDU).

Nov 30 '25 15:11 justanotherbug

same here

updating to latest Driver(581.80) & updating cudatoolkit to 13.0 fix it for me

Nov 30 '25 18:11 bronyowl

I upgraded to a 5060 Ti...

0