Vladimir Albrekht

Just want to train own QQP model, started testing. When training is starting I get this error message. ``````````````````````````` ### Training... cuda:0 Traceback (most recent call last): File "/content/DiffuSeq/train.py", line...

"Input Type (torch.cuda.FloatTensor) and Weight Type (torch.cuda.HalfTensor) Mismatch"

7

### Hello, when I start recording got this error. When model try to convert input. Different types of input and weights. Model, was trained on RVC version 1 not v2....

[BUG] <title> Inference error. Replacing the LLM part with Llama-3.1 70B quantized causing error ( RuntimeError: shape mismatch: value tensor of shape [1024] cannot be broadcast to indexing result of shape [1025] )

7

### 是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this? - [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions ### 该问题是否在FAQ中有解答？ | Is there an...

How to convert the AWQ model after the quantization into safetensors

1

Sorry. I searched everywhere but I don't found any script to convert the quantized .pt file to the **safetensors.** I received the Llama-3.1-Nemotron-70B-Instruct-HF-w4-g128.pt After using this script: ``` python -m...

Slow training of Qwen3-VL-30B-A3B with DeepSpeed Stage 3

1

### Reminder - [x] I have read the above rules and searched the existing issues. ### System Info llamafactory-cli env --> - `llamafactory` version: 0.9.4.dev0 - Platform: Linux-5.14.0-362.24.1.el9_3.0.1.x86_64-x86_64-with-glibc2.34 - Python...