Tan Xiang

icon company Chongqing University of Posts and Telecommunications icon location 重庆 icon location My name is Tan Xiang. I am a graduate student at Chongqing University of Posts and Telecommunications.

Results 1 comments of Tan Xiang

[BUG] <title>lora微调后，无法batch推理怎么办

```python import torch from transformers import AutoModelForCausalLM, AutoTokenizer from transformers import GenerationConfig import sys from peft import get_peft_config, PeftModel, PeftConfig, get_peft_model, LoraConfig, TaskType from qwen_generation_utils import make_context, decode_tokens, get_stop_words_ids tokenizer...