XuMayi

[Bug]: ValueError: There is no module or parameter named 'lm_head' in Gemma2ForCausalLM

3

### Your current environment Missing 'lm head' in Gemma2ForCausalLM ### 🐛 Describe the bug [rank0]: llm = LLM(model=f"{llm_type}", gpu_memory_utilization=gpu_memory_utilization, tensor_parallel_size=1, [rank0]: File "/home/xumayi/miniconda3/envs/kgllm-vllm3/lib/python3.8/site-packages/vllm/entrypoints/llm.py", line 177, in __init__ [rank0]: self.llm_engine =...

How to save the lora weight and config as the huggingface format?

2

How to save the lora weight and config as the following format: adapter_config.json adapter_model.bin https://huggingface.co/LLMs/AlpacaGPT4-LoRA-13B-elina/tree/main