Isaac Chen comments

Results 4 comments of


                                            Isaac Chen

![image](https://github.com/THUDM/ChatGLM2-6B/assets/17777706/0b83837c-4a1c-45a7-999d-bf17168757e6) loss越来越高，相同的参数和数据，在ChatGLM-6B下面做微调，loss是一直下降的。

![image](https://github.com/THUDM/ChatGLM2-6B/assets/17777706/fac5ab2f-36d9-4358-84de-5b3b3c751579)

![image](https://github.com/THUDM/ChatGLM2-6B/assets/17777706/12fef7bd-96d7-4a7a-85d0-3050f3c81e3a)

使用lora微调后，也是重复输出 ![image](https://github.com/THUDM/ChatGLM2-6B/assets/17777706/64e0dc01-ccb7-4261-ad7c-d39beb4bba7e)