Du Wenjie

### Is there an existing issue for this? - [X] I have searched the existing issues ### Have you checked the FAQ (https://github.com/windingwind/zotero-pdf-translate/issues/6)? - [X] I have checked the FAQ...

Question: Would you meet the output of LTU is poor quality in the early stage？

1

I am trying to use the familiar framework to align LLama with other time-series data. But my finetuned model rarely output formatted answer for multi-choices question, therefore it's very difficult...

Question: Where is the setting to freeze the backbone LLM like LLaVA?

1

```python # LLaVA if model_args.freeze_backbone: model.model.requires_grad_(False) ``` In LTU code, only note the LLM has already frozen. ```python # for audio params, lora always trainable, llama always frozen for name,...