ltu

ltu copied to clipboard

Is there a length limit for input audio in ltu-as? And are there any plans to implement streaming audio input?

BongkiLee

Question: Would you meet the output of LTU is poor quality in the early stage？

1

I am trying to use the familiar framework to align LLama with other time-series data. But my finetuned model rarely output formatted answer for multi-choices question, therefore it's very difficult...

Kurt232

Question: Where is the setting to freeze the backbone LLM like LLaVA?

1

```python # LLaVA if model_args.freeze_backbone: model.model.requires_grad_(False) ``` In LTU code, only note the LLM has already frozen. ```python # for audio params, lora always trainable, llama always frozen for name,...

Kurt232