necrophagists

[Q]Question about wandb logging memory

3

Hi, I've been using it recently and noticed that wandb logs memory information even when trainer's args.skip_memory_tracker=True, how can I turn off this setting in wandb?

caption_llava.py is not work

2

 i change the llm to llava-v1.6-mistral-7b，but model's output is empty。

Can you share the Loss Curve?

1

Hello,can you share the pretrain Loss Curve and fine-tune Loss Curve? I have some questions about my reproduction results.Thank you!

### 📚 The doc issue 怎么使用lmdeploy进行视频模态的推理？ ### Suggest a potential alternative/fix _No response_

why grad norm is so high？

1

s 

Question about Pretraining

1

Hello! I wonder if RWKV7 used the sequence packing strategy during pre-training? If so, do the samples need to be masked from each other?

MQAR评估的问题.

1

非常棒的工作，我想问下你们的MQAR数据是用Zoology仓库里的脚本生成的吗？