LLaVA-NeXT

LLaVA-NeXT copied to clipboard

LLaVA-NeXT-Video-34B-DPO 模型无法启动，报错

1

用的 LLaVA-NeXT-Video-34B-DPO 这个模型， https://github.com/LLaVA-VL/LLaVA-NeXT git checkout video_inference这个分支的代码，为什么我的测试起不来，报错（ 1、stopping_criteria = KeywordsStoppingCriteria(keywords, tokenizer, input_ids) 屏蔽后报 2、 2、llava_arch.LlavaMetaForCausalLM.prepare_inputs_labels_for_multimodal---->concat_images = torch.cat(images_list, dim=0), 输出为None ） 有没有把这个模型安排起来的，，，LLaVA-NeXT-Video-34B-DPO用到了clip-vit-large-patch14-336（这个模型）， 是不是代码有点问题。

csm12321

LLaVa consistently ranks among the top open-source projects, setting a high standard. Why not extend this excellence by opening up to Chinese datasets?

lucasjinreal

Thanks for your great work! I noticed that the data used in the May version of LLaVA-NeXT comprises of ~790K data, while the Jan version has only 760K data. Could...

yqy2001

When will the finetune code open sourced?

8

Thanks for your great job！When will open source finetune code？

will-wiki

poor quality output for qwen 72b

4

server: ``` export CUDA_VISIBLE_DEVICES="3,4,5,6" python -m sglang.launch_server --model-path lmms-lab/llava-next-72b --tokenizer-path lmms-lab/llavanext-qwen-tokenizer --port=30010 --host="0.0.0.0" --tp-size=4 --random-seed=1234 --context-length=32768 &> 72b.log & ``` client: ``` """ Usage: # Installing latest llava-next: pip install...

pseudotensor

请求基于Mistral-7B-Instruct-v0.3版本的llava-next

13

同上。

iMountTai

Can we deploy LLaVA-NeXT on a MacBook(M2)?Please provide an example.

2

Can we deploy LLaVA-NeXT on a MacBook(M2)?Please provide an example.

seasoncool

This PR adds the sample from the documentation to the repo, a gradio UI, and squishes a few bugs that were discovered along the way.

deece

Fixed Prompt formatting in conversation.py

1

removed "" from the roles since they get added automatically as well and lead to duplicate tokens like "user"

KT313

Hello Developers, Thank you for your outstanding work. Could you please provide the Training Hyperparameters used during the training of the LLaVA-NeXT-video and LaVA-NeXT-video-dpo model?

AmazDeng