InternVL
InternVL copied to clipboard
OpenGVLab
[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
### Checklist - [ ] 1. I have searched related issues but cannot get the expected help. - [ ] 2. The bug has not been fixed in the latest...
### 📚 The doc issue I can't find any guide for InternOmni model. Would you guide me how to run inference and finetune for it? ### Suggest a potential alternative/fix...
InternVL2的76B模型的基座是LLama，但是微调脚本中使用的对话模版都使用的InternLM2的风格，而40B模型虽然在微调脚本里用的Hermes-2的风格，但是其在LMdeploy中还是用的InternLM2的风格。然而我观察这两者的token id好像都不太对。请问二者在训练时应该用哪一种对话模版
### 📚 The doc issue 怎么使用lmdeploy进行视频模态的推理？ ### Suggest a potential alternative/fix _No response_
### Motivation JSON format output from an VLM provides structured data, making it easier to parse and integrate with other systems. In zero-shot classification, JSON allows the VLM to clearly...
### 📚 The doc issue In "Enhancing InternVL2 on COCO Caption Using LoRA Fine-Tuning" tutorial, "Next, we’ll fine-tune the InternVL2-2B model using LoRA. Execute the following command for fine-tuning: GPUS=8...
### Motivation Maybe I am wrong but it does not look like the current chat api support batch inference for interleaved text and image data. ### Related resources NA ###...
Thanks for your great work! By the way, is the free API access still available? I submitted the form about a week ago, but I still didn't get any response
### 📚 The doc issue I'm very interested in the RAG method you used in InternVL2-Pro. Could you provide more details about it, including the model size, training strategy, and...
### Motivation streamlit run /root/InternVL/streamlit_demo/app.py --server.port $WEB_SERVER_PORT -- --controller_url $CONTROLLER_URL --sd_worker_url $SD_WORKER_URL 执行的时候，出现了 You can now view your Streamlit app in your browser. Local URL: http://localhost:10003 Network URL: http://内网IP:10003 External...
