Ask-Anything

Ask-Anything copied to clipboard

VideoChat2_it_hd_mistral(config=cfg.model) 'bert base uncased' Error

1

Hi I'm trying to follow this [demo](https://github.com/OpenGVLab/Ask-Anything/blob/main/video_chat2/demo/demo_mistral_hd.ipynb) for testing, and encountered an issue related to Bert Tokenizer , below is the the error message, can you help me to fix...

daisyyywang

Get an import error when install vllm by source

1

When I import vllm after installing vllm by source, I get this error below. "ImportError: /opt/conda/lib/python3.10/site-packages/vllm/_C.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN3c104cuda9SetDeviceEi" Could I get any tips?

Rhealalalala

What validation dataset did you use during the training process?

1

Hello authors, What validation dataset did you use to during the training epochs of stage 1, 2, and 3, respectively? I believe validation accuracy is important to monitor model convergence...

jpan72

VideoChat2-text basline

7

Hello, Thank you for putting out this amazing set of models, datasets and evals! Is it possible to release the code and details for the VideoChat2-text baseline from your paper?...

BennoKrojer

Has anyone done performance optimization？

xusk

model zero-shot retrieval capability of the videochat2 stage-1 model

7

Hello. Can you apply the evaluation results (especially the zero-shot retrieval performance on MSR-VTT dataset) for the videochat2 stage-1 model. Should it perform better the _**UMT model**_ or not? Thanks.

wengzejia1

Discrepancy in Image ID Alignment Between M3IT and VideoChat2IT

4

Could you please provide a script or JSON file of the ID map from M3IT to VideoChat2IT? Matching different files can be quite challenging. For example, `coco llava minigpt4 paragraph_captioning...

patrick-tssn

Do you have the code to test LLaVa-v1.5-7B on MVBench? Thanks you very much.

Liuziyu77

How to submit result to mvbench board actually?

2

Looks like the posted result will be wiped out the other day. Shall we provide more detailed result json of each sample?

lucasjinreal

How to get dataset?

3

Hello, I would like to ask if videochat2-it has any officially provided processed data, including the storage format of the data, because I found that some data links on your...

caichaoxiang