Ovis

Ovis copied to clipboard

If it is possible to run inference with OVIS 1.6 on a single 4090 GPU?

6

Could anyone please advise if it is possible to run inference with OVIS 1.6 on a single 4090 GPU? After loading the model, it appears to consume approximately 20GB of...

Raven625

Can I use this model with the CPU without GPU?

peterlong2003

Finetune Ovis 1.6 with LoRA

1

Thank for your great work! @runninglsy How can I finetune Ovis 1.6 with LoRA?

anhquannguyen21

hey, while running on 4bit quantized model from https://huggingface.co/ThetaCursed/Ovis1.6-Gemma2-9B-bnb-4bit i am getting the following error ``` { "name": "RuntimeError", "message": "self and mat2 must have the same dtype, but got...

haiderasad

How to use multiple GPUs for inference?

6

I want to use multiple GPUs for inference, and I use device_map='auto' to load the model. However, I always met that problem: Expected all tensors to be on the same...

waltonfuture

Can I identify and analyze videos? How to input video? Do you have any examples

1

Can I identify and analyze videos? How to input video? Do you have any examples，How much GPU is needed to run

libai-lab

Huggingface -> Hugging Face

eltociear

training script

2

Hello! Ovis 1.6 is indeed impressive! Could you please explain the differences between the scripts for Ovis 1.5 and Ovis 1.6? Also, do you have any plans to release the...

ecnuycxie

Traning script and data_info_v1.6 will be open source?

2

Will the complete training code and training data be open source?

liuheng0111

Failed to process batch: Currently, only support `batch_size=1`

5

When will support for batch size > 1 be available, or where should I make modifications to enable this feature?

Phoenix724