MiniGPT-4

MiniGPT-4 copied to clipboard

GPTQ quantization version Vicuna?

3

Can we use a GPTQ quantized version of Vicuna v0 as the backbone?

OedoSoldier

Any idea if this will work on CPU?

4

First of all, thanks for this great project! The output quality seems very good, and the idea of running a multimodal model to work locally is awesome. It seems we...

spikespiegel

segmentation fault

1

mac Apple M1 Pro 32 GB Vision-CAIR/MiniGPT-4/minigpt4/models/eva_vit.py self.pos_embed = nn.Parameter(torch.zeros(1, num_patches + 1, embed_dim)) num_patches = 256 embed_dim = 1408 but I got error: "[1] 14423 segmentation fault python demo.py...

garvinzhang

Error running evaluation on dual GPUs

3

I'm attempting to run the model on dual RTX 4090s. Enabling this would be a great update and would allow more people to run the full float16 model. Some changes...

valine

Conda env create error on Mac M2

14

MacBook Air M2 Steps to reproduce: > conda env create -f environment.yml Collecting package metadata (repodata.json): done Solving environment: failed ResolvePackageNotFound: - cudatoolkit

DexterLagan

Name is misleading

2

This project is not related to GPT-4. It is not part of the same lineage, from the same company, or anywhere near the same size / composition. Unsuspecting users can...

iandanforth

Thanks for your great project. Is there any results on some standard benchmarks?

2

Such as COCO, Flickr30k caption, VQAv2, etc.

vtddggg

raise ImportError( ImportError: Using `low_cpu_mem_usage=True` or a `device_map` requires Accelerate: `pip install accelerate`

4

SUWEN-WEIJI

Error in loading pretrained minigpt-4 checkpoint

1

Thank You for the wonderful work. I am trying to run demo on local using the minigpt-4 pretrained ckpt but get following error. Error(s) in loading state_dict for MiniGPT4: size...

OmkarThawakar

I made a colab I hope you like it

3

thanks for the project ❤ https://github.com/camenduru/MiniGPT-4-colab

camenduru