LLaVA-NeXT icon indicating copy to clipboard operation
LLaVA-NeXT copied to clipboard

Request for Detailed Parameter Breakdown of LLaVA-NeXT-Interleave 7B Model and VRAM Requirements

Open YoungjaeDev opened this issue 1 year ago • 0 comments

I'm looking for specific information about the LLaVA-NeXT-Interleave 7B model

  1. Detailed parameter breakdown

    1. Language Model (LLM) size
    2. Image Encoder size
    3. Projector size
  2. VRAM requirements for evaluation: I'm encountering OOM (Out of Memory) errors when trying to evaluate the 7B model. What is the minimum VRAM required to successfully run the evaluation?

YoungjaeDev avatar Aug 24 '24 13:08 YoungjaeDev