feiliya333

[BUG] deepspeed Chat. OOM when running "single_node" mode because deepspeed is assigning calculating job to a small display card instead of other four A100 gpu cards

2

**Describe the bug** i have 5 gpus card on my machine, 0,1,2,4 are A100 and gpu-3 is a small capacity display card(4GB), but the deepspeed is running on the gpu-0,1,2,3...

[question] how many GPUs are used by 'single_node' in the default deepchat running script

3

i only have 2 A100(80GB), so I need to know about the count of GPUs used by single_node to adjust train_batch_size in my situation. thanks in advance.

**Describe the bug** A clear and concise description of what the bug is. **To Reproduce** Steps to reproduce the behavior: 1. Go to '...' 2. Click on '....' 3. Scroll...

[bug] It seems that LLaVA/llava/train/train.py has not been updated for v1.6

4

### Describe the issue For example, in the current LLaVA/llava/train/train.py, there is no image_grid_pinpoints parameter in the model_args, which will be used in llava/mm_utils.py, line176: image = process_anyres_image(image, image_processor, model_cfg.image_grid_pinpoints)