LukeBailey181

[Feature request] Why torch.no_grad on CLIPVisionTower Foward

2

### feature In `llava/model/multimodal_encoder/clip_encoder.py` line 39, the forward pass of the vision encoder has `torch.no_grad` decorator. I am trying to do some input optimization, and I think this is stopping...