kondvit issues

Repositories
Issues
Comments

Results 2 issues of


kondvit

[BLIP2] Model names typo

https://github.com/salesforce/LAVIS/blob/47e0f3f25ca763975738c7224c8369207812ce6c/lavis/models/blip2_models/blip2_opt.py#L24-L25 The model names should be pretrain_opt2.7b and pretrain_opt6.7b

[BLIP2] lavis/tasks/base_task.py accum_grad_iters division for reduction

Hello, First of all, awesome work Salesforce team. I am finetuning Blip2FlanXL I noticed in base_task.py you are not dividing loss by accum_grad_iters. https://github.com/salesforce/LAVIS/blob/47e0f3f25ca763975738c7224c8369207812ce6c/lavis/tasks/base_task.py#L214-L230 For FlanXL the default loss reduction...