Video-LLaMA
Video-LLaMA copied to clipboard
Possible bugs in LR scheduler
trafficstars
Hi, do you think the following could be bugs in the lr scheduler?
- https://github.com/DAMO-NLP-SG/Video-LLaMA/blob/ae12557b8510a7cc94baa3d3aea58ea07f6de76a/video_llama/common/optims.py#L83 should be
step=total_cur_step,? - https://github.com/DAMO-NLP-SG/Video-LLaMA/blob/ae12557b8510a7cc94baa3d3aea58ea07f6de76a/video_llama/common/optims.py#L91 should be
epoch=total_cur_step - self.warmup_steps,? - https://github.com/DAMO-NLP-SG/Video-LLaMA/blob/ae12557b8510a7cc94baa3d3aea58ea07f6de76a/video_llama/common/optims.py#L93 should be
max_epoch=self.max_epoch * self.iters_per_epoch - self.warmup_steps,?