DDP set device id

[yetiansh]

Hi, I am using LAVIS to train albef model recently, while I find a potential issue.

At here, we are applying torch DDP to the original model that requires device id, i.e., the rank of current process.

However, I think it is not the responsibility of config file to set rank for each process and it results in failure. I suggest using get_rank instead.