penolove
penolove
Hi, my device single 1070, cuda 8.0, cudnn 5.0 and follows your 4 step installation git clone --recursive https://github.com/bharatsingh430/py-R-FCN-multiGPU/ install NCCL and sucessfully compile the caffe , build Cython modules...
in the propose to promote this application, the easy to startup the application is important for the command provided in the README `sh ./launch_tornado.sh` which didn't work in my env...
is quite interesting of this awesome work. do you ever try that 1. train with SPIN only 2. train with SFT + SPIN + DPO 3. mixture the SPIN +...
https://pytorch.org/docs/stable/generated/torch.nn.KLDivLoss.html  according to the formula, it's seems just equivalent to optimize soft-label cross-entropy, since the target y_true is just a constant decided by teacher model https://pytorch.org/docs/stable/generated/torch.nn.CrossEntropyLoss.html#crossentropyloss isn't it? or...