vector-quantize-pytorch icon indicating copy to clipboard operation
vector-quantize-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon lucidrains

Is it possible to use Cosine Distance in Residual-VQ?

Open zhengsipeng opened this issue 1 year ago • 1 comments
trafficstars

Hi, I just wonder is it possible to adopt cosine distance instead of Eu distance in Residual VQ? Have you ever tried this before?

zhengsipeng avatar Dec 04 '23 02:12 zhengsipeng

@zhengsipeng i haven't heard of anyone getting good results with cosine distance VQ in general. i may remove it at a later date

lucidrains avatar Dec 04 '23 16:12 lucidrains